Job description

About Technical Lead ( Azure Data Factory ) San Jose, CA 95110 / Santa Clara, CA 95054 (Onsite) Salary: Market/DOE We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data engineering and migration projects. The ideal candidate will have hands-on expertise in SAP HANA, Databricks, Azure Data Factory, and related technologies, with a proven track record of leading at least 3 successful data projects. Experience/Skills • Minimum of 8 years of experience in data engineering/architecture roles • Must have led 3 or more end-to-end enterprise data projects involving SAP HANA, Databricks, and Azure technologies • Deep knowledge of SAP HANA architecture and complex data models • Extensive experience with Databricks, PySpark, Spark SQL, and Delta Lake • Strong command over ETL tools such as SAP Data Services and Azure Data Factory • Proficient in programming languages: Python, Java, or Scala • Hands-on with Azure cloud services including networking and security configurations • Bachelor's degree in Computer Science, Information Systems, or a related field Key Responsibilities • Lead the design and implementation of ETL solutions using SAP Data Services and Azure Data Factory • Guide and mentor team members on data engineering best practices • Develop and maintain complex ETL pipelines using Python, Java, or Scala • Ensure high-quality, secure, and performant data migrations using Azure Blob Storage and Spark JDBC • Drive collaboration across teams to implement advanced analytics and ML models in Databricks • Identify and resolve performance bottlenecks and network-related issues • Ensure adherence to data governance and compliance standards across all data flows • Analytical Skills: Strong analytical and problem-solving skills, with the ability to interpret complex data sets and derive meaningful insights • Communication Skills: Excellent verbal and written communication skills, with the ability to convey technical information to non-technical stakeholders • Leadership Skills: Proven ability to lead and manage teams, with a track record of successful project delivery • Presentation Skills: Effectively presenting project updates and outcomes to stakeholders and executives Secondary Skills / Good To have • Understanding of Databricks ML and analytics tools; Experience resolving networking/VPN issues related to data flow • Familiarity with data governance, security, and compliance frameworks; setting up CI/CD pipelines and using DevOps tools is a plus Yamini D TechnoGen Inc Nice-to-have skills • Azure Data Factory • SAP Hana • PySpark • Python • Java • Scala • Santa Clara, California Work experience • Data Engineer • Data Infrastructure Languages • English

Requirements