Job description

Databricks Azure Engineer MAHIN-JOB-32334 Job Title:- Databricks Azure Engineer Experience: 8 + Years Job Location : Santa Clara, CA (Onsite) Job Description • Hands on experience in Databricks stack • Data Engineering technologies (Ex: Spark, Hadoop, Kafka etc.,) • Must me proficient in Streaming technologies • Hands on in Python, SQL • Expertise in implementing Data warehousing solutions • Expertise in Any ETL tool i.e. (SSIS, Redwood) • Good understanding on submitting jobs using Workflows, API & CLI • Designing and implementing highly performant data pipelines from multiple sources using Apache Spark and/or Azure Databricks • Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained • Highly proficient in using the spark framework (python and/or Scala) • Programming experience in Scala or Python, SQL • Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably in Databricks). • Hands on experience designing and delivering solutions using Azure including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics • Experience with ingestion tools (nifi/azure cloud factory • Experience with big data technologies (Hadoop)

Requirements