Job description

for first 1-2 week cnadidate needs to work onsite in Chicago, IL and then it will be remote (client wont pay for any expenses for this) Job Description: Azure Databricks Engineer Job Title: Azure Databricks Engineer Location: Chicago, IL and then Remote Qualifications: • Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field. • 5+ years of experience in data engineering, with at least 3 years focused on Azure data platforms. • Strong expertise in Azure Databricks, Apache Spark, and Delta Lake. • Proficiency in programming languages such as Python, Scala, or PySpark. • Hands-on experience with Azure Data Lake Storage Gen2 (ADLS Gen2). • Solid understanding of relational and NoSQL databases, data warehousing concepts, and data modeling. • Experience with other Azure data services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Event Hubs). • Familiarity with version control systems (e.g., Git). • Experience with CI/CD pipelines for data solutions (e.g., Azure DevOps). • Excellent problem-solving skills, analytical thinking, and attention to detail. • Strong communication and interpersonal skills, with the ability to collaborate effectively with technical and non-technical stakeholders. Preferred Qualifications: • Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert). • Experience with real-time data streaming technologies (e.g., Kafka, Azure Event Hubs/Stream Analytics). • Knowledge of data governance, data security, and compliance best practices in a cloud environment. • Familiarity with machine learning workflows and MLOps within Databricks. • Experience with Databricks Workflows or similar orchestration tools. If you are interested or have any references please share resume at mukul@brightmindsol.com.

Requirements