Job description

Role - Azure Databricks Developer / Data Engineer Location - Louisville, KY (Onsite) Exp need - 8+ years Job Summary We are seeking a skilled zure Databricks Developer to design, build, and optimize large-scale data processing solutions in the cloud. The ideal candidate will have hands-on experience with zure Databricks , pache Spark , and zure Data Services , and will be responsible for developing data pipelines, integrating multiple data sources, and supporting analytics and AI workloads. Key Responsibilities • Design and implement ETL/ELT pipelines using zure Databricks , zure Data Factory (ADF) , and zure Synapse Analytics . • Develop data transformation workflows using PySpark , Scala , or SQL within Databricks. • Optimize data processing for performance, scalability, and cost efficiency. • Integrate structured and unstructured data from multiple on-premise and cloud data sources. • Collaborate with data scientists, analysts, and business teams to deliver high-quality datasets and models. • Manage Delta Lake implementations for data versioning and ACID transactions. • Implement data quality checks , monitoring , and error handling across pipelines. • Contribute to CI/CD automation for data workflows using zure DevOps or GitHub Actions . • Ensure compliance with data governance , security , and privacy policies. • Troubleshoot performance issues and provide technical support for production pipelines. Required Skills & Qualifications • Bachelor's degree in Computer Science, Information Systems, or related field. • 6+ years of experience in data engineering or cloud data development . • Strong expertise in zure Databricks and pache Spark (PySpark or Scala). • Experience with zure Data Factory , zure Synapse , zure Data Lake Storage (ADLS) , and zure SQL . • Proficiency in SQL , Python , and Spark optimization techniques . • Understanding of data lakehouse architectures , Delta Lake , and Medallion (Bronze/Silver/Gold) design patterns. • Experience working with CI/CD pipelines , version control (Git) , and DevOps tools . • Familiarity with data governance , security roles , and ccess management in Azure. Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Requirements