Job description

Job Title: Azure Databricks Developer (Python, PySpark, SQL)Duration: Long-Term Contract Job Description:We are seeking an experienced Azure Databricks Developer with strong expertise in Python, PySpark, and SQL to join our team in Pittsburgh, PA. The ideal candidate will have hands-on experience building and optimizing data pipelines, working with large-scale datasets, and deploying solutions in Azure cloud environments. This role requires onsite presence 5 days a week in Pittsburgh, PA. Responsibilities:Design, develop, and optimize data pipelines and ETL workflows using Azure Databricks, PySpark, and SQL.Work with stakeholders to understand business requirements and translate them into scalable data solutions.Implement data processing, transformation, and cleansing for large-scale structured and unstructured data.Collaborate with data engineers, analysts, and architects to build reliable and high-performing data platforms.Ensure data quality, security, and compliance across all solutions.Monitor, debug, and optimize performance of Databricks clusters and jobs. Required Skills:Overall IT Experience: 8-10+ Years5+ years of hands-on experience with Azure Databricks.Strong expertise in Python, PySpark, and SQL.Solid experience with ETL pipeline design and data processing in cloud environments.Good understanding of Azure Data Lake, Azure Data Factory, and related Azure services.Experience working with large, complex datasets and performance tuning.Strong problem-solving and debugging skills. Nice to Have:Experience with Delta Lake, MLflow, or Spark Streaming.Familiarity with CI/CD pipelines and DevOps practices in Azure.Exposure to financial services, healthcare, or large-scale enterprise environments.

Requirements