Job description

Job Title: Databricks Engineer -USC or GC (3-Month Contract – Remote) Location: Remote Duration: 3 Months (Contract) Start Date: 04/01/2025 Compensation: Commensurate with experience Must be US Citizen or Green Card Overview: We are seeking an experienced Databricks Engineer for a 3-month contract engagement. This fully remote role involves supporting our data engineering and analytics initiatives by designing and optimizing Databricks solutions that enable efficient data processing, transformation, and delivery. Key Responsibilities: • Design, develop, and maintain scalable data pipelines using Databricks. • Implement ETL/ELT processes to support data integration and analytics use cases. • Optimize Spark-based workflows and ensure efficient performance on Databricks clusters. • Collaborate with data scientists, analysts, and other engineers to ensure clean, structured, and accessible data delivery. • Ensure data quality, reliability, and security best practices. • Support and troubleshoot existing data pipelines and workflows. • Assist in knowledge transfer and documentation of processes and architectures. Required Skills & Experience: • Strong hands-on experience with Databricks and Apache Spark. • Proficiency in Python and/or Scala for data processing. • Experience with Delta Lake, MLflow, and Databricks SQL. • Strong understanding of data warehousing, data lakes, and modern data architecture. • Experience building and optimizing ETL/ELT pipelines in cloud environments (Azure, AWS, or GCP). • Familiarity with CI/CD and version control tools (e.g., Git). • Excellent problem-solving and communication skills. Nice to Have: • Experience integrating Databricks with BI tools (e.g., Power BI, Tableau). • Exposure to machine learning pipelines or data science workflows. • Experience with Airflow, dbt, or other orchestration tools.

Requirements