Job description

Hi, We do have an urgent requirement for the below position with our direct client, Please submit Resume, Rate and Contact details. Title: Data Engineer Duration: Long Term Location: Washington, DC (Hybrid) Job Summary: We are seeking a highly skilled Senior Data Engineer with 10+ years of IT experience, specializing in Azure cloud data services and Python development. The candidate will design, build, and optimize data pipelines, ensuring scalability, performance, and data quality across enterprise analytics platforms. Key Responsibilities: • Design and develop data pipelines and ETL processes using Azure Data Factory, Databricks, and Python. • Build, optimize, and maintain data lakes and data warehouses on Azure (Azure Data Lake, Synapse). • Develop reusable Python scripts for automation, data transformation, and integration. • Work with structured, semi-structured, and unstructured data (CSV, JSON, Parquet, streaming). • Implement data quality, governance, and security best practices in Azure environments. • Collaborate with data architects, analysts, and business stakeholders to translate requirements into scalable data solutions. • Support real-time and batch data processing using Azure Event Hub, Kafka, or similar tools. • Monitor, troubleshoot, and optimize pipelines for performance and cost efficiency. • Contribute to CI/CD pipelines and infrastructure-as-code deployments (Azure DevOps, Terraform). Required Skills & Experience: • 10+ years of IT experience, with at least 5+ years in Data Engineering. • Strong expertise in Azure Data Services: Azure Data Factory, Azure Data Lake, Azure Synapse, Databricks. • Proficiency in Python for data engineering (PySpark, Pandas, automation scripts). • Experience with SQL (performance tuning, stored procedures, complex queries). • Knowledge of ETL design, data modeling, and data warehouse concepts. • Familiarity with CI/CD pipelines, version control (Git), and DevOps practices. • Experience in handling large-scale datasets in a cloud environment.

Requirements