Job description

Job Title: Azure Data Engineer Databricks & Microsoft Fabric Specialist Location: Atlanta, Georgia(Hybrid) We are currently seeking candidates who meet the following qualification Required Qualifications: • Bachelor's degree in Computer Science, Data Engineering, or a related field. • Minimum 3 years of experience in data engineering or analytics engineering. • Proficient in advanced SQL for data transformation, optimization, and querying. • Hands-on experience with: • Azure Databricks (Spark, Delta Lake) • Microsoft Fabric (Dataflows, Pipelines, OneLake) • SQL and Python (including Pandas and PySpark) • SQL Server 2019+ • Solid understanding of: • ETL/ELT processes • Data quality frameworks • Schema design and dimensional modeling • Data governance and security best practices Preferred Qualifications: • Experience working with Power BI datasets and semantic modeling. • Familiarity with Microsoft Purview, Unity Catalog, or other data governance tools. • Exposure to real-time data processing and streaming architecture. • Understanding of federal/state compliance requirements for data handling. • Experience with Azure DevOps, Terraform, or CI/CD pipeline automation. • Microsoft Fabric Analytics Engineer certification is a plus. Responsibilities:Data Engineering & Pipeline Development • Develop and maintain robust ETL/ELT pipelines using Azure Databricks and Microsoft Fabric. • Utilize the medallion architecture (Bronze, Silver, Gold) for structured data flow. • Build real-time and batch data ingestion solutions from IES Gateway and other systems. • Ensure high data quality, validation, and consistent transformation logic. • Write efficient Spark and SQL code using Databricks/Fabric notebooks. • Leverage Delta Lake for versioning, ACID transactions, and schema enforcement. • Integrate data pipelines with Azure services such as OneLake, ADLS Gen2. Data Modeling & Curation • Design dimensional and real-time data models in collaboration with Domain Owners. • Create analytics-ready datasets for Power BI and other reporting needs. • Standardize schema definitions and field naming conventions. Data Governance & Security • Implement data classification and tagging per DECAL's governance framework. • Apply row-level security, data masking, and audit logging. • Support metadata and lineage tracking through Microsoft Purview. Reporting & Visualization Support • Partner with BI developers to optimize data models for Power BI reporting. • Deliver curated datasets aligned with business logic. • Create and support BI dashboards; provide training for end users. DevOps & Automation • Support CI/CD processes for data pipelines using Azure DevOps. • Monitor data workflows, log issues, and fine-tune job and cluster performance. Soft Skills: • Strong analytical and problem-solving skills. • Excellent verbal and written communication for both technical and non-technical audiences. • Experience collaborating with government stakeholders is highly desirable. If you meet these qualifications, please submit your application via link provided in Linkedin. Kindly do not call the general line to submit your application. About the Company: ACS Consultancy Services

Requirements