Job description

Data Engineer (Azure Databricks and Microsoft Fabric) Data Engineer (Azure Databricks and Microsoft Fabric) Direct message the job poster from Charter Global Position: Analytics Engineer (Azure Databricks and Microsoft Fabric) Location: Atlanta, GA-30334 (Hybrid) Duration: Long Term Contract Local Resouces Only Independent Resources Only Primary Skills: 3+ years of experience in: Advanced SQL: Proficiency in advanced SQL techniques for data transformation, querying, and optimization. Microsoft Fabric (Dataflows, Pipelines, OneLake) SQL and Python (Pandas, PySpark) JOB DESCRIPTION: The Analytics Engineer will contribute to our modern data estate strategy by developing scalable data solutions using Microsoft Fabric and Azure Databricks. This role will be instrumental in building resilient data pipelines, transforming raw data into curated datasets, and delivering analytics-ready models that support enterprise-level reporting and decision-making. •Must be physically located in Georgia •On-site: Tuesday to Thursday, per manager's discretion •Mandatory in-person meetings: o All Hands o Enterprise Applications o DECAL All Staff •Work arrangements subject to management's decision Key Responsibilities: •Data Engineering & Pipeline Development •Build and maintain ETL/ELT pipelines using Azure Databricks and Microsoft Fabric. •Implement medallion architecture (Bronze, Silver, Gold layers) to support data lifecycle and quality. •Develop real-time and batch ingestion processes from IES Gateway and other source systems. •Ensure data quality, validation, and transformation logic is consistently applied. •Use Python, Spark, and SQL in Databricks and Fabric notebooks for data transformation. •Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement. •Integration with Azure Services: Integrating Databricks with other Azure services like Azure One Lake, Azure ADLS Gen2, and Microsoft fabric. Data Modeling & Curation •Collaborate with the Domain Owners to design dimensional and real-time data models. •Create analytics-ready datasets for Power BI and other reporting tools. •Standardized field naming conventions and schema definitions across datasets. Data Governance & Security •Apply data classification and tagging based on DECAL’s data governance framework. •Implement row-level security, data masking, and audit logging as per compliance requirements. •Support integration with Microsoft Purview for lineage and metadata management. Data Modeling: •Dimensional modeling •Partner with BI developers to ensure data models are optimized for Power BI. •Provide curated datasets that align with reporting requirements and business logic. •Create BI dashboards and train users. DevOps & Automation •Support CI/CD pipelines for data workflows using Azure DevOps. •Assist in monitoring, logging, and performance tuning of data jobs and clusters. Required Qualifications: •Bachelor’s degree in computer science, Data Engineering, or related field. •3+ years of experience in data engineering or analytics engineering roles. •Advanced SQL: Proficiency in advanced SQL techniques for data transformation, querying, and optimization. •Hands-on experience with: o Microsoft Fabric (Dataflows, Pipelines, OneLake) o SQL and Python (Pandas, PySpark) o SQL Server 2019+ •Familiarity with data modeling, data governance, and data security best practices. •Strong understanding of ETL/ELT processes, data quality, and schema design. Preferred Skills: •Experience with Power BI datasets and semantic modeling. •Knowledge of Microsoft Purview, Unity Catalog, or similar governance tools. •Exposure to real-time data processing and streaming architectures. •Knowledge of federal/state compliance requirements for data handling •Familiarity with Azure DevOps, Terraform, or CI/CD for data pipelines. Certifications (preferred): •Microsoft Fabric Analytics Engineer. Seniority level Seniority level Mid-Senior level Employment type Employment type Contract Job function Job function Information Technology Industries IT Services and IT Consulting and Government Relations Services Referrals increase your chances of interviewing at Charter Global by 2x Sign in to set job alerts for “Data Engineer” roles. Atlanta, GA $106,300.00-$175,400.00 5 months ago Atlanta, GA $123,000.00-$203,000.00 5 months ago Atlanta, GA $61,900.00-$141,000.00 5 hours ago Atlanta, GA $106,300.00-$175,400.00 3 months ago Atlanta, GA $106,300.00-$175,400.00 1 month ago Atlanta, GA $140,000.00-$180,000.00 2 weeks ago Atlanta, GA $105,000.00-$195,000.00 1 hour ago Atlanta, GA $138,000.00-$181,650.00 2 days ago Atlanta, GA $110,000.00-$115,000.00 3 weeks ago Atlanta, GA $108,000.00-$142,000.00 2 weeks ago Atlanta, GA $123,000.00-$203,000.00 4 months ago Atlanta, GA $61,900.00-$141,000.00 10 hours ago Atlanta, GA $124,000.00-$162,800.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr

Requirements