Allata is seeking a Lead Data Engineer to design and implement data pipelines using Microsoft Fabric tools in Dallas, TX. The role involves collaborating with cross-functional teams to deliver high-quality data products for enterprise data platform projects.
Role & Responsibilities: - Design and implement data pipelines using Microsoft Fabric’s integrated tools (Data Factory, Pipelines, Dataflows Gen2, etc.). - Work with Lakehouses and Delta tables to support structured and semi-structured data storage. - Develop and maintain data models and transformations using Fabric’s SQL and Spark engines. - Enable real-time and batch data processing for analytics and reporting use cases. - Collaborate with analysts, data scientists, and business users to understand data needs and deliver reliable, governed data products. - Ensure data quality, lineage, and compliance with security and governance policies. - Monitor and optimize performance and cost of data workflows. Hard Skills - Must Have: - Experience in data engineering, with at least 1 year working directly with Microsoft Fabric (or deep experience in Synapse + Data Factory + Power BI prior to Fabric). - Proficiency in data modeling, ETL/ELT, and working with large-scale datasets. - Experience with Delta Lake and Lakehouse architectures. - Strong skills in SQL, and optionally in PySpark or T-SQL. - Familiarity with Microsoft Purview, Azure Data Lake, and Azure Active Directory integration. - Experience integrating data from various sources (on-prem, cloud, APIs). Soft Skills / Business Specific Skills: - Ability to identify, troubleshoot, and resolve complex data issues effectively. - Strong teamwork, communication skills and intellectual curiosity to work collaboratively and effectively with cross-functional teams. - Commitment to delivering high-quality, accurate, and reliable data products solutions. - Willingness to embrace new tools, technologies, and methodologies. - Innovative thinker with a proactive approach to overcoming challenges.
Allata is seeking a Lead Data Engineer to design and implement data pipelines using Microsoft Fabric tools in Dallas, TX. The role involves collaborating with cross-functional teams to deliver high-quality data products for enterprise data platform projects.