Job description

About the position Responsibilities • Design and architect end-to-end Microsoft Fabric solutions including data lakes, data warehouses, and real-time analytics platforms • Design and deploy AI models using Azure AI Foundry and Azure OpenAI Service • Implement Microsoft Copilot solutions across the Microsoft ecosystem, including customization and integration with Fabric data sources • Design, build, and troubleshoot data acquisition pipelines from diverse sources including SQL databases, APIs, Salesforce, Oracle, and Dynamics into Microsoft Fabric using Dataflows Gen2 and Azure Data Factory • Implement Direct Lake connectivity and optimize semantic models for high-performance analytics and reporting • Design and implement medallion architecture (bronze, silver, gold) data lake patterns • Proactively identify and resolve issues across the data stack such as ingestion failures, performance bottlenecks in Fabric Notebooks (Spark/Python), KQL databases, and data modeling inconsistencies • Implement real-time streaming analytics solutions using Event Streams and KQL Database • Experience with Fabric Capacity Metrics app for performance monitoring and optimization • Establish data governance frameworks using Microsoft Purview and Fabric governance capabilities • Lead AI strategy development and implementation roadmaps for enterprise clients • Stay current with Microsoft Fabric roadmap and emerging AI capabilities • Develop accelerators, templates, and best practice frameworks • Contribute to proposal development and pre-sales technical discussions • Create intellectual property including white papers and case studies • Lead discovery sessions to understand client requirements and current state architecture • Conduct knowledge transfer sessions and create comprehensive documentation • Provide ongoing support and optimization recommendations post-implementation Requirements • 7+ years of data engineering experience with a focus on cloud-native data architectures • Hands-on experience with Microsoft Fabric and its components (Data Factory, OneLake, Lakehouse, Dataflows Gen2, Direct Lake, Notebooks, Power BI, KQL databases) • Expert-level knowledge of Azure cloud services, particularly data and AI services • Strong proficiency in SQL, Python, and DAX • Robust understanding of data modeling, ETL/ELT processes, and data warehouse design principles • Experience with CI/CD pipelines and DevOps practices for data and AI solutions • Background with configuring incremental refresh and partitioning strategies to optimize compute unit (CU) consumption and query performance • Familiarity with implementing and managing RBAC (Role-Based Access Control) with a zero-trust security approach, ensuring appropriate access to data and services across cross-workspace environments • Experience implementing and customizing Microsoft Copilot solutions (Microsoft 365 Copilot, Copilot for Power Platform, Copilot in Fabric) • Hands-on experience with Azure OpenAI Service, including GPT models and prompt engineering • Prompt engineering and integration with LLM APIs (e.g., OpenAI, Minstrel, LLaMA) • Knowledge of RAG (retrieval augmented generation) pipelines or hybrid search architectures • Excellent problem-solving skills and ability to translate high-level ML goals into production-ready systems • Familiarity with containerization (Docker) and deployment tools (Azure Container Apps, etc.) • Understanding of responsible AI principles and governance frameworks • Knowledge of Azure DevOps practices and model lifecycle management Nice-to-haves • Microsoft certifications: Azure Data Engineer Associate, Azure AI Engineer Associate, Fabric Analytics Engineer Associate, or Microsoft 365 Certified: Enterprise Administrator Expert • Hands-on experience with Spark/Python development in Fabric Notebooks • Knowledge of data mesh governance, cross-workspace data sharing, and advanced data modeling techniques • Knowledge of industry-specific data models (healthcare, financial services, retail) • Experience with comparable cloud data platforms (AWS, Snowflake, Databricks) • Advanced degree in Computer Science, Data Science, or related field • Previous experience at a major consulting firm or Microsoft partner Benefits • Training Opportunities: We believe in lifelong learning and provide numerous avenues for skill enhancement • Fully Invested 401K Plan: We help secure your future with a fully invested 401K plan • PPO and HDHP Medical Plans: Choose the health insurance program that best fits your needs • Employer-Paid Dental and Vision Plans: We cover dental and vision plans, ensuring our employees have access to comprehensive health care • Onsite Fitness Center: Stay fit and healthy with our state-of-the-art fitness center • Wellness Program: We promote a healthy lifestyle with our wellness program • Catered Lunches: Enjoy delicious catered lunches regularly

Requirements