Job description

Join our vibrant team at hackajob on-demand, where we specialize in matching talented contractors with organizations looking for specific skillsets. We're excited to connect you with engaging contract opportunities and share project details on behalf of our partnering companies. Job Opportunity: Senior Data Engineer (Azure & Dataverse Focus) We are seeking a skilled and experienced Data Engineer to contribute to the design, build, and optimization of our data solutions that are vital for driving business operations. If you are passionate about solving complex data challenges and enjoy working in a collaborative environment, this role is designed for you! Key Responsibilities: • Oversee and manage extensive multi-terabyte datasets within Dataverse, employing platforms such as Azure SQL and Azure Cosmos DB. • Design and implement robust data models (both relational and non-relational), emphasizing optimization and performance enhancements. • Conduct data archival processes and assist in reconciling large datasets. • Develop and maintain data warehousing solutions; familiarity with tools such as Microsoft Fabric is preferred, while Snowflake experience is a plus. • Build and manage ETL pipelines leveraging Azure Data Factory, Azure Databricks, and other Azure-native integration services. • Collaborate effectively with cross-functional teams, including developers, architects, and business analysts, to deliver scalable data solutions. Requirements: • Minimum of 5 years of experience in data engineering and database optimization. • In-depth, hands-on experience with Azure cloud data services. • Comprehensive understanding of Dataverse and Microsoft Dynamics 365 data architecture. • Proficiency in SQL and Python for data manipulation and pipeline development. • Awareness of data governance, security, and compliance in cloud environments. • Strong problem-solving abilities coupled with excellent communication skills. Preferred Qualifications: • Experience with Microsoft Fabric or Snowflake. • Familiarity with the Power Platform, particularly Power Apps and Power Automate. • Knowledge of data visualization tools like Power BI.

Requirements