Job description

Overview We are looking for a highly skilled, hands-on Senior Data Engineer to join our Data & Analytics team. In this role, you will build and scale behavioral and Ecommerce data platforms, enabling trusted analytics and making AI-ready data available across the organization. You will design and implement robust, scalable data pipelines, model complex, high-volume datasets, and deliver high-quality, well-structured data products to power business insights and future AI capabilities. This is a delivery-focused engineering position demanding deep technical expertise in Azure, Databricks, and Synapse, with experience managing large-scale behavioral data in enterprise environments. Required Qualifications 5+ years of experience in data engineering or similar roles, with hands-on delivery of cloud-based data solutions. Preferred Engineering certifications: Microsoft Certified: Azure Data Engineer Associate and Databricks: Databricks Certified Data Engineer Professional Strong expertise in Databricks and Azure Synapse, with practical experience in Spark-based data processing. Proficient in modern data architectures (Lakehouse, ELT/ETL pipelines, real-time data processing). Advanced SQL skills for data transformation and performance optimization. Proven ability to model and manage large-scale, complex behavioral and Ecommerce datasets. Expert in BI and best practices for data enablement and self-service analytics. Hands-on experience with Unity Catalog and data cataloging tools (e.g., Alation) for governance and metadata management. Working knowledge of behavioral analytics platforms (Adobe Analytics, Adobe Customer Journey Analytics). Strong collaboration and communication skills Experience operating in agile delivery environments, balancing speed, scalability, and solution quality. Key Responsibilities Design, build, and maintain robust, scalable ELT/ETL pipelines and data transformations using Databricks, Spark, and Synapse. Model high-volume, complex event-level datasets (digital behavior, Ecommerce transactions, marketing interactions) to support dashboards, experimentation, ML models, and marketing activation. Enforce data governance, discoverability, and stewardship using Unity Catalog and Alation, ensuring compliance and lineage tracking. Validate and reconcile data pipelines against established behavioral datasets such as Adobe Customer Journey Analytics (CJA) and Adobe Analytics. Partner with data architects, analysts, data scientists, and marketing teams to deliver trusted, reusable, and well-structured datasets that power BI dashboards and decision-making. Mature the data ingestion, processing, orchestration, and curation capabilities leveraging Delta Lake optimization, Databricks Workflows, and Synapse for analytical consumption. Support and optimize semantic models and data marts that enable self-service analytics through AI/BI Dashboards and Power BI. Participate in agile delivery processes (sprint planning, backlog refinement, documentation), collaborating through Jira and Confluence. Document data assets, transformations, and pipelines for discoverability, transparency, and long-term maintainability. Seniority level Mid-Senior level Employment type Contract Job function Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at Golden Technology. We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr Golden Technology

Requirements