Job description

Senior Azure Data Engineer (Manager) – Remote/White Plains, NY Skills – Data Engineering, Senior Data Engineer, Hands On, Azure, Azure Databricks, Azure Data Factory, Data Lakes, Management, Data Warehouse, Project Delivery, Communication Skills My client, a leading Global brand within the CPG industry, is currently looking to onboard a Senior Azure Data Engineer. The ideal individual will have a proven and strong hands-on background within Azure, Azure Databricks, Azure Data Factory, and building data lakes. This is a Full-Time position which will see individuals working remotely 2-3 days per week, with the remaining 2-3 days on-site at my client’s offices in White Plains, NY. The Role/Core Responsibilities: • As the Data Engineer, you will be directly responsible for the availability, quality, and reliability of data to meet business data needs across the organization. • The primary focus of this role will revolve around data warehouse maintenance in MS Azure. • As a Senior Azure Data Engineer, you will design, build, and maintain the data infrastructure to ensure seamless integration of internal and external systems and smooth data flow. • Work closely with the business to deliver complex data integrations and projects to meet client needs from a data perspective. • Design, build, and maintain data pipelines using tools such as Azure Data Factory, Databricks, Azure Synapse, SQL, and Python. • Oversee the creation of data pipelines and data marts in real-time, near real-time, and batch processing. • Ensure accurate and efficient integration of a large variety (structured, semi-structured, and unstructured) of data from various sources. • Own and manage all data warehouse deliverables, such as data models, ETL/ELT processes, and data quality assessments. • Ensure consistent adherence to data warehouse architecture standards through governance, best practices, and automation. • Manage the day-to-day operations of the Azure data, Power BI, and UC4 platforms. • Monitor, audit, and measure data warehouse performance and recommend improvements. • Manage the data lake environment, including blob storage. • Guide the development and implementation of procedures for the maintenance and monitoring of data warehouse and related systems. • Ensure the availability, performance, and scalability of the data warehouse platform, including data pipelines, security controls, administration tools, and warehouse database. The Candidate: • 8+ years of experience in data warehousing, data modeling, and data transformation. • Proven hands-on and extensive experience with Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake Storage (ADLS). • Strong grasp of data ingestion, transformation, and delivery (ETL/ELT) processes. • Expert knowledge of SQL Server environments for designing and developing databases. • Highly proficient in PySpark and SQL. • Experience working with Power BI dataflows and job scheduling platform UC4 is beneficial. • Extensive experience working with complex systems to retrieve, analyze, and synthesize data. • Proven ability to communicate complex technical processes and data concepts in an understandable manner to business stakeholders. • Prior experience implementing end-to-end data pipelines for large datasets using cloud and on-premise stacks. Salary – $150k-$170k Per Annum + Bonus (20%) + Benefits Please send resumes directly to View email address on click.appcast.io and we can look to run through the specifics. I look forward to hearing from you. #J-18808-Ljbffr

Requirements