Job description

Azure Data Engineer job at Softthink Solutions Inc. Herndon, VA. About the Role: We seek a skilled Data Engineer to support multiple International organization projects. The consultant will work with a multidisciplinary team, delivering data solutions using cutting-edge technologies in a highly collaborative environment. Key Responsibilities: Design and implement data solutions using Microsoft Azure (preferred), AWS, or Google Cloud. Develop and optimize ETL/ELT processes using Azure Data Factory, Databricks, PySpark, SQL Server, and SSIS. Manage and optimize Data Lakes/Delta Lakes and complex data transformations. Build and maintain CI/CD pipelines using Azure DevOps. Migrate legacy data systems to modern platforms. Required Skills & Experience: 5+ years as a Data Engineer. Expertise in Microsoft Azure Data Services (Data Factory, Logic Apps, Azure Functions, Databricks, Synapse, DevOps). Strong SQL (T-SQL, Spark SQL) and Python/PySpark experience. Proven experience with Data Lakes, Delta Lakes, and ETL pipelines. Experience with CI/CD, PowerShell, and Bash scripting. Strong communication, collaboration, and problem-solving skills. Preferred: AI/ML and Business Intelligence (BI) knowledge is a plus. Experience in Agile methodologies (SCRUM, PMP, PRINCE2). Certifications: Azure Data Engineer Associate, DP-500, or related. This is a remote position. #J-18808-Ljbffr Softthink Solutions Inc

Requirements