Job description

Job Description We are looking for an experienced Senior Data Engineer with strong expertise in IBM DataStage and Microsoft Azure Data Factory (ADF) to lead large-scale migration projects. The ideal candidate will have 10+ years of experience in designing, developing, and implementing enterprise-scale data solutions, with a proven track record of modernizing ETL pipelines and data integration platforms. Responsibilities Lead the end-to-end migration of ETL processes from IBM DataStage to Azure Data Factory. Analyze existing DataStage jobs, workflows, and dependencies to design optimized ADF pipelines. Collaborate with architects, data modelers, and business stakeholders to gather and validate requirements. Implement best practices for Azure cloud data engineering, including performance tuning, security, and cost optimization. Develop reusable frameworks, templates, and automation scripts for efficient migration. Conduct code reviews, troubleshoot issues, and provide technical guidance to junior team members. Ensure compliance with data governance, quality, and security standards. Prepare technical documentation and present solutions to technical and non-technical stakeholders. Required Skills & Experience 10+ years of experience in Data Engineering with strong background in IBM DataStage. Hands-on migration experience from on-premise ETL tools to Azure Data Factory. Proficiency in designing data pipelines using ADF (Mapping, Wrangling, Data Flows, Integration Runtimes). Strong SQL development skills (T-SQL, PL/SQL) and experience with relational databases (SQL Server, Oracle, etc.). Knowledge of Azure ecosystem including Data Lake, Synapse Analytics, Databricks, Logic Apps, Key Vault. Experience in scheduling, orchestration, and monitoring of ETL/data workflows. Familiarity with Git-based CI/CD, DevOps practices, and infrastructure as code (ARM/Bicep/Terraform). Strong analytical and problem-solving skills with excellent communication abilities. Preferred Skills Experience migrating large-scale ETL systems to cloud data platforms. Familiarity with data modeling, performance optimization, and big data technologies. Exposure to Power BI or other data visualization/reporting tools.

Requirements