Job description

Description Data Engineer (DataStage & ADF) We are seeking a seasoned Data Engineer with strong expertise in both IBM DataStage and Azure Data Factory (ADF). This role requires hands-on technical capabilities along with experience in leading offshore teams to deliver enterprise-grade data solutions across hybrid environments. Key Responsibilities: • 8+ years of experience in data engineering with a balanced focus on traditional ETL and modern cloud-based integration. • 4+ years of hands-on experience with IBM DataStage, including development, optimization, and support of complex ETL workflows. • 4+ years of experience with Azure Data Factory, Azure SQL Database, and other Azure-native services for data ingestion and transformation. • Experience in ETL migration projects, particularly transitioning DataStage workloads to ADF or equivalent cloud pipelines. • Ability to design, develop, and maintain ETL pipelines in both on-premise (DataStage) and cloud (ADF) ecosystems. • Proven ability to lead and coordinate offshore development teams, ensuring alignment with timelines, quality standards, and delivery goals. • Expertise in building and managing data pipelines using Databricks, implementing data quality, lineage, and governance practices. • Proficient in SQL and Python, including writing scripts for data manipulation and orchestration logic. • Experience in Azure-based data warehouse platforms like Azure Synapse Analytics, Azure Data Lake, and associated data services. • Familiar with CI/CD practices using Azure DevOps, including automation of pipeline deployment and version control. • Knowledge of data governance, security, and compliance best practices in the Azure cloud environment.

Requirements