Job description

About the position Responsibilities • Maintain and operate legacy ETL processes utilizing Microsoft SSIS, Powershell, SQL procedures, SSAS, .NET code, and other technologies. • Implement full lifecycle Azure cloud native data pipeline development and operation. • Work closely with client personnel and team members to understand data requirements and develop appropriate data solutions. • Support the design and implementation of data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, SQL and NoSQL data stores. • Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures to develop high performing data pipelines. • Redevelop existing SSIS extract, transform, load scripts to Azure Data Factory and Synapse Pipelines. • Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML. • Implement data migration, data integrity, data quality, metadata management, and data security functions to optimize data pipelines. • Monitor and troubleshoot data related issues to maintain high availability and performance. • Implement governance, build, deployment and monitoring to automate platform operation. • Actively support Agile DevOps process, including Program Increment planning. • Actively engage in continuous learning to increase relevant skills. • Maintain strict versioning and configuration control to ensure integrity of data. Requirements • BS degree in Computer Science or related field and 8+ years or Masters with 6+ years of experience • 4+ years of experience developing and maintaining ETL processes using Microsoft SSIS, SQL, SQL Agent, and scripting languages including Powershell. • 4+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, Python, PySpark • Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes), scripting languages including PowerShell • Experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synasolutions • Must have ability to obtain Public Trust Clearance

Requirements