Job description

Azure Data Engineer with PythonJersey City, NJ11+ and W2 Only The RoleResponsibilities:Help us implement our data strategy, design, develop and maintain efficient data pipelines in Azure.Automate data workflows for both real-time and batch processing.Integrate data from various sources and sync data to various systems.Implement data quality checks and ensure data integrity, consistency and reliability.Help build the required infrastructure and DevOps pipelines.Requirements:Cloud experienceFluent with Azure/ Power platform Data technologies like Data Factory, Data Fabric, Data Lake Storage. SQL Database, Data Explorer, Synapse Analytics, PurviewAzure Identity management such as AKV, UAMI.ETL experienceFluent with Big Data technologies like Spark, Kafka and Hive,Demonstratable knowledge of applying data engineering processes and principles in an Agile environment.Programming skills/ DevOpsExperience of setting up CI/CD pipeline like GitLab/Teamcity/Jenkins.OtherAbility to work with analysts and other subject matter experts, in a globally distributed team, to test changes to our trading application suite.Prior experience of working in a fast-paced global organization with teams in various geographical locations.Soft skillsAbility to work with analysts and other subject matter experts, in a globally distributed team, to test changes to our trading application suite.Preferred, but not required:Preferably in the financial services industry. Ability to adapt to frequent changes, work to a schedule and meet the deadlines.Ability to continuously learn about business and technology processes in order to test them and protect the reliability and integrity of front office applications.Innovation skills to suggest ways to enhance our data sharing processes to make them more effective and efficient.Good interpersonal skills, ability to communicate well verbally and in writing, experience working with distributed computing platforms.

Requirements