Job description

Software Methods is seeking an Azure Data Engineer, for a one-year contract opportunity, to assist our client in their Chadds Ford, PA facility. The ideal candidate will have one to two years’ experience in a corporate pharmaceutical setting. This is an on-site assignment. If you’re the right one for us, you love working with data. You take great pride in your work, think of data transformation as more than just a job, and have a few great projects to show off. You can take a concept and transform it into an awesome data experience with your own technical and administrative expertise. Responsibilities: • Develop and manage effective working relationships with other departments, groups, and personnel with whom work must be coordinated or interfaced • Data Modeling & strong analytics and problem-solving skills. • Efficiently communicate with ETL architect while understanding the requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users • Assist in the overall architecture of the ETL Design, and proactively provide inputs in designing, implementing, and automating data strategies • Investigate and mine data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions • Build data pipelines and data flows in and out of the data storage using Azure Data Factory. • Solution and design data delivery mechanisms using Azure Synapse, Azure Blob Storage and Azure SQL Server databases. • Develop complex python scripts in conjunction with the Spark framework using the Databricks platform. • Responsible for documenting the implementations, and test cases as well as responsible for building deployment documents needed for CI/CD. • Familiarity with data visualization tools (e.g. Power BI, Qlik Sense etc.) • Ability to identify data bottlenecks and provide solutions. Required Experience: • Bachelor’s degree or equivalent work experience • 3+ years of experience in data warehousing concepts, ETL concepts, and working with ETL/Data quality tools on any ETL platform • 3+ years of experience in writing complex SQL queries, stored procedures and performance tuning • 1+ years of experience with Microsoft Azure cloud services and data warehouse environment • 1+ years of experience with building, deploying, and troubleshooting data extraction and loading pipelines (ETL) using Azure Data Factory (ADF) • 1+ years analyzing and executing data profiles. referred Experience: • Azure Certification in database and data engineer roles • 1+ years of experience developing a data solution on Snowflake Data Warehouse using snowflake continuous data pipelines with Snowpipe, Streams and Tasks • 1+ year of experience working with pharmaceutical data. • Familiar with R programming and Data Science concepts. • Familiar with data orchestration tools such as Airflow. If this sounds like you, please contact us today! Unable to sponsor visas for this position. Please encourage those authorized, to work in the U.S. without a visa, to apply! No third parties please.

Requirements