Job description

Data Engineer job at NexTech Solutions. Pennsylvania. Role: Permanent - Data Engineer Location: Prefer local to Pittsburgh, PA (hybrid office schedule). Will consider Remote options within a couple of hours driving distance from Pitt. Expectations are to be in the office onsite 1-2x per quarter. No sponsorship. Must be USC or GC holder. SUMMARY Client is looking for a talented and experienced intermediate-senior level Quality Assurance Data Engineer to join their IT Product and Enterprise Data Warehouse team. In this role, you will design and execute test plans to ensure the highest quality software products for our specialty pharmacy customers. The ideal candidate for this role will have strong technical knowledge of data quality assurance. The candidate should have excellent communication and problem-solving skills and be able to think critically to evaluate and analyze reports, dashboards, and exports. This position will be responsible for evangelizing and executing data QA policies and procedures, adhering to company standards, and monitoring the process to ensure a high quality of deliverables. Top 4 Required Skills: • PySpark/Python experience & expertise for data quality checks and data validations. • ETL experience - Data extraction, data transformation, and data loading for data quality and analysis • Business Intelligence (BI) tools for dashboards, reporting, data visualization, data analytics, etc. (Power BI, Tableau) • Strong SQL query skills for testing data Responsibilities • Works with the business team to understand the business requirements and create testing documentation. • Creates test strategies, test approaches, and test documentation. • Creates Data profiling and Data mapping documents to support testing requirements. • Develops own testing framework using PySpark and validates data, reports, and dashboards with various checks. • Reports defects and runs the defect triage calls with the development team. • Creates test data to validate the accuracy of transformation and logic between layers. • Conducts dashboard and ETL Result testing and verification. • Creates data quality rules & checks based on data completeness & data transformation logic. Required Skills/Qualifications • Bachelor’s degree in Computer Science, Information Technology, or a related field. • Strong working knowledge of data testing processes and methodologies. • Experience in data quality testing, design, and implementation of mixed Cloud/on-prem solutions. • Experience in Test Automation using Python (Pandas, PySpark, Pytest). Github, API testing, and Jenkins preferred. • Strong experience in ETL (cleansing and normalizing source data, transformation, and loading) reports and dashboard testing. • Experience in executing data pipelines and testing. • Experience in creating data profiling, data mapping & SQL. • Experience in BI tools like MS Power BI and Tableau. • Experience using management systems - (Azure DevOps, ADF Orchestration, etc.) , Azure Cloud Data Services (ADLS Gen 2, ADF) and Microsoft Azure DataBricks preferred. • Strong understanding of Data Warehousing concepts and dimensional modeling. • Experience in business requirements participation and documentation of data quality requirements, data analysis, and validation. • Experience in the pharmacy industry (preferred, but not required) • Excellent problem-solving and troubleshooting skills. • Excellent verbal and written communication skills. #LI-HR1 #LI-AT #CB

Requirements