Job description

Job Description We are seeking a Sr. Data Engineer who need to join ourdynamic and fast-paced team. The ideal candidate should excel in Development orpipeline, orchestrating data, resolving connection issue, Solve productionissues, Guide Team members. The successful candidate will play a critical rolein leading the development and design of Supply Chain Data Engineeringsolutions, maintaining high standards of code quality, and reducing technicaldebt and vulnerabilities across the project. The ideal candidate should be ableto work in shared service team and work in multiple initiatives parallelly. Required Skills: Technical skill:- Python, PySpark, ADF, SQL, ADLS,Microsoft Azure, Azure Databricks, Azure Synapse. GitHub Actions: Familiarity with setting up and managingCI/CD pipelines using GitHub Actions, ensuring smooth and automated deploymentprocesses. Agile Methodology: Experience working in an Agile/Scrumenvironment, with a focus on iterative development, continuous feedback, anddelivery. Qualifications: Experience: Proven experience in a similar role, with astrong track record as Sr. Data Engineer and has helped/lead development teamsin delivering high-quality data orchestration solutions with min 7%2B yearsexperience. Key Responsibilities Development: - Working with varied data file formats(Avro, json, csv) using PySpark for ingesting and transformation, Terraformscripting and DevOps process. Lead Development Initiatives: Develop code with FTR andof quality. Also to take ownership of different development initiatives,ensuring timely delivery while meeting or exceeding quality standards. Code Quality and Maintenance: Oversee the maintenance ofcode quality and enforce best practices, including code reviews, unit testing,CICD, and adherence to coding standards. Reduce Technical Debt: Identify, prioritize, andimplement strategies to reduce technical debt and address vulnerabilities inthe codebase. Team Leadership: Provide mentorship and guidance to teammembers, fostering a collaborative, innovative, and high-performanceenvironment. Collaboration: Work closely with cross-functional teams,including product management, Cloud Security, LOB, Network security, andDevOps, to integrate different features into broader solutions. Problem Solving: Address and troubleshoot complextechnical issues, providing solutions that enhance system performance and userexperience. Documentation: Ensure comprehensive documentation ofsystems, processes, and code to facilitate knowledge sharing and maintenance. Stakeholder Communication: Communicate progress,challenges, and solutions to stakeholders, ensuring transparency and alignmentwith business objectives. Note to Vendors This is an updated job for 11221. There are a few changesthat needed to be made, and the HM is wanting to see all new candidates here. There were great developers submitted to 11221 but the HMis not just looking for strong developers, they would like someone who also hasexperience leading. The contractor hired for this role will need to leadmultiple initiatives within the team. They will not necessarily be developingthe whole time. Note From the Hiring Manager: Summary should includebelow Rating on following tech stack (1-to-10, 1 being weakest& 10 being strongest) Python PySpark SQL DataBricks ADF ADLS Azure Notes: Top 3 skills: Azure data factory, data bricks, and CICD Soft Skills Needed: Leadership capabilities,collaboration and stakeholder communication Project person will be supporting: Supply Chain ProductFunding Work Location (in office, hybrid, remote):Nice to have incinci -local candidates would be preferred - hybrid ..willing to do remote forstrong candidate Is travel required: Once or twice a year if we are goingwith a remote candidate Required Working Hours: in general working hours 8-5 EST-on call support on a rotational basis Interview process and when will it start: sometime middleof next week Prescreening Details: manual prescreen - 5 questions thatwere provided by the manager. When do you want this person to start: HM would likesomeone to start

Requirements