Role name: Developer Role Description: Experience in generating data pipelines in Azure ADF Experience in ingesting data from different Sources using in Azure ADF Experience in transforming the data using Azure Databricks & Delta lake and Pyspark Experience in Azure DevOps CI/CD Stories, Bugs, and Issue management Implement Integration solution in Microsoft Azure Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues Experience working in agile development projects and sprint deliver Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines. Perform data transformations and cleansing operations to ensure data accuracy and consistency. Evolve existing scripts and notebooks to meet client needs. Monitor, troubleshoot, and optimize data pipelines for seamless functionality. Ensure data solutions align with security and compliance standards Work closely with data architects to harmonize data models with project objectives. Document programming efforts and processes, technical specifications, and best practices. Competencies: Digital : Microsoft Azure, Digital : Databricks Note: Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions. We promote and support a diverse workforce at all levels in the company. This is not an unsolicited mail and if it is not intended for you or you are not interested in receiving our e-mails, you can unsubscribe. We are sorry for any inconvenience. About the Company: Diverse Linx
No similar jobs were found with a matching skill set for this role.
Job Type
Fulltime role
Skills required
No particular skills mentioned.
Location
Yorkville, Tennessee
Salary
No salary information was found.
Date Posted
January 20, 2025
No similar jobs were found with a matching skill set for this role.
Diverse Linx is seeking an Azure Databricks Engineer to develop and optimize data pipelines using Azure ADF and Databricks. The role involves collaboration with cross-functional teams to ensure data accuracy and compliance.