BBI is looking for an Azure Data Engineer to design and implement scalable data pipelines using Microsoft Azure and Python. This contractor role involves collaborating with cross-functional teams to deliver data-driven solutions.
We are seeking a talented and dynamic Data Engineer with expertise in MicroSoft Azure and Python development to join our team. In this role, you will help build scalable and efficient data pipelines that support our data-driven initiatives. You will leverage cutting-edge technologies in the cloud space to deliver accurate and actionable insights, empowering teams to make data-informed decisions and drive business growth. As a Python Data Engineer, you will work closely with cross-functional Business and IT teams,(Financial, Development, Infrastructure, DevOps etc.) to provide data-driven solutions that impact customer data, optimize processes, and build long-term customer relationships. You’ll be responsible for transforming raw data into meaningful insights and delivering reliable data pipelines that directly support business goals. Requirements · Design, implement, and maintain scalable and efficient data pipelines within the MS Azure ecosystem, utilizing industry-standard tools such as Cloud Data Fusion, Cloud Composer, Python, and Dataflow. · Implement real-time messaging with Pub/Sub and ensure proper monitoring and alerting via Cloud Monitoring. · Develop, manage, and optimize solutions for the company’s customer data systems, with a strong focus on maintaining data quality, synchronization. · Work in an Agile environment, applying SDLC principles and SCRUM methodologies. Utilize tools such as Azure Dev Ops, Confluence (Wiki), Bitbucket/GitHub, and Atlassian Bamboo for continuous integration/deployment. · Ensure adherence to software security best practices and product scalability. Apply general data warehousing principles, maintain comprehensive documentation, and adhere to best practices in refactoring and testing to ensure system reliability and maintainability. · Use Apache Airflow for automation and provisioning · Require excellent communication and documentation skills, especially when communicating with business users
BBI is looking for an Azure Data Engineer to design and implement scalable data pipelines using Microsoft Azure and Python. This contractor role involves collaborating with cross-functional teams to deliver data-driven solutions.