Techstra Solutions is seeking a Sr Azure Data Engineer in Chicago, IL, with expertise in designing and implementing data pipelines using Databricks. The role requires strong skills in Azure, Python, and data engineering practices.
Azure Data Engineer job at Techstra Solutions. Chicago, IL. Techstra is seeking an experienced Sr Azure Data Engineer with a minimum of 4-7 years' experience (ex: Data warehouse design, business intelligence reporting and Customer Information Systems) or in lieu of experience, 6-9 years equivalent combination of education and work experience. From the day you join, you will hit the ground running surrounded by amazing people. Here is a look at some of the expectations and responsibilities for this position: Responsibilities: Design, test and build scalable ETL/ELT/Data pipelines using Databricks producing Data Products that support strategic priorities for our clients. Integrate Databricks with cloud services. Ingest structured and unstructured data from multiple sources (e.g., Kafka, REST APIs, databases and cloud storage). Write optimized Spark SQL or PySpark code for batch and streaming data transformations. Implement data cleansing, validation, and enrichment processes. Optimize jobs for performance, memory management, and cost-efficiency. Create Technical design documents. Develop Technical and procedural documentation, as required. Experience & Qualifications: Databricks Platform Proficient in using Databricks notebooks. Delta Lake (versioning, ACID transactions). Unity Catalog (data governance and lineage). MLflow (for MLOps, if involved in machine learning workflows). Azure Environment Apache Spark Deep understanding of Spark core concepts (RDDs, DataFrames, Spark SQL, Spark Streaming). Performance tuning and optimization of Spark jobs. Programming Languages Python (PySpark): Essential for most Databricks tasks. SQL: For data transformation and analysis. Scala or Java: Sometimes required for advanced Spark use cases. Data Engineering ETL/ELT pipeline design and implementation. Working with structured and unstructured data. Batch vs. streaming data processing (Structured Streaming). Integration with Collibra. DevOps & CI/CD Git, Azure DevOps, or GitHub Actions. Automated deployment of notebooks and workflows. Data & Analytics Skills Data modeling and warehousing (e.g., Star/Snowflake schema). Working with BI tools (Power BI, Tableau). Understanding of lakehouse architecture. Security & Governance Role-based access control (RBAC) and credential passthrough. Data masking and audit logging. Soft skills Strong communication and collaboration (especially in cross-functional teams). Experience writing technical design specifications for data integrations and data transformations with structured and unstructured data. Problem-solving and debugging. Experience with Scrum development methodology. At Techstra Solutions, we help top companies and brands achieve the business value of Digital and Talent Transformation. We believe there are three components in successful business transformation: Business Strategy, Technology and Talent. It is the coming together of these three disciplines that enables companies to take full advantage of opportunities. It differentiates us. Our approach is holistic and all encompassing. We consider the full picture as we guide our clients on this journey. We are experts in transformation, business strategy, technology, innovation, and human capital management. We deliver our expertise through client consulting, innovative staffing solutions and software development. From strategy through implementation, we are dedicated to bringing our clients world-class business and talent solutions that fit strategic requirements and most importantly, deliver results. Equal Employment Opportunity Statement Techstra Solutions is an equal opportunity employer. The Company makes its decisions on merit, and its policy of equal opportunity prohibits discrimination in all phases of the employment process, including, but not limited to, recruitment, hiring, promotion, selection, transfer, demotion, layoff, termination, compensation, benefits, and other terms and conditions of employment. The policy of equal opportunity applies without regard to race, color, creed, religion, gender, sexual orientation, gender identification, pregnancy, marital status, national origin, ancestry, age, disability that can reasonably be accommodated without undue hardship, military status, veteran status, genetic predisposition or carrier status, alienage or citizenship, domestic partnership status, arrest or conviction record, status as a victim of domestic violence, or any other protected categories under federal, state, or local law. The Company also prohibits discrimination or harassment based upon the perception that a person has, or is associated with a person who has, any of these characteristics. #J-18808-Ljbffr Techstra Solutions
MetLife is seeking a Senior Azure Data Engineer to enhance their Marketing Data Engineering team, focusing on Azure cloud services and marketing technology integrations. The role involves data platform architecture, administration, and automation to deliver scalable and secure data solutions.
AKT Corp is seeking a Senior Azure Data Engineer in Atlanta, GA, to design and implement scalable data solutions using Azure technologies. The role involves collaboration with cross-functional teams and mentoring junior engineers.
Sira Consulting is seeking an experienced Azure Databricks Engineer with expertise in PySpark to design and optimize big data solutions on Azure. This full-time position is based in Branchville, NJ.
Techstra Solutions is seeking a Sr Azure Data Engineer in Chicago, IL, with expertise in designing and implementing data pipelines using Databricks. The role requires strong skills in Azure, Python, and data engineering practices.
Cognizant is seeking a Microsoft Certified Azure Solutions Architect Expert to lead the design and implementation of scalable data solutions in Chicago, IL. The role focuses on real-time data access, AI-driven analytics, and integration with enterprise systems.
Cognizant is seeking an AZURE Cloud Architect with a strong JAVA background to join their team in Chicago, IL. The ideal candidate will have over 15 years of IT experience, focusing on architecting cloud solutions and implementing Azure technologies.
MetLife is seeking a Senior Azure Data Engineer to enhance their Marketing Data Engineering team, focusing on Azure cloud services and marketing technology integrations. The role involves data platform architecture, administration, and automation to deliver scalable and secure data solutions.
AKT Corp is seeking a Senior Azure Data Engineer in Atlanta, GA, to design and implement scalable data solutions using Azure technologies. The role involves collaboration with cross-functional teams and mentoring junior engineers.
Sira Consulting is seeking an experienced Azure Databricks Engineer with expertise in PySpark to design and optimize big data solutions on Azure. This full-time position is based in Branchville, NJ.
Techstra Solutions is seeking a Sr Azure Data Engineer in Chicago, IL, with expertise in designing and implementing data pipelines using Databricks. The role requires strong skills in Azure, Python, and data engineering practices.
Cognizant is seeking a Microsoft Certified Azure Solutions Architect Expert to lead the design and implementation of scalable data solutions in Chicago, IL. The role focuses on real-time data access, AI-driven analytics, and integration with enterprise systems.
Cognizant is seeking an AZURE Cloud Architect with a strong JAVA background to join their team in Chicago, IL. The ideal candidate will have over 15 years of IT experience, focusing on architecting cloud solutions and implementing Azure technologies.
MetLife is seeking a Senior Azure Data Engineer to enhance their Marketing Data Engineering team, focusing on Azure cloud services and marketing technology integrations. The role involves data platform architecture, administration, and automation to deliver scalable and secure data solutions.
AKT Corp is seeking a Senior Azure Data Engineer in Atlanta, GA, to design and implement scalable data solutions using Azure technologies. The role involves collaboration with cross-functional teams and mentoring junior engineers.
Techstra Solutions is seeking a Sr Azure Data Engineer in Chicago, IL, with expertise in designing and implementing data pipelines using Databricks. The role requires strong skills in Azure, Python, and data engineering practices.