JobRialto is seeking an Azure Data Engineer in Sunnyvale, CA, with expertise in Databricks, PySpark, and Azure services. The role involves building data governance solutions and optimizing data processes.
Azure Data Engineer job at JobRialto. Sunnyvale, CA. Description: Data Bricks(Must Have) Strong hands on in Pyspark and Apache Spark Strong hands on in Medallion architecture Experience in Native Spark Migration to Databricks. Experience in Building Data Governance Solutions like Unity Catalog, Azure Purview etc. Highly experienced in Usability Optimization (Auto Compaction, Ordering, Vacuuming), Cost Optimization and Performance Optimization. Build Very Strong Orchestration Layer in Databricks/ADF.... Workflows. Build CICD for Databricks in Azure Devops. Process near Real time Data thru Auto Loader, DLT Pipelines. Implement Security Layer in Delta Lake. Implement Massive Parallel Processing Layers in Spark SQL and PySpark. Implement Cost effective Infrastructure in Databricks. Experience In extracting logic and from on prem layers, SAP, ADLS into Pyspark/ADLS using ADF/Databricks. Azure Synapse Analytics/Azure data Factory (ADF)(Must Have) Hands on Experience in Azure Synapse Analytics, Azure Data Factory and Data Bricks, Azure Storage, Azure Key Vault, SQL Pools CI/CD Pipeline Designing and other Azure services like functions, logic apps Linked services, Various Runtimes, Datasets, Pipelines, Activities Strong Hands-on Experience in Various Activities like Control flow logic and conditions (For Each, if, switch, until), Lookup, Stored procedure, scripts, validations, Copy Data, Data flow, Azure functions, Notebooks, SQL Pool Stored procedures and etc Strong hands on exp in deployment of code throughout landscape (Dev -> QA -> Prod), Git Hub, CI/CD pipelines and etc SQL Server stored procedures(Must have) strong hands on creating the SQL stored procedures Functions, Stored Procedures, how to call one SP into another, How to process record-by-record Dynamic SQL Python(Must have) Must have strong background about the Python libraries like PySpark, Pandas, NumPy, pymysql, Oracle, Pyspark libraries Must have strong hands on to get data through APIs Must be able to install libraries and help users to troubleshoot issues Must have knowledge to get the data through stored procedures via Python Should be able to debug the Python code Sparks(Must have) Hands on experience in Spark Pools, PySpark Should be able to merge data/delta loads through Notebooks Must have strong background about the Python libraries and PySpark Education: Bachelors Degree
JobRialto is seeking an Azure Data Engineer in Sunnyvale, CA, with expertise in Databricks, PySpark, and Azure services. The role involves building data governance solutions and optimizing data processes.
CEDENT is seeking an experienced Azure Databricks Engineer to design and optimize data pipelines and analytics solutions in Dallas, TX. The role involves collaboration with cross-functional teams and mentoring junior engineers.
DaVita is seeking a Senior Azure Data Engineer in Denver, CO, to architect and build data pipelines and analytical solutions on Microsoft Azure. The role requires expertise in Power BI and collaboration with cross-functional teams to drive data-driven decision-making.
Techstra Solutions is seeking a Sr Azure Data Engineer in Chicago, IL, with expertise in designing and implementing data pipelines using Databricks. The role requires strong skills in Azure, Python, and data engineering practices.
Cognizant North America is seeking an experienced Azure Databricks Architect to design and implement scalable data solutions remotely. The ideal candidate will have extensive experience in Azure technologies and data engineering.
MetLife is seeking a Senior Azure Data Engineer to enhance their Marketing Data Engineering team, focusing on Azure cloud services and marketing technology integrations. The role involves data platform architecture, administration, and automation to deliver scalable and secure data solutions.
JobRialto is seeking an Azure Data Engineer in Sunnyvale, CA, with expertise in Databricks, PySpark, and Azure services. The role involves building data governance solutions and optimizing data processes.
CEDENT is seeking an experienced Azure Databricks Engineer to design and optimize data pipelines and analytics solutions in Dallas, TX. The role involves collaboration with cross-functional teams and mentoring junior engineers.
DaVita is seeking a Senior Azure Data Engineer in Denver, CO, to architect and build data pipelines and analytical solutions on Microsoft Azure. The role requires expertise in Power BI and collaboration with cross-functional teams to drive data-driven decision-making.
Techstra Solutions is seeking a Sr Azure Data Engineer in Chicago, IL, with expertise in designing and implementing data pipelines using Databricks. The role requires strong skills in Azure, Python, and data engineering practices.
Cognizant North America is seeking an experienced Azure Databricks Architect to design and implement scalable data solutions remotely. The ideal candidate will have extensive experience in Azure technologies and data engineering.
MetLife is seeking a Senior Azure Data Engineer to enhance their Marketing Data Engineering team, focusing on Azure cloud services and marketing technology integrations. The role involves data platform architecture, administration, and automation to deliver scalable and secure data solutions.
JobRialto is seeking an Azure Data Engineer in Sunnyvale, CA, with expertise in Databricks, PySpark, and Azure services. The role involves building data governance solutions and optimizing data processes.
CEDENT is seeking an experienced Azure Databricks Engineer to design and optimize data pipelines and analytics solutions in Dallas, TX. The role involves collaboration with cross-functional teams and mentoring junior engineers.
JobRialto is seeking an Azure Data Engineer in Sunnyvale, CA, with expertise in Databricks, PySpark, and Azure services. The role involves building data governance solutions and optimizing data processes.