Job description

Azure Data Engineer - Hybrid in Palo Alto,CA job at Beacon Hill Staffing Group. Palo Alto, CA. This position is no longer open for applications Salary: USD170000 - USD172000 per year One of our clients in Palo Alto is looking for Azure Data Engineer with the following skills and experience: NOTE: This is a DIRECT HIRE position. Candidates will be working 3 days onsite in Palo Alto, CA Must-Haves: Expertise in Azure Cloud platform services. Proficient in SQL with a focus on Azure SQL. Heavy experience with RESTful API development. Familiarity with Azure Data Factory (ADF). Experience working with Prophecy and Purview for data pipeline design and data governance. Responsibilities: Design and develop end-to-end data pipelines across various data sources and systems, ensuring data quality and integrity. Develop data models, structures, and ETL jobs for efficient data acquisition and transformation. Work closely with cloud service providers to align solutions with platform offerings. Manage and maintain cloud-based data and analytics platforms, including performing quick proof of concepts for data solutions. Implement Unified Data governance and Data Quality Management solutions for enterprise data governance. Interact with business stakeholders to understand requirements and translate them into technology solutions. Qualifications: Bachelor’s degree in computer science, computer engineering, or related field with 10+ years of experience. Strong expertise in Azure SQL, including complex SQL queries and performance tuning. Experience with Azure API Management Service and RESTful API development. Proficiency in real-time data processing using Azure Event Hubs, Service Bus, and Stream Analytics. Knowledge of data transformation languages like .Net/C#, Python, Java, R, or Scala, preferably with Databricks/Spark. Experience with NoSQL Databases and Azure CosmosDB. Familiarity with Azure Purview for data cataloging and metadata management. Experience with Azure Data Lake Storage Gen2 and Azure BLOB storage. Understanding of different data formats such as Parquet, Avro, CSV, ORC, etc. Experience in creating, scheduling, and monitoring Azure Data Factory (ADF) pipelines. Previous experience in a fast-paced, agile environment. Ability to work with on-shore/off-shore teams. #J-18808-Ljbffr Beacon Hill Staffing Group

Requirements