Job description

Azure Databricks Consultant job at C4 Technical Services. Kansas. Azure Databricks Consultant Location: 100% remote We are seeking a skilled Azure Databricks Engineer to join our team. The ideal candidate will have hands-on experience with Azure Databricks and a strong background in big data technologies. This role involves designing, implementing, and optimizing data processing workflows and analytics solutions within the Azure Databricks environment. Key Responsibilities: • Data Engineering: Design and develop scalable data pipelines using Azure Databricks to handle large volumes of data from various sources. • Data Integration: Integrate data from multiple sources including cloud storage (Azure Blob, Azure Data Lake), databases, and APIs. • Performance Optimization: Optimize data processing and querying performance for both batch and streaming data. • Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand requirements and deliver effective solutions. • Monitoring and Troubleshooting: Implement monitoring solutions for data pipelines and troubleshoot issues related to data processing and performance. • Documentation: Create and maintain documentation for data pipelines, workflows, and best practices. • Innovation: Stay up-to-date with the latest advancements in Azure Databricks and related technologies, and recommend improvements to existing processes and tools. Required Qualifications: • Experience: 3+ years of experience in data engineering or related roles with a focus on Azure Databricks. Technical Skills: • Proficiency in Azure Databricks, Spark, and related technologies. • Experience with programming languages such as Python, Scala, or SQL. • Knowledge of data storage solutions (e.g., Azure Blob Storage, Azure Data Lake). • Familiarity with data modeling and ETL processes. • Education: Bachelor's degree in Computer Science, Engineering, Data Science, or a related field, or equivalent work experience. Soft Skills: • Strong analytical and problem-solving skills. • Excellent communication and teamwork abilities. • Ability to manage multiple tasks and priorities effectively. Preferred Qualifications: • Certifications: Azure Data Engineer Associate or similar certifications. • Experience with Data Warehousing: Knowledge of data warehousing concepts and tools (e.g., Azure Synapse Analytics). • Cloud Experience: Experience with other Azure services (e.g., Azure SQL Database, Azure Data Factory) is a plus. #DICE cschulz@c4techservices.com C4 Technical Services

Requirements