Job description

Position Title: Data Engineer with Databricks and Azure Location: Dallas, TX Duration: 12 plus months with possible extension Technical Skills • Azure Cloud Services: Configure VNets, NSGs, firewalls, and private endpoints for secure connectivity. • Security: Manage Azure Active Directory (Azure AD), identity and access management (IAM), RBAC, encryption, and key management for data protection. • Storage: Understand and manage Azure Storage accounts for data storage. • Databricks Platform/Workspace Management: Set up and manage Databricks workspaces, including user identities, compute resources, and workspace settings. • Data Governance: Implement and manage data governance features, including data tables, views, sharing, and security models. • Compute: Create and manage compute resources for Databricks jobs and workloads. • Scripting & Automation/Programming Languages: Proficiency in languages like Python, Scala, or Java for developing solutions and automating tasks. • Azure CLI: Use command-line tools for managing Azure resources and tasks. • Infrastructure as Code (IaC): Experience with tools like ARM templates, Bicep, or Terraform for automating infrastructure deployment. • Monitoring & Troubleshooting/Monitoring Tools: Set up and utilize Azure Monitor, Log Analytics, and other tools to monitor performance and identify issues. • Performance Tuning: Analyze metrics and logs to proactively identify and resolve performance bottlenecks. Soft Skills • Problem-Solving: Excellent ability to troubleshoot issues and find effective solutions. • Attention to Detail: Meticulousness in ensuring accurate configurations and precise settings. • Communication & Collaboration: Strong skills to effectively communicate with teams and collaborate on projects. • Adaptability & Learning: A continuous learning mindset to keep up with the fast pace of technological change in cloud environments.

Requirements