Job description

Job Title: Lead Data DevOps Engineer Location: Encino, CA/Atlanta, GA Must have: Automate Data pipeline in Azure ecosystem with Python, Shell script, Azure Devops, Windows Powershell, Linux, Managing and Automating the Data Infrastructure to Install, Configure, Automate via CI-CD, Troubleshoot, establish monitoring and alerting data infrastructure on Azure cloud and off cloud resources. Good to have: Wherescape skill/Tool, DataVault. Job Summary: We are seeking a skilled Lead Data DevOps to manage and automate our data infrastructure across Azure Cloud and on-premises resources. The ideal candidate will be proficient in installing, configuring, automating, and maintaining robust data environments. They will implement CI/CD pipelines, troubleshoot issues, and establish reliable monitoring and alerting systems to ensure the seamless operation of our data infrastructure. Key Responsibilities: •⁠ ⁠Data Infrastructure Management: Install, configure, and maintain data infrastructure on Azure Cloud and off-cloud environments. •⁠ ⁠Automation and CI/CD: Design and implement automation processes, including CI/CD pipelines, to streamline deployments and updates across the infrastructure. •⁠ ⁠Troubleshooting: Diagnose and resolve issues within the data infrastructure, ensuring minimal downtime and optimal performance. •⁠ ⁠Monitoring and Alerting: Develop and manage monitoring systems to proactively identify potential problems and set up alerting mechanisms to notify relevant teams. •⁠ ⁠Collaboration: Work closely with data engineers, developers, and IT teams to align infrastructure capabilities with organizational goals. •⁠ ⁠Security and Compliance: Ensure the infrastructure complies with security standards and best practices for data protection. Required Skills and Qualifications: •⁠ ⁠Proven experience managing data infrastructure on Azure Cloud and hybrid environments. •⁠ ⁠Proficiency in automation tools and scripting languages (e.g., Python, Bash, PowerShell). •⁠ ⁠Hands-on experience with CI/CD tools such as Jenkins, Azure DevOps, or similar. •⁠ ⁠Strong understanding of monitoring tools like Prometheus, Grafana, or Azure Monitor. •⁠ ⁠Expertise in troubleshooting complex system issues. •⁠ ⁠Familiarity with containerization and orchestration tools such as Docker and Kubernetes. •⁠ ⁠Knowledge of database systems (e.g., SQL, NoSQL) and data pipelines is a plus. •⁠ ⁠Strong problem-solving skills and a proactive mindset. Preferred Qualifications: •⁠ ⁠Certifications in Azure (e.g., Azure Solutions Architect, Azure DevOps Engineer). •⁠ ⁠Experience with Infrastructure as Code (IaC) tools like Terraform or Ansible. •⁠ ⁠Familiarity with data governance and compliance standards

Requirements