Job description

Key Responsibilities: • Data Lake Development: Must have experience being part of a team that has built a Data Lake from scratch. You will be responsible for designing, implementing, and maintaining the Data Lake infrastructure. • Azure Data Factory: Utilize Azure Data Factory to orchestrate and automate data movement and transformation. This includes creating and managing data pipelines, integrating various data sources, and ensuring data quality and consistency. • Databricks: Leverage Databricks for big data processing and analytics. Implement scalable data processing solutions and collaborate with data scientists to optimize data workflows. • Infrastructure as Code: Use tools like Terraform and Azure Resource Manager (ARM) templates to define and manage infrastructure. Ensure that infrastructure is scalable, secure, and compliant with industry standards. • CI/CD Experience: Develop and maintain CI/CD pipelines to automate the deployment of data solutions. Ensure that code changes are tested, validated, and deployed efficiently. • Unity Catalog in Azure: Implement and manage Unity Catalog in Azure to ensure data governance, security, and compliance across the Data Lake. Qualifications: • 10+ years in IT, strong preference for those within a law firm, corporate legal, or professional services environment. • 5+ years in cloud and on-prem infrastructure design. • Deep expertise in Azure (IaaS, PaaS, SaaS) and Microsoft 365 suite. • Strong knowledge of IAM, RBAC, MFA, and network security best practices. • Proficiency in Infrastructure as Code (PowerShell, Terraform, Azure CLI, Ansible). • Experience with CI/CD pipelines, SQL, Python, Azure Data Factory, and Apache Spark. Preferred Skills: • Azure 104 Certification (strongly preferred). • Familiarity with AI/ML applications, data mining, and statistical tools. • Exposure to Databricks, Unity Catalog, Collibra. • Knowledge of other cloud platforms (AWS, GCP, OCI) is a plus.

Requirements