Job description

Data Architect (Hybrid) Experience: 10+ Years Location: Hybrid Mandatory: Azure, Medallion Architecture, SQL, Databricks, Data Lake Key Responsibilities: • Design and architect scalable, high-performance, and cost-effective cloud-based solutions using Azure services and Databricks. • Develop architecture blueprints for data pipelines, data warehousing, and advanced analytics solutions. • Architect and implement big data processing solutions leveraging Apache Spark for ETL, data transformation, and machine learning workflows. • Design data pipelines for large-scale data ingestion, processing, and storage. • Implement data security, governance, and compliance measures within Databricks using Unity Catalog. • Collaborate with data engineers, DevOps teams, and stakeholders to ensure seamless solution integration. • Analyze system performance, identify bottlenecks, and implement performance optimization solutions. • Implement monitoring tools for Azure and Databricks environments to ensure system health. • Ensure data security and compliance with GDPR, HIPAA, and other regulations through encryption, access control, and logging strategies. • Proficient in Azure services like Azure Data Factory, Azure Storage, Azure SQL, and Azure Functions. • Expertise in Databricks, Apache Spark, and big data technologies. • Strong scripting skills in Python and SQL, with experience in Terraform or CloudFormation. • Experience with Kubernetes, Docker, and containerized applications. • Familiarity with data lake architectures, Delta Lake, and advanced analytics. • Strong knowledge of CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC). Educational Qualifications: • Engineering Degree BE/ME/BTech/MTech/BSc/MSc • Technical certifications in multiple technologies are desirable.

Requirements