Job description

Join to apply for the Data Architect - Databricks role at Jobs via Dice 16 hours ago - Be among the first 25 applicants Dice is the leading career destination for tech experts at every stage of their careers. Our client, Sensiple Inc., is seeking a Databricks Architect in St. Louis, MO . Apply via Dice today! Sensiple Inc. is a New Jersey-based company with over two decades of experience in technology-driven solutions, specializing in Customer Experience, Contact Center Solutions, Digital Transformation, Cloud Computing, and Independent Testing. We have a team with extensive experience in executing and developing sustainable IT strategies across various industries, including Healthcare, Technology, Retail, Logistics, Education, Telecommunications, Government, and Media. Our goal is to develop scalable and consistent solutions to deliver excellence and help our customers envision and build a better future. Position Details: Title: Databricks Architect Location: St. Louis, MO Job Type: 6 months Contract to hire Experience: 8-12 years Job Summary: We are seeking a highly skilled Databricks Architect with hands-on experience in migrating Azure Data Factory (ADF) pipelines to Databricks, and a strong foundation in data governance and compliance. The ideal candidate will play a key role in modernizing our data platform, optimizing performance, and ensuring data integrity, security, and regulatory compliance. Key Responsibilities: Lead migration of data pipelines from Azure Data Factory to Databricks, ensuring minimal downtime and performance optimization. Architect and implement scalable data processing frameworks using Apache Spark, PySpark, Delta Lake, and Databricks notebooks. Define and implement data governance best practices, including data lineage, quality, cataloging, classification, and access control. Collaborate with stakeholders to understand data needs and develop efficient Databricks solutions. Optimize data pipelines for cost, scalability, and performance. Integrate Databricks with Azure services such as Azure Data Lake Storage, Synapse, Purview, and Key Vault. Establish and maintain CI/CD pipelines, DevOps processes, and version control for Databricks environments. Work with data stewards, compliance teams, and security architects to meet data governance and regulatory standards (e.g., GDPR, HIPAA). Document architecture decisions, migration plans, and support knowledge transfer. Required Skills & Qualifications: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field. 8+ years in data engineering/architecture, with 2+ years in Databricks. Experience migrating ADF pipelines to Databricks, including orchestration and dependency management. Expertise in Apache Spark, PySpark, SQL, and Delta Lake. Understanding of data governance frameworks, metadata management, data cataloging, masking, and RBAC. Experience with Azure data ecosystem (ADF, ADLS Gen2, Synapse, Key Vault, Azure DevOps). Familiarity with CI/CD in Databricks using CLI, Repos, Terraform, or ARM templates. Experience with performance tuning and cost optimization in Databricks. Strong problem-solving, documentation, and communication skills. Preferred Skills: Experience with Unity Catalog in Databricks for fine-grained access control. Knowledge of data quality tools. Familiarity with enterprise data warehouse concepts and modern data stack. Certifications such as Databricks Certified Data Engineer, Azure Data Engineer Associate, or Azure Solutions Architect. Please send your updated resume and expected hourly rate to View email address on click.appcast.io . Regards, Sugapriyan | Sensiple Inc. Email: View email address on click.appcast.io Address: 555 US Highway 1 S, Ste 330, Iselin, NJ 08830 Seniority level Mid-Senior level Employment type Full-time Job function Engineering and Information Technology Industries Software Development Referrals increase your chances of interviewing at Jobs via Dice by 2x. Get notified about new Data Architect jobs in St Louis, MO . Salary range in St Louis, MO: $99,933 - $147,901 (posted 2 weeks ago) #J-18808-Ljbffr Jobs via Dice

Requirements