Job description

About the Role Our global professional services firm is seeking an experienced Databricks Consultant to join our Capital Markets practice. You will work on high-impact assignments, delivering modern analytics and large-scale data architecture solutions for trading, regulatory, and risk-focused environments. Key Responsibilities • Lead and deliver end-to-end implementations on the Databricks platform. • Architect and deploy data lake and streaming solutions optimized for capital markets use cases. • Design and manage real-time data pipelines using Kafka and Spark Streaming. • Build and optimize ETL workflows for ingestion, cleansing, and transformation at scale. • Ensure data governance, quality, and compliance across surveillance and reporting pipelines. • Support deployment pipelines with CI/CD best practices and version control. • Participate in code reviews, architecture discussions, and client workshops. • Collaborate with stakeholders to ensure timely, successful project delivery. Required Skills & Experience • Deep expertise with Databricks, Apache Spark, and Data Lake architectures (Delta Lake preferred). • Proven experience with Kafka, streaming pipelines, and real-time data processing. • Proficiency in PySpark and SQL, with hands-on integration into Azure, AWS, or Google Cloud Platform. • Experience with CI/CD workflows, Git-based version control, and production deployments. • Familiarity with MLflow and Databricks ML tools for machine learning pipelines. • Strong background in capital markets data trading, financial instruments, or regulatory reporting. • Excellent communication, client-facing, and documentation skills. Why Join Us? • A strong pipeline of capital markets projects, working with leading global institutions. • Exposure to cutting-edge data and analytics technologies. • A collaborative culture that invests in training, career growth, and continuous learning. • Competitive compensation, comprehensive benefits, and flexible work options.

Requirements