Job description

Position Title: Databricks SME with Data Model skills & AI Agents expertise Work location: Dallas, TX Duration: 12 plus months contract with possible extensionJob Description: • Need strong exp with Databricks SME with Data Profiling & Data Model Skills and AI agents • A Data Engineer specializing in Databricks is responsible for designing, building, and maintaining scalable data pipelines and infrastructure to process and analyze large datasets efficiently. This role involves collaborating with cross-functional teams to ensure data accessibility, quality, and security within the Databricks environment. • Design, develop, and implement scalable data pipelines using Databricks to ingest, transform, and store structured and unstructured data. • Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions. • Performance Optimization: Analyze, optimize, and tune existing data pipelines for performance, reliability, and efficiency. • Implement security measures and best practices to ensure data privacy and compliance with regulatory standards. • Work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure efficient data processing and analysis. • Proven experience with Databricks and data infrastructure technologies, including Apache Spark, SQL, and Python. • Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform, and their data services. • Data Warehousing: Experience in designing and implementing data warehousing and ETL processes. • Excellent problem-solving skills and attention to detail. • Communication Skills: Strong communication skills and ability to work collaboratively with cross-functional teams.

Requirements