Job description

Job Role: Databricks Data Engineer Location: Los Angeles, CA - Remote Duration: 12 Months Contract Is this role located on-site, hybrid, or remote?: Remote Is a Livescan Required for Position?: Yes Candidate should clear the following background checks for at least the past 7 years: • Employment History – Verification of past employment records. • Educational Background – Validation of academic credentials. • Criminal/Felony – Check for any criminal records. • SSN – Social Security Number (SSN) verification. Skills Preferred: The Databricks Data Engineer will play a critical role in accelerating data modernization efforts. Their expertise will support timely report conversion, improve data pipeline efficiency, and help ensure data integrity and accessibility across the organization. Databricks platform expertise (workspace management, clusters, job scheduling). Spark (PySpark/Scala) proficiency. SQL optimization and advanced querying skills. Azure Data Factory (ADF) or equivalent ETL pipeline experience Data warehousing concepts and architecture (Delta Lake). Python scripting for data manipulation and automation. Familiarity with Azure Cloud environment (Blob Storage, ADLS). Knowledge of data governance, data security, and compliance. Experience Preferred: • 3+ years hands-on experience with Databricks, including cluster management and optimization. • 3+ years of Delta Lake architecture and implementation. • 5+ years background in PySpark or Scala for data engineering tasks. • 5+ years of demonstrated success building efficient ETL pipelines, using Azure Data Factory (ADF) or similar. • 5+ years of migrating legacy reports to modern cloud analytics platforms. • 5+ years of strong SQL skills with expertise in data modeling and performance tuning. • 5+ years of BI tools such as Power BI or Tableau. Education Preferred: Bachelor’s degree in Computer Science, Information Systems, Data Science, or related technical field. Relevant industry certifications in Databricks, Azure Cloud, Data Engineering, or similar fields. Databricks Certified Data Engineer Associate (No more than 12 months expired) Remote Skills: Apache Spark, Business Intelligence Software, Cloud Computing, Computer Science, Data Management, Data Modeling, Data Quality, Data Science, Database Extract Transform and Load (ETL), Information Technology & Information Systems, Information/Data Security (InfoSec), Microsoft Windows Azure, Performance Modeling, Performance Tuning/Optimization, Power BI, Query Optimization, SQL (Structured Query Language), Scala Programming Language, Software Engineering, Tableau, Time Management About the Company: Pyramid Technology Solutions, Inc

Requirements