Job description

Senior Azure Databricks Solutions Architect Job ID: Type: Regular Full-Time # of Openings: 1 Category: Accounting/Finance Corporate Office Overview We are seeking an experienced Senior Azure Databricks Solutions Architect to design and implement scalable and innovative data solutions utilizing Azure Databricks. In this technical role, you will leverage your expertise to create efficient data pipelines, manage data lakes, and ensure data integrity within the Azure cloud ecosystem, aligning architectural strategies with organizational objectives. Responsibilities • Solution Design: Architect and execute data architecture on Azure Databricks, encompassing data ingestion, transformation, and warehousing strategies. Optimize ETL pipelines using PySpark, Scala, or Spark SQL. Create and manage Databricks notebooks for data exploration and visualization. • Big Data Processing: Design and enhance ETL/ELT pipelines leveraging Apache Spark and programming knowledge in Python, Scala, or SQL. • Data Technologies: Set up and manage Azure Databricks clusters, focusing on performance optimization and cost management. Understand and handle big data processing in Azure Data Lake and other storage solutions. • Technical Leadership: Provide guidance to development teams, data engineers, and analysts on best practices for data modeling and processing within the Databricks environment. • Data Integration: Develop solutions to integrate data from diverse sources including on-premises systems and cloud applications. • Performance Optimization: Monitor and enhance data processing efficiency on Databricks clusters. • Security and Governance: Implement security measures and access controls to safeguard sensitive data. Ensure compliance with best practices in security and governance. • Collaboration: Work collaboratively with data teams, business intelligence analysts, and stakeholders to translate business requirements into actionable technical solutions. • Compliance: Adhere to company policies, complete compliance training, and follow applicable laws and regulations including Anti Money Laundering protocols. • Supervisory Responsibilities: Lead data projects and manage teams to ensure the successful implementation of architectural solutions. Qualifications Education and Experience: A bachelor’s degree with 8+ years of relevant experience, preferably within a financial institution. 8+ years of expertise in big data architecture and cloud solutions, primarily in Azure. • Experience with Azure services including Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, and Apache Spark. • Familiarity with programming languages such as DAX, Power BI, C#, Python, SQL, or Scala. • Strong understanding of data modeling, both relational and non-relational databases. • Proficient in Azure security services and data governance principles. Other Qualifications: • Exceptional communication skills to convey information clearly and concisely. • Ability to build positive relationships and work well with cross-functional teams. • Detail-oriented, organized, and capable of managing multiple projects effectively. • Demonstrated leadership ability to coach and develop team members. • Willingness to travel occasionally to Southern and Northern California branches as needed. BluPeak Credit Union is committed to equal opportunity employment and providing reasonable accommodations for individuals with disabilities and sincerely held religious beliefs. For more information, please contact Human Resources. Compensation details: 00 Yearly Salary

Requirements