Job description

Responsibilities Job Summary The Data Engineer assists in the design, integration, build, and maintenance of data pipelines and data transformation algorithms for enterprise data analytics consumption. You will be part of a team that is responsible for data integration, monitoring of data storage, and data distribution across multiple on premise and cloud data environments. You are passionate about learning how to create data platforms to enable rapid application development and integration. Collaborating with other team members in your team will assist in your success here, it will be a large part of your workflow so you must be comfortable being flexible in a fast-paced environment because it allows you to learn and grow. As a Data Engineer, you'll be part of the team that drives the overall enterprise service bus implementation, governance, solution architecture and rollout. You'll build out a standards and governance model for internal and external API's and work cork cross-functionally with a broad set of business partners, using keen business process understanding and critical thinking to design, develop, test and document APIs using Azure platform. Responsibilities • Design and implement robust, scalable and optimized data engineering solutions on the Databricks platform. • Develop ETL/ELT pipelines leveraging Databricks notebooks, Delta Lake, Workflows in the Azure Data Factory/ Azure Databricks environment • Collaborate with Data Scientist/BI Analysts and other stakeholders to understand data requirements and develop solutions that meet business needs while accommodating large volume of data. • Impeccable analytical and problem-solving skills to solve hard complex problems in a fast-paced environment. • Create and maintain design documents and documentation for data pipelines • Good experience working with any cloud platforms like Azure, AWS or GCP, integrating data between storage solutions within Databricks. • Monitor and troubleshoot production jobs • Optimize the performance of workflows, improving query performance Qualifications Education • Bachelor’s degree in computer science, Information Systems or similar field or equivalent experience Experience • 5+ years of experience in data engineering or related field • Intermediate to Advanced knowledge of data management including Extract, transform, load, API Concepts for relational databases, Data warehousing, data marts, data stores, data sets. • Strong experience with **Azure Databricks, PySpark, or SparkSQL or Scala**. • Development experience in python is preferred. • Experience working on Medallion architecture is preferred. • Strong analysis and design skills with a focus on system design, flow, and performance. • Experience working in a fast-paced environment, ideally supporting a 24/7/365 organization. • Attention to detail with the ability to produce reliable, effective solutions. • Possess a positive attitude and ability to work in a collaborative and energetic team environment. Certifications • Azure Data Engineer preferable • Databricks Certified Data Engineer Associate preferable Specialized Skills • Python/Pyspark/ SQL Experience • Azure Data Services technology or similar platform (AWS, Google Cloud etc.) • Experience in ETL/API Concepts and ETL/API Tools (Informatica, ADF, ASB, etc.) • Data Schema Knowledge in relational and non-relational database design and development Functional and Behavior Competencies • Ability to work with a globally distributed team. • Collaborate with other teams to deliver quality solutions Other Job Requirements • Domestic & International travel under 10% of time Indicate Physical Effort (Choose 1) • Exerts up to 10 lbs. of force occasionally and/or a negligible amount of force frequently or constantly to lift, carry, push, pull, or otherwise move objects, including the human body. involves sitting most of the time but may involve walking or standing for brief periods of time. Overview At Spirit, we live “More Fly.” It’s not just about getting from point A to B—it’s about feeling fly while you’re at it. For our Team Members, it means thinking BIG, taking action, making connections, and having a blast while doing it. From the station to the cockpit, the cabin to the computer, every day is an adventure as we redefine travel. Soar with us and enjoy travel perks that bring you closer to what matters. Join a team that empowers you to bring your full self to work, grow personally and professionally, and fuel the communities we serve. At Spirit Airlines, the sky isn’t the limit—it’s just the beginning! EEOC Statement Spirit Airlines is an Equal Employment Opportunity employer.  All aspects of employment are governed on the basis of merit, competence and qualifications without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or any other category protected by federal, state, or local law.

Requirements