Job description

Job Title: PySpark and Azure Architech - Hybird - MT. LAUREL, NJ Experience: 12 years Job Summary: We are seeking an experienced Architect with 12 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in PySpark and Azure Databricks, and will be responsible for designing and implementing data solutions. This role requires a proactive individual who can drive innovation and efficiency in data processing and analytics. Required Skills: Technical Skills: PySpark, Azure Responsibilities: - Design and develop scalable data architectures using PySpark and Azure Databricks to meet business requirements. - Collaborate with cross-functional teams to understand data needs and translate them into technical solutions. - Implement data processing pipelines that ensure data quality, integrity, and security. - Optimize data workflows for performance and cost-effectiveness in a cloud environment. - Provide technical guidance and mentorship to junior team members to foster growth and development. - Conduct regular reviews of data architecture and recommend improvements for efficiency. - Stay updated with the latest industry trends and technologies to ensure the company remains competitive. - Troubleshoot and resolve complex data-related issues to maintain system reliability. - Document data architecture designs and processes for future reference and compliance. - Engage with stakeholders to gather feedback and refine data solutions to better meet business objectives. - Ensure adherence to best practices and standards in data architecture and engineering. - Contribute to the strategic planning of data initiatives to align with company goals. - Drive innovation by exploring new tools and techniques to enhance data processing capabilities. Qualifications: - Possess a strong understanding of PySpark and its application in data processing. - Demonstrate expertise in Azure Databricks and cloud-based data solutions. - Have a proven track record of designing scalable data architectures. - Show proficiency in optimizing data workflows for performance and cost. - Exhibit excellent problem-solving skills and attention to detail. - Display strong communication skills to effectively collaborate with teams. - Hold a degree in Computer Science, Information Technology, or a related field.

Requirements