Job description

Role: Python Full Stack Developer with Azure Databricks Exposure Location: Jersey City, NJ Duration: Long Term Requirements • Develop highly scalable applications in Core Python. • Hands-on with Python web frameworks such as Django, Flask, or FastAPI. • Experience working on SQL with ability to run various data analytics tasks and queries. • Exposure to Java script technologies (preferably React) • Exposure to Azure Databricks environment (PySpark, notebooks, integrate repos, job workflows, delta lake, unity catalog etc) • Exposure to azure environment and various interconnected azure components (Functions, App Service, Containers etc.). • Knowledge on Financial domain and mainly Risk management is highly desirable Qualifications • 8+ years of prior experience as a developer in the required technologies Qualifications • IT professional experience in Azure Cloud with Minimum 5+ years of professional experience in software development with a strong focus on Python programming for data engineering and automation tasks. • Proficient in Python, SQL, and libraries like pandas, NumPy, and SQL Alchemy for scalable data processing. • Solid understanding of SQL and relational database concepts; experience writing optimized queries. • Strong grasp of ETL processes, data transformation, and data warehousing principles using Python-based frameworks and custom scripts. • Ability to recreate existing legacy application logic and functionality into Azure Databricks/Data Lake, SQL Database and SQL Datawarehouse environment. • Experience with Azure services such as Data Factory, Azure Machine Learning, and Azure DevOps. • Excellent interpersonal and communication skills • Skilled in version control using Git/GitHub, including branching strategies, pull requests, and CI/CD integration. • Manage & Monitor Databricks clusters and integrate with version control systems such as GitHub. • Enable seamless integration between on-premises databases and Power BI for reporting and analytics. • Design and build large-scale data pipelines using Azure native data processing frameworks. • Collaborate with architects, engineers, analysts, and business stakeholders to deliver enterprise-grade, data-driven solutions. • Provide technical leadership and guidance on cloud architecture and implementation strategies. • Coordinate with platform teams, Azure API Management (APIM), GitHub, and support teams to ensure smooth operations. • Analyze business requirements and design scalable, secure, and efficient solutions on the Azure cloud platform. • Develop, test, and optimize software components to enhance the performance and reliability of data platforms. • Integrate and standardize data from diverse sources while ensuring compliance with data quality and accessibility standards. • Implement streaming data solutions and reusable design patterns in a big data environment. • Apply sound judgment and technical expertise to resolve moderately complex data engineering challenges. • Review and provide feedback on core code changes and support production deployments Core Technologies • Azure: Azure Databricks, Azure Synapse Analytics, Azure Functions, Azure Data Lake Storage Gen2, Azure Event Grid, Azure Event Hubs, Azure Service Bus, Azure Key Vault, Azure Monitor, Azure Log Analytics, Azure API Management (APIM), Azure DevOps. • Scripting: Python, PySpark, SQL, Bash. • Databases: SQL Server, Oracle, PostgreSQL, Delta Lake • Big Data: Apache Spark • Version Control: GitHub, Git, Azure DevOps • Visualization: Power BI & Integration with REST APIs for custom dashboards. • Data Integration & Workflow Orchestration: Azure Data Factory, Databricks Workflows Vendor screening notes for both roles • Very strong Python/SQL foundational knowledge (Someone who has experience building applications ground-up using Python/SQL and not just maintaining frameworks that have largely been built.) • Demonstrate strong system design skills including rationalization of the architecture and articulating technical concepts. • Someone with current hands-on experience and not focused on support / QA roles or essential coding as a team lead.

Requirements