Roles & Responsibilities • Architect and develop end-to-end data solutions using Azure Databricks, Azure Data Factory, and Azure SQL DB, focusing on high-performance, scalable, and secure data architectures. • Lead the design and development of data ingestion pipelines utilizing Delta Live Tables (DLT) and Structured Streaming to handle both batch and real-time data ingestion requirements. • Solution Design experience: Collaborate with stakeholders to understand business requirements and design scalable and optimized data bricks Data and Data Warehousing solutions on Azure • Strong experience in driving initiatives towards organization vision and expertise on handling large programs • Work experience with ADO, Agile Method, Sprint Planning and • Strong experience in Translating business needs into long-term data architecture solutions • Optimize the performance of Spark jobs and Databricks workflows using advanced Spark internals, performance tuning, and job optimization techniques. • Develop and maintain metadata-driven data ingestion frameworks to improve automation, scalability, and data pipeline management. • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to define data requirements and deliver solutions that align with business goals. • Implement and enforce data quality checks, governance policies, and data security measures to ensure the integrity, availability, and confidentiality of data. • Continuously monitor, optimize, and enhance the performance of cloud-based data infrastructure, while ensuring cost efficiency. • WebForms, ASP.NET MVC, Core, Blazor. • Frameworks 4.8.2 and Core 6, 8 • Webservices and APIs • Must have experience with upgrades of .NET Framework to Cloud • Must have experience with Nota Fiscal integration in a related sector • Microsoft SQL Server (DDL, DML, Stored Procedures) • Experience working with Azure DevOps Tools (Git repository, pipelines and managing workitems) • Analyze and document defects and work with development team for defect resolution • Lean-agile/SCRUM environment • Windows Server troubleshooting (IIS, Event Viewer, Peformance Monitor) • Azure services (authentication, key vault, etc) Salary Range-$100,000-$140,000 a year
Job Type
Fulltime role
Skills required
Agile, .NET, Azure
Location
Atlanta, Georgia
Salary
$100,000 - $140,000
Date Posted
June 9, 2025
Tata Consultancy Services is seeking a Lead Databricks Data Architect with Product Owner experience to design and implement scalable data solutions on Azure. The role involves leading data ingestion pipeline development and collaborating with cross-functional teams to meet business goals.