Job ID: JOB_ID_1744
Role Overview: Senior Azure Databricks Lead
Tanisha Systems is seeking a highly skilled and experienced Senior Azure Databricks Lead for a critical contract-to-contract (C2C) engagement based in Boston, MA. This role requires a physical presence onsite five days a week, serving as the primary technical authority for our client’s data modernization initiatives. As a lead, you will bridge the gap between complex business requirements and high-performance technical solutions, ensuring that the data architecture is scalable, secure, and cost-effective.
Key Responsibilities and Strategic Leadership
- Stakeholder Engagement: Act as the principal technical liaison for Product Owners, Architects, and IT Leadership. You will lead discovery workshops to uncover business needs and translate them into actionable technical roadmaps.
- Architecture Design: Design and implement end-to-end data platforms utilizing the Azure ecosystem, specifically focusing on Azure Databricks, Delta Lake, and Unity Catalog. You will be responsible for defining Lakehouse architectures that support batch, streaming, and real-time analytics.
- Data Modeling Standards: Establish and enforce rigorous data modeling standards across Bronze, Silver, and Gold layers. Your goal is to create curated data marts that provide high-value insights to the business.
- Integration & Modernization: Define integration patterns for upstream and downstream systems, including APIs, Kafka, Event Hubs, and Power BI. You will play a pivotal role in cloud migration and the replacement of legacy platforms.
- Team Mentorship: Review and validate deliverables from offshore teams, ensuring adherence to architectural standards and high-quality code. You will resolve technical blockers and guide teams through complex implementations.
- DevOps & Optimization: Drive the enablement of CI/CD pipelines using Azure DevOps and Git. You will also establish monitoring and cost-optimization strategies to ensure the platform remains efficient and within budget.
Technical Requirements
- Core Expertise: Over 10 years of experience in data engineering and architecture, with at least 5 years dedicated to Azure data platforms.
- Databricks Mastery: Minimum of 3 years in a technical lead role specifically focused on Azure Databricks, Spark, and Delta Lake.
- Cloud Services: Deep proficiency in Azure Data Lake Storage (ADLS Gen2), Azure Data Factory, and Synapse Pipelines.
- Programming: Advanced skills in Python, SQL, and Spark optimization techniques.
- Certifications: Azure Solutions Architect or Databricks Certified Data Engineer Professional is highly preferred.
Why Join This Project?
This is a high-visibility role in the heart of Boston’s tech hub. You will have the opportunity to lead a major digital transformation project for a leading enterprise, utilizing the latest advancements in AI and Machine Learning integration within the Databricks environment. If you are a proactive leader with a passion for data excellence, we encourage you to apply.
Special Requirements
Contract C2C; 5 days onsite in Boston, MA; Requires offshore team management experience.
Compensation & Location
Salary: $195,000 – $255,000 per year (Estimated)
Location: Boston, MA
Recruiter / Company – Contact Information
Recruiter / Employer: Tanisha Systems Inc.
Email: rishabh.verma@tanishasystems.com
Recruiter Notice:
To remove this job posting, please send an email from
rishabh.verma@tanishasystems.com with the subject:
DELETE_JOB_ID_1744