Job ID: JOB_ID_2097
Position Summary: Sr. Databricks Lead
Tanisha Systems Inc. is urgently hiring a Senior Databricks Lead for a high-impact contract C2C role based in Boston, MA. This position requires a 5-day onsite presence, offering a unique opportunity to lead technical initiatives directly at the client site. The ideal candidate will possess over 10 years of experience in data engineering and architecture, with a specialized focus on the Azure Databricks ecosystem. You will serve as the primary technical liaison between business stakeholders and offshore delivery teams, driving the success of complex data platform modernizations.
Core Responsibilities
- Act as the primary technical point of contact for customer stakeholders, including Business Owners, Architects, and IT Leadership.
- Lead requirements discovery workshops and translate business needs into scalable Azure Databricks-based lakehouse architectures.
- Design end-to-end data platforms utilizing Azure Data Lake Storage (ADLS), Delta Lake, and Unity Catalog.
- Establish and enforce data modeling standards across bronze, silver, and gold layers.
- Define integration patterns with upstream and downstream systems such as Kafka, Event Hub, Power BI, and Azure Synapse.
- Provide technical leadership during program inception, design sign-off, and critical project milestones.
- Review and validate offshore team deliverables to ensure architectural adherence, quality, and performance.
- Drive DevOps enablement through Azure DevOps, Git, and CI/CD pipeline implementation.
- Establish monitoring, logging, and cost optimization strategies for the cloud data platform.
Required Technical Expertise
- Strong hands-on expertise with Azure Databricks (Spark, Delta Lake, Unity Catalog).
- Deep experience with Azure Data Lake Storage (ADLS Gen2) and Azure Data Factory.
- Proficiency in streaming technologies including Kafka, Event Hub, and Structured Streaming.
- Advanced skills in Python, SQL, and Spark optimization techniques.
- Solid understanding of data warehousing, lakehouse, and analytics architectures.
- Familiarity with ML/AI integration within the Databricks environment is highly desirable.
Leadership and Qualifications
- 10+ years in data engineering or data architecture roles.
- 5+ years of experience specifically designing solutions on Azure data platforms.
- 3+ years in a technical lead or solution architect capacity.
- Proven experience working directly with customers in an onshore, client-facing role.
- Strong ownership mindset with the ability to manage distributed/offshore delivery teams effectively.
- Azure or Databricks certifications are preferred.
Special Requirements
Contract C2C; 5 days onsite in Boston, MA.
Compensation & Location
Salary: $180,000 – $240,000 per year (Estimated)
Location: Boston, MA
Recruiter / Company – Contact Information
Recruiter / Employer: Tanisha Systems Inc.
Email: rishabh.verma@tanishasystems.com
Recruiter Notice:
To remove this job posting, please send an email from
rishabh.verma@tanishasystems.com with the subject:
DELETE_JOB_ID_2097