Job ID: JOB_ID_1897
Role Overview
We are seeking a highly skilled and motivated Technical Team Lead with extensive experience in Azure Databricks to join our dynamic team. The ideal candidate will possess a strong technical background, exceptional leadership abilities, and a passion for driving innovative solutions. As a Technical Team Lead, you will be responsible for guiding a team of developers and engineers in the design, development, and implementation of data-driven solutions that leverage Azure Databricks. This role requires a deep understanding of cloud-native data engineering and the ability to manage complex project lifecycles in a fast-paced environment.
Key Responsibilities
- Lead and mentor a team of technical professionals, fostering a collaborative and high-performance culture.
- Design and implement data processing solutions using Azure Databricks, ensuring scalability and efficiency.
- Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
- Oversee the development lifecycle, from planning and design to deployment and maintenance.
- Conduct code reviews and provide constructive feedback to team members to ensure code quality and adherence to best practices.
- Stay up-to-date with industry trends and emerging technologies related to Azure Databricks and data engineering.
- Facilitate communication between technical and non-technical stakeholders to ensure alignment on project goals.
- Identify and mitigate risks associated with project delivery and team performance.
- Optimize Spark jobs and Databricks clusters for performance and cost-efficiency.
- Implement robust data security and governance frameworks within the Azure ecosystem.
Mandatory Technical Skills
- Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes.
- Strong programming skills in languages such as Python, Scala, or SQL.
- Experience with cloud-based data storage solutions, particularly Azure Data Lake Storage (ADLS Gen2) and Azure SQL Database.
- Solid understanding of data modeling, ETL processes, and data warehousing concepts.
- Demonstrated ability to lead technical teams and manage multiple projects simultaneously.
- Experience with Delta Lake architecture and Unity Catalog for data governance.
Preferred Qualifications
- Familiarity with Azure DevOps for CI/CD processes and automated deployment.
- Experience with machine learning frameworks and libraries (MLflow, Scikit-learn).
- Knowledge of data governance and compliance standards (GDPR, HIPAA).
- Strong analytical and problem-solving skills with a focus on business outcomes.
- Excellent communication and interpersonal skills for stakeholder management.
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- 7-10 years of experience in data engineering, software development, or a related technical role.
- Relevant certifications in Azure (e.g., Azure Data Engineer Associate) are a plus.
Working Environment
This position is a Day 1 Onsite role, requiring physical presence at one of our branch locations in Branchville, NJ, Hartford, CT, or Charlotte, NC. Candidates must be prepared to work in a collaborative office environment from their first day of employment. We offer a competitive C2C rate and the opportunity to work on cutting-edge data initiatives for major enterprise clients.
Special Requirements
Day 1 Onsite; C2C only; Locations: Branchville, NJ, Hartford, CT, Charlotte, NC.
Compensation & Location
Salary: $60 – $60 per year
Location: Charlotte, NC
Recruiter / Company – Contact Information
Recruiter / Employer: Agile Enterprise Solutions Inc.
Email: irfanshaik@aesincus.com
Recruiter Notice:
To remove this job posting, please send an email from
irfanshaik@aesincus.com with the subject:
DELETE_JOB_ID_1897