Job ID: JOB_ID_1041
Position Overview
We are seeking a visionary and hands-on Lead Data Engineer at a Manager level to join our enterprise technology team. This 100% remote role is designed for a technical powerhouse who can define complex technical architectures while simultaneously guiding large-scale implementations. As a strategic leader, you will own the technical track of mid to large-scale client projects from inception to completion, ensuring that our data solutions are robust, scalable, and aligned with enterprise goals. This position requires a unique blend of deep technical expertise in the Databricks ecosystem and the leadership acumen necessary to mentor high-performing engineering teams. You will be the primary technical point of contact for complex client engagements, particularly within the Insurance sector, driving innovation and excellence in every phase of the data lifecycle.
Core Responsibilities and Leadership
- Define and implement the technical architecture for enterprise-grade data platforms, ensuring scalability and security.
- Provide hands-on leadership in the development of complex data pipelines, setting the standard for code quality and architectural integrity.
- Mentor and grow a team of data engineers, fostering a culture of continuous learning and technical excellence.
- Lead the end-to-end technical delivery of client projects, managing stakeholder expectations and technical risks.
- Design and build highly scalable ETL/ELT pipelines using Python and SQL, optimizing for performance and cost-efficiency.
- Manage and optimize Databricks workspaces, including cluster configuration, security, and the implementation of advanced features like Delta Live Tables and MLflow.
- Architect data integration solutions that bridge various database management systems, including SQL Server, PostgreSQL, and Oracle.
- Collaborate with cross-functional teams, including architects, project managers, and business stakeholders, to translate requirements into technical reality.
- Stay at the forefront of industry trends, evaluating and adopting emerging technologies that can provide a competitive advantage.
Technical Requirements and Domain Expertise
- 10-15 years of comprehensive experience in software engineering, with a significant focus on data-centric applications.
- 5-7 years of deep, hands-on experience with Databricks solutions and modern data engineering practices.
- 5-7 years of specialized experience within the Insurance domain, demonstrating a clear understanding of industry-specific data challenges and regulatory requirements.
- Expert-level proficiency in Python and SQL for advanced data transformations, automation, and pipeline development.
- Advanced knowledge of Azure data platforms, including Azure Data Lake Storage, Azure Data Factory, and Synapse Analytics.
- Familiarity with the broader Databricks ecosystem, including tools such as Fivetran, dbt, Coalesce, and Alation.
- Experience with data visualization and business intelligence tools like Tableau or Power BI to drive data-driven decision-making.
- Strong analytical and critical thinking skills, with a proven ability to solve complex technical challenges in high-pressure environments.
Professional Certifications and Growth
The ideal candidate will hold a Databricks Certified Data Engineer Associate or Professional certification, demonstrating a validated level of expertise in the platform. This role offers an unparalleled opportunity to lead significant digital transformation initiatives within the insurance industry, leveraging the full power of the cloud. You will have the autonomy to shape technical strategies and the responsibility to ensure the long-term success of our data infrastructure. We are looking for a leader who is not only a master of their craft but also a mentor who can inspire the next generation of data engineers. This position is open to all visa types, including H1B, USC, and GC, provided the candidate meets the rigorous seniority and domain requirements.
Special Requirements
Visa: Any Visa is Fine (H1B, USC, GC). Domain: Insurance. Experience: 10-15 years required. Mode: 100% Remote.
Compensation & Location
Salary: $195,000 – $265,000 per year (Estimated)
Location: New York, NY
Recruiter / Company – Contact Information
Recruiter / Employer: Fixity Technologies
Email: sai.p@fixitytech.com
Recruiter Notice:
To remove this job posting, please send an email from
sai.p@fixitytech.com with the subject:
DELETE_JOB_ID_1041