Job ID: JOB_ID_6414
Job Title: Lead Data Engineer
We are seeking a highly skilled and experienced Lead Data Engineer to join our team. This role focuses on backend and data engineering, requiring end-to-end data pipeline experience and a strong understanding of SQL and data warehousing concepts. The ideal candidate will have expertise in modern data platforms and engineering stacks, including Databricks, Enterprise Data Warehouse (EDW), DataStage (ETL), and SQL-based data warehouses. While not the primary focus, a secondary understanding of BI/Analytics tools like Tableau, SSAS Cubes, and other reporting tools is a plus.
Key Responsibilities:
- Design, develop, and maintain robust end-to-end data pipelines.
- Implement and optimize data warehousing solutions.
- Utilize Databricks for data processing and analytics.
- Develop ETL processes using tools like DataStage.
- Ensure data quality, integrity, and availability for downstream consumption.
- Lead architectural discussions and provide technical guidance to the team.
- Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
- Troubleshoot and resolve data-related issues.
- Stay up-to-date with the latest trends and technologies in data engineering.
Required Skills and Qualifications:
- Proven experience in backend and data engineering.
- Extensive experience with end-to-end data pipeline development.
- Strong proficiency in SQL and data warehousing concepts.
- Hands-on experience with Databricks.
- Experience with ETL tools, such as DataStage.
- Experience with BI and analytics tools (e.g., Tableau) is a plus.
- Lead-level or architect mindset with the ability to design and own solutions.
- Full-stack data capability, with a strong emphasis on engineering.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
Work Location:
San Francisco, CA (415 Mission St, San Francisco, CA 94105) – Onsite
Employment Type:
Onsite
Keywords: business intelligence, information technology, golang, bay area, California, data engineering, SQL, Databricks, ETL, DataStage, EDW.
Special Requirements
Need local to CA
Compensation & Location
Salary: $150,000 – $200,000 per year (Estimated)
Location: San Francisco, CA
Recruiter / Company – Contact Information
Recruiter / Employer: VBeyond Corporation
Email: thoshg@vbeyond.com
Recruiter Notice:
To remove this job posting, please send an email from
thoshg@vbeyond.com with the subject:
DELETE_JOB_ID_6414