Job ID: JOB_ID_3548
Job Title: Lead Data Engineer / Architect
We are seeking a highly skilled and experienced Lead Data Engineer / Architect to join our team. This is an onsite contract role located in San Jose, CA, with a duration of 6-12 months. The ideal candidate will be responsible for designing and scaling enterprise Lakehouse architecture on Databricks, driving data platform standards, performance optimization, and cost efficiency. You will lead engineering decisions, mentor teams, and build production-grade data platforms using Spark, Delta Lake, and modern cloud data technologies.
Key Responsibilities:
- Design and scale enterprise Lakehouse architecture on Databricks.
- Drive data platform standards, performance optimization, and cost efficiency.
- Lead engineering decisions and provide technical guidance to the team.
- Mentor junior data engineers and promote best practices.
- Build and maintain production-grade, scalable data platforms.
- Develop and optimize data pipelines using Spark, Delta Lake, and other relevant technologies.
- Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
- Ensure data quality, integrity, and security across all data platforms.
- Stay up-to-date with the latest trends and technologies in data engineering and cloud computing.
Essential Skills and Experience:
- 8-10 years of progressive experience in Data Engineering.
- Strong expertise in Databricks and Apache Spark (PySpark/Scala).
- Hands-on experience with Delta Lake and Lakehouse architecture principles.
- Proficiency in SQL and experience with large-scale data processing.
- Proven experience in designing enterprise data platforms and data pipelines.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Strong experience in data modeling, including Medallion Architecture (Bronze/Silver/Gold).
- Demonstrated experience in performance tuning and optimization within Spark and Databricks environments.
- Experience building production-grade, scalable data platforms.
Additional Information:
- This is an onsite role in San Jose, CA.
- The duration is 6-12 months, with potential for extensions.
- Local candidates are strongly preferred.
Special Requirements
LOCAL CANDIDATES ONLY
Compensation & Location
Salary: $70 – $90 per year (Estimated)
Location: San Jose, CA
Recruiter / Company – Contact Information
Email: ajesh@realtekconsulting.net
Recruiter Notice:
To remove this job posting, please send an email from
ajesh@realtekconsulting.net with the subject:
DELETE_JOB_ID_3548