Job ID: JOB_ID_3672
Job Description: Big Data Engineer with Scala
We are seeking passionate Data Engineers to join our global, cross-functional team. You will play a key role in developing and evolving search and experimentation platforms, prototyping solutions, and adopting advanced data technologies. This position offers the opportunity to make a significant impact by turning innovative ideas into production-ready systems.
Key Responsibilities:
- Collaborate in a global, cross-functional environment, leading through influence and partnership.
- Develop and evolve search and experimentation platforms.
- Prototype new solutions and adopt advanced data technologies.
- Build and maintain high-scale, distributed systems and data pipelines.
- Support ad hoc metrics analysis, pipeline debugging, and data migration.
- Implement comprehensive monitoring for traffic and models, including setting up dashboards and alerting using Grafana and PagerDuty.
- Clean up old data pipelines and deprecated tables with appropriate testing.
Required Experience:
- 5+ years of hands-on experience in a software engineering role, with a proven track record of shipping high-quality code to production.
- Experience building or supporting high-scale, distributed systems, data pipelines, and/or analytical libraries.
Technical Expertise:
- Programming & Data Engineering: Proficiency in Java, Scala, and Python (at least one required; others preferred).
- SQL Expertise: Strong SQL skills, with the ability to perform deep analysis for debugging and query optimization.
- Big Data Technologies: Proficiency with SQL-based analytics and big data technologies, including Hive, Presto/Trino, and Spark.
- Data Processing Frameworks: Deep, hands-on experience with at least one modern big data processing framework such as Spark or Dataflow.
Nice to Have:
- Knowledge of cloud platforms, such as AWS services (e.g., S3, EMR) or equivalent offerings from other cloud providers.
- Experience with scientific or statistical computation, particularly related to online experimentation.
- Experience with feature stores, such as Chronon.
- Familiarity with AI coding assistants like Claude Code and GitHub Copilot.
Sample Projects & Areas of Impact:
- Data Pipelines & Evaluation Systems: Counterfactual evaluation, ad hoc metrics analysis, pipeline debugging, pipeline data migration, offline counterfactual scoring, search simulator, offline interaction detection.
- Monitoring, Quality & Reliability: Holdout implementation, traffic and model monitoring, pipeline cleanup, dashboard and alerting setup.
This role is ideal for a motivated Data Engineer looking to contribute to cutting-edge data solutions in a collaborative environment.
Special Requirements
On-site – Local only
Compensation & Location
Salary: $90,000 – $130,000 per year
Location: Mountain View, CA
Recruiter / Company – Contact Information
Email: a.m@exaways.com
Recruiter Notice:
To remove this job posting, please send an email from
a.m@exaways.com with the subject:
DELETE_JOB_ID_3672