NEWPosted 3 hours ago
Job ID: JOB_ID_5936
Role Overview
We are seeking a Databricks Automation Engineer to lead automation strategy and data quality initiatives across large-scale data platforms. This role requires deep expertise in Databricks, Spark, and Delta Lake, along with strong leadership in building scalable test frameworks.
Key Responsibilities
- Own and define test architecture for ETL/ELT pipelines, Databricks/Spark, APIs, and UI systems
- Build advanced data validation frameworks:
- Schema validation
- Row count reconciliation
- Statistical checks & anomaly detection
- Data drift and delta comparisons
- Design and implement CI/CD-integrated automation pipelines (Azure DevOps / GitHub Actions)
- Lead synthetic data generation and mocking strategies for downstream systems
- Execute performance & scalability testing for Spark jobs and microservices
- Collaborate with cross-functional teams to define:
- Acceptance criteria
- Release quality gates
- Automation SLAs
- Develop automation observability dashboards (pass rate, flakiness, coverage, MTTD)
- Own runbooks, documentation, and incident triage processes
- Mentor and lead QA/Test Automation teams
Keywords
continuous integration continuous deployment quality analyst user interface wtwo Texas Washington
Special Requirements
W2 Only (No C2C / No 1099), Must be a US Citizen or Green Card Holder, Onsite
Compensation & Location
Salary: $120,000 – $160,000 per year (Estimated)
Location: Seattle, WA
Recruiter / Company – Contact Information
Email: hwanth@configusa.com
Recruiter Notice:
To remove this job posting, please send an email from
hwanth@configusa.com with the subject:
DELETE_JOB_ID_5936