Job ID: JOB_ID_5034
Position Summary
We are seeking a highly skilled and self-driven Senior QA Automation Engineer (Data) to support an Enterprise Data & Analytics Platform. This role will be responsible for designing and implementing advanced data testing and automation strategies across the full data lifecycle, ensuring high data quality, system scalability, and AI/BI model accuracy.
The ideal candidate will bring deep expertise in data pipeline testing, Databricks, PySpark, and data governance tools such as Azure Purview and Profisee MDM, along with strong experience in automated testing frameworks and CI/CD integration.
Key Responsibilities:
- Architect and implement automated testing frameworks using PySpark and Databricks-native tools across Raw, Curated, and Mart layers
- Design and execute metadata-driven test strategies integrated with CI/CD pipelines
- Develop QA user stories, acceptance criteria, and detailed test scenarios for data ingestion, transformation, and consumption layers
- Perform complex data reconciliation testing across multiple source systems ensuring accuracy and consistency
- Own the end-to-end testing lifecycle (QA, Staging, Production) including validation and sign-offs
- Develop and execute AI/ML model testing, including validation of inputs, outputs, and statistical accuracy
- Collaborate with data engineers to troubleshoot pipeline failures, performance issues, and data inconsistencies
- Define and track data quality KPIs using automated dashboards
- Establish standards for data lineage, auditability, and governance compliance
- Lead and manage User Acceptance Testing (UAT) cycles with business stakeholders
- Drive defect triage, resolution, and retesting during UAT and release cycles
- Work within a SAFe Agile framework, participating in PI planning, sprint ceremonies, and cross-team collaboration
- Manage test environments, data provisioning, and release readiness
- Provide regular updates to leadership on QA progress, risks, and milestones
Required Skills & Qualifications:
- 5+ years of experience in QA Automation with a focus on Data Engineering environments
- Hands-on experience with Databricks and Profisee MDM
- Strong understanding of data lakehouse architecture and medallion framework
- Expertise in data validation and testing methodologies
- Proficiency in PySpark and SQL
- Experience testing AI/BI models and data pipelines
- Strong experience with CI/CD tools (e.g., Azure DevOps)
- Knowledge of data governance frameworks, including data lineage and audit trails
- Excellent analytical, troubleshooting, and problem-solving skills
- Ability to work in a fast-paced Agile environment
Preferred Qualifications:
- Experience with Azure Purview or similar data governance tools
- Exposure to enterprise-level data analytics platforms
- Prior experience working in SAFe Agile environments
- Strong communication skills with the ability to interact with both technical and business stakeholders
Special Requirements
Visa constraints: None specified. Screening steps: None specified. Interview modes: None specified. Domain restrictions: None specified.
Compensation & Location
Salary: $60 – $80 per year (Estimated)
Location: Remote
Recruiter / Company – Contact Information
Email: hiverma007008@gmail.com
Recruiter Notice:
To remove this job posting, please send an email from
hiverma007008@gmail.com with the subject:
DELETE_JOB_ID_5034