NEWPosted 1 hour ago
Job ID: JOB_ID_6439
Role Overview
We are seeking an experienced QA Data Engineer (L1 & ) to lead testing efforts for complex data pipelines and ensure high data quality across Azure-based data platforms. The candidate should have strong expertise in ETL testing, automation, and data validation using modern tools.
Key Responsibilities
- Design and execute end-to-end test strategies for data pipelines
- Validate large-scale data transformations using Databricks and PySpark
- Perform advanced ETL testing for Azure Data Factory pipelines
- Develop and maintain automated test frameworks for data validation
- Manage and optimize ADO Test Plans, test suites, and reporting dashboards
- Conduct data reconciliation, regression testing, and performance testing
- Create detailed test cases, test reports, and defect analysis reports
- Work closely with data engineers, architects, and stakeholders
- Ensure data quality, integrity, and governance standards
Required Skills
- Strong experience in: Azure Data Factory, Databricks, PySpark
- Expertise in ETL/Data Warehouse testing
- Hands-on experience with Azure DevOps (ADO Test Plans, Boards, Reports)
- Strong SQL skills for complex data validation
- Experience in test automation (Python / PySpark-based validation preferred)
- Knowledge of data pipelines, big data ecosystems, and cloud platforms
- Familiarity with CI/CD pipelines in Azure DevOps
Experience
- 3-9 years of relevant experience in Data QA / Data Engineering QA
Special Requirements
Visa constraints: Not specified. Screening steps: Not specified. Interview modes: Not specified. Domain restrictions: Not specified.
Compensation & Location
Salary: $65,000 – $115,000 per year (Estimated)
Location: Remote
Recruiter / Company – Contact Information
Email: sai.sarath@siriinfoinc.com
Recruiter Notice:
To remove this job posting, please send an email from
sai.sarath@siriinfoinc.com with the subject:
DELETE_JOB_ID_6439