Job ID: 1149
Position Overview
We are seeking a highly skilled and detail-oriented ETL Tester with specialized expertise in Azure Databricks to join our dynamic Agile team. In this role, you will be instrumental in building and validating sophisticated healthcare applications. You will work at the intersection of data engineering and quality assurance, ensuring that our data pipelines are robust, scalable, and compliant with the stringent standards of the healthcare industry. This is a hybrid position based in Philadelphia, PA, offering a blend of collaborative onsite work and remote flexibility. The successful candidate will be responsible for ensuring the accuracy and reliability of data flowing through complex cloud-based architectures.
Key Responsibilities
- Design, develop, and execute comprehensive test plans and test cases for ETL processes within the Azure Databricks environment.
- Validate data transformations using Delta Lake, Delta Live Tables, and Unity Catalog to ensure data integrity and performance.
- Develop automated testing scripts using Python, PySpark, and SQL to streamline the QA lifecycle and integrate with CI/CD pipelines.
- Utilize Azure Data Factory for monitoring pipeline execution and validating data movement across various cloud stages.
- Implement data quality frameworks using tools like Great Expectations to automate the detection of data anomalies.
- Collaborate with data architects and developers to ensure data governance and PII compliance are maintained throughout the development lifecycle.
- Participate in Agile ceremonies, including sprint planning, daily stand-ups, and retrospectives, to drive continuous improvement.
- Lead cross-functional quality initiatives, providing technical leadership and mentorship to junior testers.
Technical Requirements
- Extensive experience with the Azure Data stack, specifically Databricks and Data Factory.
- Strong proficiency in writing complex SQL queries and Python/PySpark scripts for data validation.
- Familiarity with Azure DevOps for version control and CI/CD integration.
- Knowledge of Collibra for data cataloging and governance is a significant advantage.
- Experience working within the Healthcare domain, understanding the nuances of clinical and patient data.
Professional Growth and Environment
Joining our team means becoming part of a forward-thinking organization that values technical excellence and innovation. You will have the opportunity to work with cutting-edge cloud technologies and contribute to projects that have a real-world impact on healthcare delivery. We foster a culture of learning where you are encouraged to stay updated with the latest trends in data engineering and automated testing. Our hybrid model in Philadelphia provides the perfect balance of professional engagement and personal flexibility, supported by a leadership team that prioritizes work-life balance and career progression. We are committed to building a diverse team and providing the tools necessary for every engineer to succeed in a fast-paced, data-driven environment.
Special Requirements
Hybrid work model; Healthcare domain experience preferred; Agile/Scrum environment.
Compensation & Location
Salary: $115,000 – $155,000 per year (Estimated)
Location: Philadelphia, PA
Recruiter / Company – Contact Information
Recruiter / Employer: VBeyond Corporation
Email: sophiar@vbeyond.com
Recruiter Notice:
To remove this job posting, please send an email from
sophiar@vbeyond.com with the subject:
DELETE_1149