Job ID: JOB_ID_1432
Role Overview: Data SDET (ETL & Automation Specialist)
We are looking for a dedicated and detail-oriented Data SDET to join our engineering team in Dallas, TX. This is an onsite, in-person role focused on ensuring the highest levels of data quality and reliability across our complex data ecosystems. As a Software Development Engineer in Test (SDET), you will not just be finding bugs; you will be building the frameworks and tools necessary to prevent them. Your expertise in ETL testing, real-time data streaming with Kafka, and cloud-native services in AWS will be critical to our success in delivering accurate data insights to the business.
Key Responsibilities
- Design, develop, and maintain sophisticated automated test frameworks specifically for ETL processes and large-scale data pipelines.
- Validate complex data transformations and ensure data integrity as it moves from source systems through Kafka streams into AWS data lakes and warehouses.
- Write high-quality, reusable Python scripts to automate data validation, regression testing, and performance benchmarking.
- Perform deep-dive ETL testing to verify data extraction logic, transformation rules, and loading efficiency.
- Validate cloud workflows within AWS environments, specifically focusing on S3, AWS Glue, Redshift, and Lambda functions.
- Integrate automated tests into CI/CD pipelines using Jenkins and Git to support continuous delivery and rapid deployment cycles.
- Collaborate closely with Data Engineers and Architects to identify potential data quality risks early in the development lifecycle.
Technical Requirements
- Minimum of 3+ years of professional experience in ETL testing and data validation.
- Strong proficiency in Python programming for automation and data manipulation.
- Hands-on experience with Apache Kafka for real-time data streaming validation.
- Technical expertise in AWS services, including S3, Glue, Redshift, and Lambda.
- Advanced SQL skills for querying complex relational databases and performing data reconciliation.
- Familiarity with modern test automation frameworks such as PyTest or Robot Framework.
- Experience working with CI/CD tools like Jenkins and version control systems like Git.
Qualifications and Environment
The successful candidate will have a Bachelor’s degree in Computer Science, Information Technology, or a related technical discipline. This role requires a proactive individual who enjoys solving complex data puzzles and has a passion for automation. Being an onsite role in Dallas, you will benefit from direct collaboration with our core engineering team, participating in daily stand-ups and in-person whiteboarding sessions. We value candidates who can communicate technical findings clearly and who are committed to maintaining the integrity of our data-driven decision-making processes.
Special Requirements
Visa: OPT Fine, No H1B; Interview/Work Mode: Onsite – Inperson; Domain: ETL, AWS, Kafka, Python.
Compensation & Location
Salary: $100,000 – $110,000 per year
Location: Dallas, TX
Recruiter / Company – Contact Information
Recruiter / Employer: Intellyk Inc
Email: shanthiintellyk@gmail.com
Recruiter Notice:
To remove this job posting, please send an email from
shanthiintellyk@gmail.com with the subject:
DELETE_JOB_ID_1432