Job ID: JOB_ID_994
Role Overview: Senior Quality Engineer (Generative AI Focus)
Vyze Inc is seeking a highly experienced Senior Quality Engineer with a specialized focus on Generative AI development and testing for a long-term, fully onsite engagement in Brooklyn, NY. This role is designed for a technical leader with over 13 years of industry experience who can bridge the gap between traditional quality assurance and the cutting-edge world of Agentic AI. As a Senior Quality Engineer, you will be responsible for the end-to-end validation of complex AI systems, ensuring that generative models and AI agents perform reliably, ethically, and efficiently within enterprise workflows.
Key Responsibilities and Technical Leadership
- AI Agent Test Scenario Creation: You will lead the design and implementation of robust test scenarios specifically tailored to validate the behavior, reasoning, and output of AI agents. This includes testing for hallucinations, bias, and adherence to safety protocols.
- Advanced Automation Integration: Leverage agentic tools such as Windsurf, Claude Code, and Cursor to push the boundaries of what is possible in automated testing. You will be expected to integrate these tools into the existing QA lifecycle to enhance productivity and coverage.
- Performance and Scalability: Conduct rigorous performance testing of AI systems using JMeter and LoadRunner to identify bottlenecks in model inference and system response times, ensuring the infrastructure can scale with user demand.
- CI/CD and DevOps Excellence: Integrate automated AI test suites into Continuous Integration and Continuous Deployment (CI/CD) pipelines using Jenkins and Azure DevOps (AZDO). You will ensure that every code commit is validated against a comprehensive battery of functional and visual tests.
- Visual and Functional AI Testing: Implement AI-powered Selenium plugins like Helenium and Applitools Eyes to manage dynamic UI changes and ensure a seamless user experience across different platforms and devices.
- Stakeholder Collaboration: Work closely with product managers to analyze Product Requirement Documents (PRDs), extracting critical testing requirements and ensuring that the final product aligns perfectly with business objectives.
Required Technical Expertise
- Minimum of 13 years of professional experience in Software Quality Engineering and Automation.
- Expert-level proficiency with automation frameworks including Selenium, QTP, WinRunner, and Visual Studio.
- Deep understanding of database management and performance testing using SQL Server, LoadRunner, and JMeter.
- Extensive experience with Agile and Scrum methodologies, acting as a mentor to junior team members.
- Proven track record of managing the full defect life cycle using tools like JIRA and MS Visio for workflow analysis.
- Hands-on experience with version control systems such as Git, GitHub, and GitLab.
- Specialized knowledge in testing REST and SOAP APIs to ensure seamless system connectivity.
Work Environment and Expectations
This is a high-impact, 100% onsite position located in Brooklyn, NY. Candidates must be local to the NJ/NY area and capable of commuting to the office Monday through Friday. The project has an initial duration of two years with annual extensions, offering significant long-term stability. Due to the seniority of the role, a professional LinkedIn profile is mandatory for all applicants to verify their career trajectory and industry contributions.
Special Requirements
F2F Interview required; 100% Onsite in Brooklyn (M-F); Local NJ/NY candidates only; LinkedIn profile is mandatory; 100% match with JD required.
Compensation & Location
Salary: $165,000 – $215,000 per year (Estimated)
Location: Brooklyn, NY
Recruiter / Company – Contact Information
Recruiter / Employer: Vyze Inc
Email: anuj@vyzeinc.com
Recruiter Notice:
To remove this job posting, please send an email from
anuj@vyzeinc.com with the subject:
DELETE_JOB_ID_994