Job ID: JOB_ID_1084
Job Description: AI Testing Specialist
Valzo Soft Solutions is seeking a highly skilled AI Testing Engineer for an urgent onsite requirement in Minneapolis, MN. As the landscape of software development shifts toward Artificial Intelligence, the need for rigorous testing of AI models and integrated AI features has never been greater. This role is designed for a senior-level professional with over 10 years of experience who can lead the quality assurance efforts for AI-driven applications. You will be responsible for ensuring that our AI implementations, including Large Language Models (LLMs) and automated assistants, perform reliably, ethically, and accurately within our enterprise ecosystem.
Core Responsibilities
- Develop and execute comprehensive testing strategies specifically tailored for AI and Machine Learning models.
- Build and maintain advanced automation frameworks to validate AI outputs and system integrations.
- Utilize Microsoft Copilot and Copilot Studio to enhance productivity and test AI-assisted workflows.
- Perform deep-dive evaluations of LLM behavior, including prompt engineering testing and response validation.
- Conduct API testing to ensure seamless communication between AI services and front-end applications.
- Collaborate with MLOps teams to integrate testing into the continuous deployment pipeline.
- Monitor AI model performance in production and identify drift or degradation in accuracy.
- Document test results, identify defects, and work closely with developers to resolve complex AI-related issues.
- Stay abreast of the latest trends in AI testing, including adversarial testing and bias detection.
Required Technical Skills
- 10+ years of experience in Software Quality Assurance and Automation.
- Strong hands-on experience in AI testing methodologies and automation frameworks.
- Expertise with Microsoft Copilot and Copilot Studio is essential.
- Proficiency in programming languages such as Python or Java for test script development.
- Extensive experience with API testing tools (e.g., Postman, RestAssured).
- Solid understanding of Azure Cloud services and MLOps principles.
- Knowledge of LLM evaluation metrics and prompt engineering techniques.
- Experience testing AI models for hallucinations, safety, and performance.
Professional Qualifications
- Proven ability to work in a fast-paced, onsite environment in Minneapolis.
- Excellent analytical and problem-solving skills with a focus on data-driven decision making.
- Strong communication skills to articulate technical AI concepts to non-technical stakeholders.
- Experience in Agile/Scrum environments.
Why Join Us?
At Valzo Soft Solutions, we are committed to staying at the cutting edge of technology. This role offers the opportunity to work on some of the most advanced AI projects in the industry today. You will be part of a forward-thinking team that values innovation and quality. This is a contract position that provides a platform to showcase your expertise in the rapidly evolving field of AI testing.
Special Requirements
Location: Onsite Minneapolis. Domain: Artificial Intelligence / LLM. Requirements: 10+ years experience, expertise in Microsoft Copilot Studio.
Compensation & Location
Salary: $165,000 – $225,000 per year (Estimated)
Location: Minneapolis, MN
Recruiter / Company – Contact Information
Recruiter / Employer: Valzo Soft Solutions
Email: pushpa@valzosoft.com
Recruiter Notice:
To remove this job posting, please send an email from
pushpa@valzosoft.com with the subject:
DELETE_JOB_ID_1084