AI Test Engineer
- Tech Mahindra
- 7 - 12 years
- Hyderabad
- 2 months ago
- Email to a friend
- Report this job
Job Description
We are seeking a highly skilled AI Test Engineer to validate, test, and assure the quality of AI/ML-based systems. The role focuses on ensuring reliability, fairness, performance, and robustness of AI models and intelligent applications across their lifecycle.
Key Responsibilities
- Design and implement test strategies for AI/ML models, including functional, non-functional, and ethical validation
- Validate data quality, model accuracy, and bias detection across training and inference stages
- Develop automated test frameworks for AI pipelines, APIs, and model outputs
- Perform model validation using statistical techniques and benchmark datasets
- Conduct adversarial testing and edge-case analysis to ensure model robustness
- Validate LLM-based applications (prompt testing, hallucination detection, response quality)
- Collaborate with Data Scientists, ML Engineers, and Product teams to ensure end-to-end quality assurance
- Ensure compliance with AI governance, regulatory, and ethical standards
- Monitor model performance in production and support continuous testing (MLOps integration)
Required Skills & Qualifications
- Bachelors/Masters degree in Computer Science, Data Science, or related field
- 7+ years of experience in Automation and QA/Testing, with exposure to AI/ML systems
- Strong understanding of Machine Learning concepts (supervised/unsupervised learning, model evaluation metrics)
- Hands-on experience with Python, and testing frameworks (e.g., PyTest, Selenium, Playwright)
- Experience testing APIs, microservices, and data pipelines
- Knowledge of ML frameworks like TensorFlow, PyTorch, or Scikit-learn
- Familiarity with data validation tools (Great Expectations, Pandera)
- Understanding of bias, fairness, explainability, and AI risks
Preferred Skills
- Experience with LLM testing (e.g., prompt engineering, RAG validation)
- Exposure to MLOps tools (MLflow, Kubeflow, Azure ML, SageMaker)
- Knowledge of performance testing for AI systems and Automation testing frameworks
- Familiarity with AI governance frameworks and regulatory standards
- Experience in cloud platforms (AWS, Azure, GCP)
Nice-to-Have Certifications
- AI/ML certifications (e.g., AWS ML, Google AI, Microsoft AI Engineer)
- ISTQB Advanced/Test Automation certifications
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: ConsultingRole Category: IT ConsultingRole: Technical ConsultantEmployement Type: Full timeContact Details:
Company: Tech MahindraLocation(s): Hyderabad
Keyskills: Large Language Model Artificial Intelligence PyTest TensorFlow Playwright Automation Automation PyTorch Great Expectations Pandera Machine Learning Algorithms Selenium Scikit-Learn
Tech Mahindra
Roles and Responsibilities Handle customer calls to resolve their queries and concerns. Provide excellent customer service by listening actively, empathizing with customers' issues, and offering solutions. Maintain accurate records of all interactions with customers using CRM software. Collaborat...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in