Xenon Seven Logo

Xenon Seven

Gen AI Tester

Reposted Yesterday
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Hyderabad, Telangana, IND
Senior level
In-Office or Remote
Hiring Remotely in Hyderabad, Telangana, IND
Senior level
The Generative AI Tester will validate AI-driven features, ensure model reliability, and drive end-to-end testing workflows in enterprise applications.
The summary above was generated by AI
Description

About us:

Where elite tech talent meets world-class opportunities!

At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources allows us to partner with clients on transformative initiatives, driving innovation and business growth. Whether it's empowering global organizations or collaborating with trailblazing startups, we are committed to delivering advanced, impactful solutions that meet today’s most complex challenges.

We are building a community of top-tier experts and we’re opening the doors to an exclusive group of exceptional AI & ML Professionals ready to solve real-world problems and shape the future of intelligent systems.


Requirements

Job Description – Generative AI Tester (5+ Years Experience)

Role Overview

We are seeking a skilled and proactive Generative AI Tester with over 5 years of experience in software testing and quality assurance, including 2–3 years focused on Generative AI systems. The ideal candidate will be responsible for validating AI-driven features, ensuring model reliability, and driving end-to-end testing workflows across enterprise-grade applications.

Key Responsibilities

  • Collaborate with product, data science, and engineering teams to understand AI use cases and define test strategies.
  • Design and execute test cases for LLM-based features such as summarization, classification, conversational flows, and content generation.
  • Validate model outputs for factual accuracy, tone, relevance, and compliance with domain-specific standards.
  • Develop automated test scripts and frameworks for prompt-response validation and regression testing.
  • Evaluate ML models using metrics like precision, recall, F1-score, and domain-specific thresholds.
  • Conduct integration testing across cloud platforms (e.g., AWS, Azure, GCP) and data environments (e.g., Snowflake, Databricks).
  • Document test results, anomalies, and improvement suggestions in structured formats.
  • Ensure ethical AI practices and compliance with data governance policies.

Required Skills & Experience

  • 5+ years in software testing, QA, or data validation roles.
  • 2–3 years hands-on experience testing Generative AI models (e.g., GPT, LLaMA, Claude).
  • Strong proficiency in Python and experience with ML testing tools or frameworks.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and data engineering environments (Snowflake, Databricks).
  • Understanding of ML workflows including time series, regression, classification, and neural networks.
  • Excellent communication skills and ability to drive cross-functional discussions with ownership.

Preferred Qualifications

  • Exposure to domain-specific AI applications (e.g., pharma, healthcare, finance).
  • Experience with prompt engineering and LLM evaluation frameworks.
  • Knowledge of ethical AI principles and regulatory compliance (e.g., HIPAA, GDPR).

Similar Jobs

12 Hours Ago
Remote
India
Mid level
Mid level
Cloud • Information Technology • Productivity • Software • Automation
Frontline Product Support Engineer for Boomi AtomSphere delivering global, follow-the-sun technical support. Troubleshoot integrations, APIs, networks, and logs; use tools like Postman, Wireshark, and Charles Proxy; work with Kubernetes, Windows/Linux, Salesforce/NetSuite/Hadoop; communicate solutions to nontechnical customers and collaborate across teams. Shift is 1:30 AM–10:30 AM IST with eventual Hyderabad office transition.
Top Skills: AIBoomi AtomsphereCharles ProxyEltETLGroovyHadoopHTTPHttpsJavaJavaScriptKubernetesLinuxNetSuiteOauth 2.0PostmanRancher DesktopReactRestSalesforceSftpSoapSsl/TlsTcp/IpWindowsWiresharkWsdl
12 Hours Ago
Remote
India
Mid level
Mid level
Cloud • Information Technology • Productivity • Software • Automation
Provide high-level technical support and troubleshooting for Boomi AtomSphere customers, resolve complex integration and connectivity issues, analyze logs and network traces, collaborate across teams, and communicate technical solutions clearly to non-technical customers. Work follow-the-sun shifts and transition to Hyderabad office.
Top Skills: AIBoomi AtomsphereCharles ProxyEltETLGroovyHadoopHttp/SJavaJavaScriptKubernetesLinuxNetSuiteOauth 2.0PostmanRancher DesktopReactRestSalesforceSftpSoapSsl/TlsTcp/IpWindowsWiresharkWsdl
14 Hours Ago
Remote
India
Mid level
Mid level
Cloud • Information Technology • Productivity • Software • Automation
Provide high-level technical support and troubleshooting for Boomi integrations, diagnose root causes across integrations, APIs, and OS/Java logs, use diagnostic tools and protocols to resolve customer issues, collaborate globally in a follow-the-sun model, and transition to in-office Hyderabad with overnight shift coverage.
Top Skills: Ai ToolsBoomi AtomsphereCharles ProxyElt/EtlGroovyHadoopHttp/SJavaJavaScriptKubernetesLinuxNetSuiteOauth 2.0PostmanRancher DesktopReactRestSalesforceSftpSoapSsl/TlsTcp/IpWindowsWiresharkWsdl

What you need to know about the Hyderabad Tech Scene

Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account