Design and build production AI systems: agentic workflows, multi-agent architectures, RAG, tool-using AI, evaluation and observability pipelines, scalable async execution, failure handling, and standards. Own deployment, monitoring, and mentoring for AI features.
Position: Senior AI Engineer
Location: Hyderabad
Industry: IT Services & Consulting
Department: Engineering – Software & QA
Employment Type: Full-Time, Permanent
Overview:
We are looking for a Senior AI Engineer to design and deliver AI-powered capabilities within business applications. The role focuses on building reliable reasoning pipelines, intelligent workflows, and agent-driven systems that integrate enterprise data and automate complex processes.
Key Responsibilities
- Design AI workflows that execute multi-step business tasks autonomously.
- Build agentic systems capable of planning, reasoning, and taking actions using tools and APIs.
- Develop multi-agent architectures where specialized agents collaborate to complete processes.
- Implement Retrieval-Augmented Generation (RAG) over enterprise data sources.
- Integrate LLMs via APIs and open-source models using provider-agnostic architecture.
- Design structured outputs, guardrails, and validation layers for reliable behavior.
- Build tool-using AI for database querying, document processing, and API orchestration.
- Create evaluation pipelines to measure accuracy, reliability, and regression of AI outputs.
- Implement observability including tracing, latency, and cost monitoring.
- Design failure handling, fallbacks, and human-in-the-loop workflows.
- Architect scalable async execution using queues and background workers.
- Own production reliability of AI features from deployment through monitoring.
- Evaluate approaches (RAG vs fine-tuning vs workflow vs agents) and justify design decisions.
- Define AI engineering standards and best practices across projects.
- Establish evaluation benchmarks and acceptance criteria for AI features.
- Participate in technical hiring and mentoring of future AI team members.
Experience
- Minimum 5+ years software development experience with significant hands-on work building production AI systems.
- Experience delivering end-to-end AI features used by real users.
- Hands-on experience with RAG, agent workflows, or automation systems.
Technical Skills
- Strong Python programming skills.
- Experience with AI frameworks (LangChain, LlamaIndex, DSPy, Semantic Kernel, or similar).
- Understanding of agents, tool calling, and workflow orchestration patterns.
- Experience with vector databases and retrieval systems.
- Knowledge of evaluation methodologies for AI outputs.
- Experience integrating AI systems with APIs, databases, and backend applications.
- Familiarity with containerized deployments and cloud platforms.
Good to Have
- Experience with multi-agent coordination patterns.
- LLMOps practices (versioning, rollback, evaluation datasets).
- Working with open-source/local models.
- Security and safety considerations in AI systems.
- Experience improving business workflows using AI automation.
Soft Skills
- Ability to work with ambiguous requirements and drive solution design.
- Strong debugging ability in non-deterministic systems.
- Clear communication and technical ownership.
Similar Jobs
Financial Services
Design and maintain reliable, scalable, and secure AWS infrastructure using Terraform and automation scripts. Manage monitoring, logging, alerting, CI/CD, container orchestration, incident response, and performance optimization. Collaborate with development, operations, and security teams, participate in on-call rotations, enforce cloud security practices, document systems, and responsibly use AI-assisted engineering tools.
Top Skills:
Ai-Assisted Software Development ToolsAlertingAWSAws LambdaCi/CdDockerInfrastructure As CodeJavaKubernetesLoggingMonitoringPythonRubyShellTerraform
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Build and deploy AI-powered solutions for enterprise and campus customers. Scope environments, prototype agentic AI applications, design secure multi-tenant and hybrid architectures, and harden successful prototypes into production. Own identity, encryption, networking, CI/CD, observability, and production support within customer environments. Collaborate with product, AI, data, and program teams to standardize repeatable solutions. The role is highly customer-facing and requires regular domestic and occasional international travel.
Top Skills:
Api GatewaysAWSAws PrivatelinkCi/CdDockerDuckdbEncryptionFastmcpIamJavaKafkaKey ManagementKubernetesLangchainLanggraphMcpMtlsObservabilityPgvectorPostgresPythonRagTypescriptVpc Peering
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Architects and deploys AI-powered applications and automated claims-testing solutions using Python, generative AI, agentic workflows, RAG, databases, cloud platforms, and DevOps tools. Develops test automation frameworks, data pipelines, microservices, and CI/CD processes; analyzes claims data for anomalies and reliability improvements. Collaborates with QA, business analysts, and cross-functional teams, provides technical leadership, mentors engineers, and supports responsible AI-assisted development.
Top Skills:
Agentic AiAirflowAWSAzureChatgptChromadbCi/CdClaudeDockerGCPGenerative AiGithub ActionsGithub CopilotJavaJenkinsKerasKubernetesLlm OrchestrationMicroservicesMicrosoft CopilotOpencvOraclePostgresPrompt EngineeringPythonRetrieval-Augmented Generation (Rag)SpringTensorFlow
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
