BS Balasubramaniam Srinivasan
Senior Applied Scientist & Tech Lead · Amazon AGI

Balasubramaniam
Srinivasan

Senior Applied Scientist & Tech Lead at Amazon AGI. I build RL environments and evaluations that make 

I work on reinforcement learning, post-training, and safety for LLM agents: studying when agents reward-hack or overstep what they were asked to do, and how that behavior generalizes. Previously I led science for agentic AI products on Amazon Bedrock AgentCore, from first prototype to general availability.

Balasubramaniam Srinivasan
7
GA launches
1,000+
enterprise customers
20+
papers & patents
Now

What I’m working on.

Currently Amazon AGI · Responsible AI

RL environments for agentic misalignment

I build and mutate RL gyms that measure agentic misalignment: when LLM agents act like insider threats, taking actions beyond what they were legitimately asked to do because reward hacking pays off. I adversarially mutate existing gyms (red team vs. blue team) to see whether mutations raise the attack success rate (ASR) of eliciting this behavior, and I study how this behavior transfers from one workflow to others.

RL environments Reward hacking Agentic misalignment Misalignment generalization
Previously AWS Agentic AI

Amazon Bedrock AgentCore

Tech Lead for science on AgentCore Optimization (GA) and AWS Agent Registry (GA): optimizing production agents from their own traces, agent search, pre-deployment security scanning, and RL-driven automated red-teaming. Core contributor to AgentCore Evaluations (GA).

Agent optimization Red-teaming Agent search Evaluations
Open to Always

Collaborations & conversations

Happy to talk with researchers at frontier labs and in academia. Especially interested in RL environments and reward hacking, alignment and safety for agentic systems, RL post-training for tool-using agents, and the science of evaluation.

Research focus

Making LLM agents capable, measurable, and safe.

My research sits where reinforcement learning, LLM agents, and safety meet: building the environments, evaluations, and optimization loops that tell us what agents actually do, and making them better and safer at it.

01

RL environments & agentic misalignment

Building long-horizon RL environments, with their graders and reward signals, that measure insider-threat behavior in LLM agents (reward hacking, specification gaming, out-of-scope actions); adversarially mutating them (red team vs. blue team) to measure the attack success rate (ASR) of eliciting that behavior; and studying how the behavior generalizes across workflows. On the security side: pre-deployment scanning and RL-driven automated red-teaming (prompt injection, jailbreaks, unsafe tool use).

02

Agent optimization & post-training

Turning production agent traces into training and optimization signal: system-prompt, tool-description, and context recommendations, auto-generated skill files, and RL policies for task correctness and cost, validated with batch evaluations and live A/B tests. Also retrieval for agents: hybrid search and fine-tuned retrievers over tools, MCP servers, and skills.

03

Evaluation science & routing

When can a score be trusted? Meta-evaluation of LLM judges (calibration, drift, agreement with human evaluation), trajectory and safety evaluation for compound agents, synthetic evaluation data, and model routing with calibrated quality predictors under user-controlled cost trade-offs.

04

Symmetry-aware representation learning

Invariant and equivariant architectures that build symmetries into neural networks, with expressiveness theory: Janossy Pooling, Relational Pooling, the equivalence of positional and structural embeddings, hypergraph networks, and ESAN subgraph GNNs.

Projects & products

From research to production.

Current research at Amazon AGI, and products I led or contributed to at AWS, from first prototype to general availability, across Amazon Bedrock AgentCore, Bedrock, and DataZone.

Amazon AGI
Current

RL Environments for Agentic Misalignment

RL gyms for Responsible AI that measure insider-threat behavior in LLM agents: out-of-scope actions driven by reward hacking and specification gaming. Existing gyms are adversarially mutated (red team vs. blue team) to test whether mutations raise the attack success rate (ASR) of eliciting insider-threat behavior, and held-out workflows measure how the behavior generalizes.

Research
Amazon Bedrock AgentCore
GA Jun 2026

AgentCore Optimization

Continuous improvement for production AI agents from their own telemetry. Mines OpenTelemetry traces and evaluator outputs to recommend system-prompt and tool-description changes, validates them with batch evaluations and live-traffic A/B tests, and surfaces failure insights. Science also covers auto-generated skill files and RL policies for task correctness and cost.

Amazon Bedrock AgentCore
GA Aug 2026

AWS Agent Registry (search and security)

Private, governed catalog for discovering and governing agents, MCP servers, tools, and skills across an enterprise, with hybrid semantic and lexical search, also exposed as an MCP server. Science covers fine-tuned retrieval for agent search, plus pre-deployment security scanning and RL-driven automated red-teaming for compound agentic systems.

Amazon Bedrock AgentCore
GA Mar 2026

AgentCore Evaluations

Production evaluation framework for AI agents covering task success, tool-use correctness, trajectory quality, and safety adherence. Owned synthetic evaluation data generation and the meta-evaluation of LLM judges (calibration, drift, agreement with human raters).

GA Core contributor Launch news → Blog →
Amazon Bedrock
Apr 2025

Intelligent Prompt Routing

Routes each request to the most suitable model within a model family. Calibrated quality predictor, user-controlled quality-cost tolerance, offline and online eval harness. Scaled to 1M+ requests/week with 40%+ cost reduction vs. top model at <150 ms routing latency. Published as IPR (EMNLP 2025).

GA Tech Lead Launch news → Blog →
Amazon Bedrock
Apr 2025

Prompt Optimization

Automatically rewrites prompts for better performance across Claude, Llama, Nova, Mistral, Titan, and DeepSeek. Contributed to rewrite strategies, per-task quality evaluation, and task coverage spanning summarization, RAG/QA, classification, function calling, and reasoning.

GA Core contributor Launch news → Blog →
Amazon DataZone
Mar 2024

AutoDoc: AI descriptions for the data catalog

LLM-based documentation for enterprise data catalogs. Generates summaries and column descriptions without access to column contents. Schema-aware routing, iterative refinement, and LLM-as-judge evaluation across 1,000+ column tables and 20+ industry domains. Granted US Patent 12,524,628.

GA Tech Lead Launch news → Blog →
Amazon DataZone
Oct 2023

Business Name Generation

Generative AI layer for Amazon DataZone that proposes business-friendly names for technical assets, so analysts can discover data by what it means rather than by cryptic column names. Designed a small permutation-equivariant model that jointly names all columns of a table, beating state-of-the-art LLMs by 10+ points.

GA Core contributor Launch news → Blog →
Selected publications

Selected Publications.

20+ papers and patents, 2,000+ citations. Click any paper to read the abstract; full list on Google Scholar.

News

Recent highlights.

  • 2026
    Moved to Amazon AGIBuilding RL environments for Responsible AI: agentic misalignment, reward hacking, and how they generalize across workflows.
  • Aug 2026
    AWS Agent Registry (GA)Agent search and governance for AgentCore reaches general availability (Aug 31).
  • Jun 2026
    AgentCore Optimization (GA)Recommendations, batch evaluations, and A/B testing reach general availability.
  • May 2026
    AgentCore Optimization (Preview)Led science for the launch within Amazon Bedrock AgentCore.
  • Apr 2026
    AWS Agent Registry (Preview)Led science for the launch within Amazon Bedrock AgentCore.
  • Mar 2026
    AgentCore Evaluations (GA)Agent evaluation framework reaches general availability (Mar 31).
  • Mar 2026
    EACL 2026BayesFlow and Diffusion LM Inference with MCTS accepted (Findings).
  • Jan 2026
    US Patent 12,524,628 grantedAutomated LLM analysis and documentation of tables (AutoDoc).
  • Dec 2025
    AWS re:Invent 2025Amazon Bedrock AgentCore adds quality evaluations and policy controls.
  • Nov 2025
    EMNLP 2025IPR: Intelligent Prompt Routing (Industry Track) and Survey of APO Techniques (Main) accepted.
  • Oct 2025
    Amazon Bedrock AgentCore (GA)Generally available Oct 13, 2025.
  • Jul 2025
    Amazon Bedrock AgentCore (Preview)Launched at AWS Summit NYC, Jul 16, 2025.
  • Apr 2025
    NAACL 2025 FindingsDiscoverGPT: Multi-task Fine-tuning LLM for Related Table Discovery accepted.
  • Apr 2025
    Bedrock IPR and Prompt Optimization (GA)Both move to general availability.
  • Dec 2024
    AWS re:Invent 2024Bedrock Intelligent Prompt Routing and Prompt Optimization announced in preview.
  • Nov 2024
    EMNLP 2024CoverICL: Selective Annotation for In-Context Learning via Active Graph Coverage accepted.
  • Mar 2024
    AutoDoc (GA)AI recommendations for descriptions in Amazon DataZone reaches general availability.
  • Jan 2024
    ICLR 2024TabSyn (Oral), BioBridge, and OpenTab accepted.
  • Nov 2023
    NeurIPS 2023HYTREL accepted (Spotlight).
  • Nov 2023
    EMNLP 2023NameGuess: Column Name Expansion for Tabular Data accepted.
  • Nov 2023
    AWS re:Invent 2023AutoDoc announced in preview.
  • Oct 2023
    Amazon DataZone (GA)Business Name Generation (BNG) ships as part of DataZone general availability launch.
  • Jun 2022
    Joined Amazon AWSDefended PhD at Purdue; joined AWS AI Research & Education as an Applied Scientist.
  • Jan 2022
    ICLR 2022ESAN: Equivariant Subgraph Aggregation Networks accepted (Spotlight).
  • Apr 2021
    SDM 2021Learning over Families of Sets: Hypergraph Representation Learning for Higher Order Tasks accepted.
  • Jan 2020
    ICLR 2020On the Equivalence between Positional Node Embeddings and Structural Graph Representations accepted.
  • Jun 2019
    ICML 2019Relational Pooling for Graph Representations accepted.
  • Jan 2019
    ICLR 2019Janossy Pooling: Learning Deep Permutation-Invariant Functions for Variable-Size Inputs accepted.
Background

Experience & education.

Experience
2022–now
Senior Applied Scientist & Tech Lead
Amazon: Amazon AGI (Responsible AI, current) · AWS Agentic AI (Bedrock AgentCore) · Amazon Bedrock · AWS AI Research & Education. Promoted from Applied Scientist in Apr 2024.
2020, 2021
Applied Scientist Intern
Amazon AWS · hypergraph neural networks, protein representations
2018–2022
PhD Researcher
Purdue University · Advisor: Bruno Ribeiro
2015–2016
Software Engineer, Performance Modeling & Analysis
ARM
Education
2018–2022
PhD, Computer Science
Purdue University
2016–2018
MS, Computer Science
University of California, San Diego
2011–2015
BE (Hons.), Electrical and Electronics
BITS Pilani
Service & honors
2023–now
Area Chair
NeurIPS · COLM · ACL Rolling Review
2020–now
Reviewer
ICML · ICLR · AAAI · LoG
2022–24
Paper awards
ICLR 2024 Oral · NeurIPS 2023 Spotlight · ICLR 2022 Spotlight
2018
Award for Excellence in Teaching
UC San Diego

Let’s talk.

Whether you’re a researcher, founder, or anyone else: if you’re working on hard problems in RL, alignment, or agentic AI, I’d love to hear from you.