Why This Job is Featured on The SaaS Jobs
This Senior Backend Engineer role sits at a common inflection point in modern SaaS: turning AI from isolated features into shared infrastructure. The remit is platform-first, focused on the frameworks, tooling, and guardrails that let multiple product teams build and run AI agents consistently. In a SaaS organization where many surfaces depend on reliable backend services, internal platforms like this often become the backbone for how AI capabilities are shipped and governed.
From a SaaS career perspective, the work maps to durable platform engineering skills that transfer across companies adopting agentic systems. Building evaluation pipelines, observability, and safety controls aligns with the operational realities of subscription software, where regressions, drift, and cost visibility matter over long-lived customer usage. The cross-language integration element also mirrors the practical constraints of established SaaS stacks, where new AI layers must coexist with existing services.
This is best suited to an engineer who prefers enabling other teams through APIs and developer tooling rather than owning a single end-user feature. It fits someone comfortable defining standards, debugging production behavior, and balancing flexibility with constraints in shared systems. The scope will appeal to professionals who want to specialize in production-grade AI foundations inside a multi-team SaaS environment.
The section above is editorial commentary from The SaaS Jobs, provided to help SaaS professionals understand the role in a broader industry context.
Job Description
As a Senior Backend Engineer on Gong’s AI Framework team, you will build the foundational platform that enables the entire organization to design, evaluate, deploy, and operate AI agents at scale. This is a new, high-impact team responsible for creating the frameworks, tools, and guardrails that power Gong’s agentic ecosystem.
You’ll work deeply in the agentic space, designing systems for orchestration, evaluation, observability, and safety. The platforms you build will be used by multiple teams across Gong, making your impact immediate and company-wide.
You’ll Own:
- Agentic Framework Architecture: Designing and building Gong’s internal agentic framework, leveraging and integrating industry-standard tools such as LangChain, LangSmith, ADK, and similar ecosystems.
- Evaluation and Quality Systems: Building evaluation frameworks and workflows for AI agents, including offline and online evaluations, quality metrics, regression detection, and experimentation infrastructure.
- Observability, Monitoring, and Guardrails: Providing the organization with robust observability capabilities for AI agents, including tracing, logging, monitoring, cost tracking, and safety guardrails to ensure reliable and responsible usage.
- Developer Enablement Platforms: Creating APIs, SDKs, and abstractions that enable product teams to easily build, test, and operate agents while adhering to platform standards.
- Cross-Language Integrations: Designing integrations and tooling across Python and Java to enable seamless adoption of the AI framework within Gong’s broader backend ecosystem.
- Agent Runtime and Execution Engine: Building the runtime responsible for orchestrating agent execution, managing tool calls, maintaining state and memory, and ensuring reliable execution across distributed systems.
You’ll Solve:
- Agent Lifecycle and Orchestration Complexity: Managing agent execution, tool usage, memory, workflows, and failure modes in production-grade systems.
- AI System Reliability at Scale: Ensuring agents remain observable, debuggable, and safe as usage scales across teams and products.
- Evaluation and Drift Challenges: Detecting quality regressions, model behavior changes, and unintended agent behaviors through robust evaluation and monitoring systems.
- Platform Adoption Friction: Balancing flexibility with guardrails so teams can innovate quickly without compromising reliability, security, or cost controls.
You’ll Impact:
- Company-Wide AI Enablement: Empowering every engineering team at Gong to build agent-based solutions faster, with higher quality and confidence.
- Foundational AI Infrastructure: Establishing the core frameworks, evaluations, and observability standards that all AI agents at Gong will rely on.
- AI Safety and Quality Bar: Raising the bar for how AI systems are evaluated, monitored, and governed across the company.
How You’ll Succeed Here
- 7+ years of backend engineering experience, with strong system design and platform-building expertise.
- Strong analytical and problem-solving skills, with the ability to debug and resolve complex technical issues efficiently.
- Hands-on experience designing and building agentic systems or agent frameworks in production, including orchestration, tool usage, memory management, and multi-step workflows.
- Experience extending or building frameworks on top of tools like LangChain, LangGraph, ADK, or similar agent orchestration frameworks.
- Experience designing, implementing, and operating production-grade AI agents, including handling failure modes, retries, observability, and real user traffic.
- Strong understanding of AI evaluation methodologies, including agent evaluations, prompt evaluation, regression testing, and quality monitoring.
- High proficiency in Python for building production-grade AI frameworks and services.
- Familiarity with Java and experience integrating backend platforms or tooling into Java-based systems.
- Experience building observability, monitoring, or platform tooling for distributed systems.
- Strong analytical skills and the ability to reason about complex, evolving AI-driven systems.
- Experience with cloud platforms and scalable microservices architectures.
- Excellent communication skills and a strong platform mindset, with experience enabling multiple teams.
*We operate in a flexible hybrid work model.
What Makes Engineering at Gong Unique?
At Gong, we trust and empower our employees with ownership to solve complex problems, make sound decisions, and build products that create meaningful impact. We call this “Own. Solve. Impact.”
For our engineers, this means it’s not just about writing code. You are involved in and able to influence the entire process to create the best possible product. If you’re curious to discover Gong’s dynamic and challenging environment, what are you waiting for? Don’t delay—submit your application today. Who knows, maybe there’s a Gongster in you!
We encourage our employees to express their personality and identity (whether gender, ethnic, religious, or sexual), and we ensure fairness and equal opportunities. We follow a hybrid working model that combines working from home, on the go, or at the office. This allows us: flexibility, autonomy, positive work relationships, and effective work habits.
If these considerations are important to you when choosing a workplace, we'd love to see you with us.
To review Gong's privacy policy, visit www.gong.io/privacy-policy/ for more details.
#LI-MK3
