Why This Job is Featured on The SaaS Jobs
This role stands out in SaaS because it is platform work aimed at making AI agents production-ready across an established product organization. Rather than shipping a single feature, the focus is on the internal frameworks, tooling, and guardrails that let multiple teams build and operate agentic capabilities consistently. In the current SaaS landscape, where AI features are becoming table stakes, the differentiator is often the reliability and governance layer that sits underneath.
Career-wise, the remit maps to durable SaaS platform problems: orchestration in distributed systems, evaluation discipline, and observability as a product for internal consumers. Experience designing APIs and SDKs for other engineers, plus building quality and regression workflows, translates well across companies investing in AI-enabled products. The cross-language integration work also signals exposure to real-world constraints that appear in mature SaaS backends.
The role is best suited to engineers who enjoy setting standards, reducing adoption friction, and thinking in terms of ecosystem impact rather than isolated services. It will appeal to someone comfortable with ambiguity in a new team, who can balance experimentation with operational rigor, and who prefers work that enables other product squads to move with confidence.
The section above is editorial commentary from The SaaS Jobs, provided to help SaaS professionals understand the role in a broader industry context.
Job Description
As a Senior Backend Engineer on Gong’s AI Framework team, you will build the foundational platform that enables the entire organization to design, evaluate, deploy, and operate AI agents at scale. This is a new, high-impact team responsible for creating the frameworks, tools, and guardrails that power Gong’s agentic ecosystem.
You’ll work deeply in the agentic space, designing systems for orchestration, evaluation, observability, and safety. The platforms you build will be used by multiple teams across Gong, making your impact immediate and company-wide.
You’ll Own:
- Agentic Framework Architecture: Designing and building Gong’s internal agentic framework, leveraging and integrating industry-standard tools such as LangChain, LangSmith, ADK, and similar ecosystems.
- Evaluation and Quality Systems: Building evaluation frameworks and workflows for AI agents, including offline and online evaluations, quality metrics, regression detection, and experimentation infrastructure.
- Observability, Monitoring, and Guardrails: Providing the organization with robust observability capabilities for AI agents, including tracing, logging, monitoring, cost tracking, and safety guardrails to ensure reliable and responsible usage.
- Developer Enablement Platforms: Creating APIs, SDKs, and abstractions that enable product teams to easily build, test, and operate agents while adhering to platform standards.
- Cross-Language Integrations: Designing integrations and tooling across Python and Java to enable seamless adoption of the AI framework within Gong’s broader backend ecosystem.
You’ll Solve:
- Agent Lifecycle and Orchestration Complexity: Managing agent execution, tool usage, memory, workflows, and failure modes in production-grade systems.
- AI System Reliability at Scale: Ensuring agents remain observable, debuggable, and safe as usage scales across teams and products.
- Evaluation and Drift Challenges: Detecting quality regressions, model behavior changes, and unintended agent behaviors through robust evaluation and monitoring systems.
- Platform Adoption Friction: Balancing flexibility with guardrails so teams can innovate quickly without compromising reliability, security, or cost controls.
You’ll Impact:
- Company-Wide AI Enablement: Empowering every engineering team at Gong to build agent-based solutions faster, with higher quality and confidence.
- Foundational AI Infrastructure: Establishing the core frameworks, evaluations, and observability standards that all AI agents at Gong will rely on.
- AI Safety and Quality Bar: Raising the bar for how AI systems are evaluated, monitored, and governed across the company.
How You’ll Succeed Here
- 7+ years of backend engineering experience, with strong system design and platform-building expertise.
- Strong analytical and problem-solving skills, with the ability to debug and resolve complex technical issues efficiently.
- Hands-on experience with agentic systems and frameworks such as LangChain, LangSmith, ADK, or equivalent agent orchestration platforms.
- Strong understanding of AI evaluation methodologies, including agent evaluations, prompt evaluation, regression testing, and quality monitoring.
- High proficiency in Python for building production-grade AI frameworks and services.
- Familiarity with Java and experience integrating backend platforms or tooling into Java-based systems.
- Experience building observability, monitoring, or platform tooling for distributed systems.
- Strong analytical skills and the ability to reason about complex, evolving AI-driven systems.
- Experience with cloud platforms and scalable microservices architectures.
- Excellent communication skills and a strong platform mindset, with experience enabling multiple teams.
*We operate in a flexible hybrid work model.
What Makes Engineering at Gong Unique?
At Gong, we trust and empower our employees with ownership to solve complex problems, make sound decisions, and build products that create meaningful impact. We call this “Own. Solve. Impact.”
For our engineers, this means it’s not just about writing code. You are involved in and able to influence the entire process to create the best possible product. If you’re curious to discover Gong’s dynamic and challenging environment, what are you waiting for? Don’t delay—submit your application today. Who knows, maybe there’s a Gongster in you!
We encourage our employees to express their personality and identity (whether gender, ethnic, religious, or sexual), and we ensure fairness and equal opportunities. We follow a hybrid working model that combines working from home, on the go, or at the office. This allows us: flexibility, autonomy, positive work relationships, and effective work habits.
If these considerations are important to you when choosing a workplace, we'd love to see you with us.
To review Gong's privacy policy, visit www.gong.io/privacy-policy/ for more details.
#LI-MK3
