Why This Job is Featured on The SaaS Jobs
This role stands out in the SaaS ecosystem because it focuses on the internal platform layer that makes AI features operable at enterprise scale. Rather than shipping a single product surface, the remit is to define shared runtime capabilities for agent sessions, memory, orchestration, and multi tenant isolation, which are recurring challenges as SaaS companies embed autonomous workflows into core applications.
From a SaaS career perspective, the work sits at the intersection of platform engineering and applied AI reliability. Building evaluation systems, observability, and guardrails creates durable expertise in how SaaS teams manage quality, cost, and safety for production AI. The emphasis on APIs and SDK style enablement also develops a platform mindset that transfers well across SaaS organizations where internal developer experience determines delivery speed.
The position is best suited to an engineer who prefers foundational problems, clear interfaces, and cross team alignment over narrow feature ownership. It fits someone ready to balance hands on architecture with people leadership, and who enjoys setting standards that other teams adopt. Interest in agent frameworks and pragmatic production constraints is a strong signal of fit.
The section above is editorial commentary from The SaaS Jobs, provided to help SaaS professionals understand the role in a broader industry context.
Job Description
We’re looking for an Engineering Team Lead, who will be responsible for the foundational infrastructure framework used by all Gong engineering teams to build, deploy, and operate AI agents safely in production. We are building the "operating system" for AI at Gong, covering agent sessions, memory management, tool orchestration, durable execution, and multi-tenant isolation. You will lead a high-impact team of 3-4 engineers to create the runtime and platform that defines the future of autonomous enterprise intelligence.
You’ll Own:
- Agentic Framework Architecture: Designing and building Gong’s internal agentic framework, leveraging and integrating industry-standard tools such as LangChain, LangSmith, ADK, and similar ecosystems.
- Evaluation and Quality Systems: Building evaluation frameworks and workflows for AI agents, including offline and online evaluations, quality metrics, regression detection, and experimentation infrastructure.
- Team Leadership & Mentorship: Leading a squad of 3-4 senior engineers, fostering a culture of technical excellence, and managing end-to-end delivery in a fast-paced environment. You will spend approximately 50% of your time hands-on, architecting core systems and reviewing code, and 50% leading the team, mentoring engineers, and aligning with cross-functional stakeholders.
- Observability, Monitoring, and Guardrails: Providing the organization with robust observability capabilities for AI agents, including tracing, logging, monitoring, cost tracking, and safety guardrails to ensure reliable and responsible usage.
- Developer Enablement Platforms: Creating APIs, SDKs, and abstractions that enable product teams to easily build, test, and operate agents while adhering to platform standards.
- Cross-Language Integrations: Designing integrations and tooling across Python and Java to enable seamless adoption of the AI framework within Gong’s broader backend ecosystem.
You’ll Solve:
- Agent Lifecycle and Orchestration Complexity: Managing agent execution, tool usage, memory, workflows, and failure modes in production-grade systems.
- AI System Reliability at Scale: Ensuring agents remain observable, debuggable, and safe as usage scales across teams and products.
- Evaluation and Drift Challenges: Detecting quality regressions, model behavior changes, and unintended agent behaviors through robust evaluation and monitoring systems.
- Platform Adoption Friction: Balancing flexibility with guardrails so teams can innovate quickly without compromising reliability, security, or cost controls.
You’ll Impact:
- Company-Wide AI Enablement: Empowering every engineering team at Gong to build agent-based solutions faster, with higher quality and confidence.
- Foundational AI Infrastructure: Establishing the core frameworks, evaluations, and observability standards that all AI agents at Gong will rely on.
- AI Safety and Quality Bar: Raising the bar for how AI systems are evaluated, monitored, and governed across the company.
How You’ll Succeed Here:
- 8+ years of backend engineering experience, with strong system design and platform-building expertise. Tech leadership or team leading experience is an advantage.
- Strong analytical and problem-solving skills, with the ability to debug and resolve complex technical issues efficiently.
- Hands-on experience with agentic systems and frameworks such as LangChain, LangSmith, ADK, or equivalent agent orchestration platforms.
- Strong understanding of AI evaluation methodologies, including agent evaluations, prompt evaluation, regression testing, and quality monitoring.
- High proficiency in Python for building production-grade AI frameworks and services.
- Familiarity with Java and experience integrating backend platforms or tooling into Java-based systems.
- Experience building observability, monitoring, or platform tooling for distributed systems.
- Strong analytical skills and the ability to reason about complex, evolving AI-driven systems.
- Experience with cloud platforms and scalable microservices architectures.
- Excellent communication skills and a strong platform mindset, with experience enabling multiple teams.
*We operate in a flexible hybrid work model.
What Makes Engineering at Gong Unique?
Here at Gong, we trust and empower our employees with ownership to solve complex problems, make sound decisions, and build products that create meaningful impact. We call this “Own. Solve. Impact.”
For our engineers, this means it’s not just about writing code. You are involved in and able to influence the entire process to create the best possible product. If you’re curious to discover Gong’s dynamic and challenging environment, what are you waiting for? Don’t delay—submit your application today. Who knows, maybe there’s a Gongster in you!
We encourage our employees to express their personality and identity (whether gender, ethnic, religious, or sexual), and we ensure fairness and equal opportunities. We follow a hybrid working model that combines working from home, on the go, or at the office. This allows us: flexibility, autonomy, positive work relationships, and effective work habits.
If these considerations are important to you when choosing a workplace, we'd love to see you with us.
To review Gong's privacy policy, visit www.gong.io/privacy-policy/ for more details
#LI-MK3
