Why This Job is Featured on The SaaS Jobs
AI infrastructure roles have become a distinct track inside modern SaaS, especially as search, assistants, and RAG style applications move from prototypes into dependable product surfaces. This position sits in that layer where model behavior meets production constraints, covering serving, routing, orchestration, and the data pipelines that keep systems current. The listing also signals a product-led SaaS environment through regular customer interaction and an emphasis on solving concrete workplace information problems rather than research in isolation.
For a SaaS career, the durable value here is learning how to operationalise AI features under real usage patterns. Work spanning evaluation, experimentation, and infrastructure health maps closely to how SaaS teams manage reliability and iteration when models and data shift over time. Experience building maintainable systems that enable other engineers is broadly transferable across SaaS companies adopting LLMs, where platform minded engineering increasingly underpins product velocity.
The role is best suited to an engineer who wants ownership across multiple layers of an AI stack and is comfortable balancing pragmatic delivery with technical depth. It fits someone who prefers cross-functional collaboration, can translate customer pain into system design choices, and is ready to grow through mentoring and being mentored in a production focused setting.
The section above is editorial commentary from The SaaS Jobs, provided to help SaaS professionals understand the role in a broader industry context.
Job Description
About the Role:
Glean is looking for software engineers to help build the world's best search and assistant product for work. Our engineers work on a range of systems across the stack, including generative AI, RAG, query understanding, document understanding, domain-adapted language models, natural language question-answering, evaluation, and experimentation. We interact regularly with customers, deeply understand their pain points, and use whatever tool is necessary, simple or complex, to solve their problems.
You will:
- Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale.
- Work with and enable other engineers focused on modeling and Agentic capabilities
- Build agentic systems that leverage AI to proactively monitor, diagnose, debug and maintain infrastructure health at scale across cloud deployments
- Write robust code that's easy to read, maintain, and test
- Mentor more junior engineers, or learn from battle-tested ones
About you:
- 2-5 years of experience
- BA/BS in computer science, math, sciences, or a related degree
- Proven ability to design, build, and ship production-ready software, ideally around AI/ML infrastructure (Batch processing pipelines, Serving infrastructure, LLM orchestration etc.)
- Strong coding skills (Python, Go, Java)
- Thrive in a customer-focused, tight-knit and cross-functional environment — being a team player and willing to take on whatever is most impactful for the company is a must
- A proactive and positive attitude to lead, learn, troubleshoot and take ownership of both small tasks and large features
Location:
- This role is hybrid (3-4 days a week in our San Francisco office)
Compensation & Benefits:
The standard base salary range for this position is $175,000 - $270,000 annually. Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.
We offer a comprehensive benefits package including competitive compensation, Medical, Vision, and Dental coverage, generous time-off policy, and the opportunity to contribute to your 401k plan to support your long-term goals. When you join, you'll receive a home office improvement stipend, as well as an annual education and wellness stipends to support your growth and wellbeing. We foster a vibrant company culture through regular events, and provide healthy lunches daily to keep you fueled and focused.
We are a diverse bunch of people and we want to continue to attract and retain a diverse range of people into our organization. We're committed to an inclusive and diverse company. We do not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.
#LI-HYBRID
