Why This Job is Featured on The SaaS Jobs
This Staff Machine Learning Engineer role sits at the intersection of two mature SaaS categories, observability and security, where product differentiation increasingly comes from how effectively platforms can reason over high-volume machine data in near real time. The remit around agentic SOC workflows and multi-agent architectures signals a shift from standalone ML features toward system-level AI capabilities that must operate reliably inside production SaaS environments.
For a SaaS career, the distinctive value is end-to-end ownership across the AI lifecycle: evaluating emerging foundation model frameworks, building evaluation pipelines, and translating prototypes into scalable LLMOps. Work that blends architecture, quality measurement, and operational constraints such as latency and cost tends to transfer well across SaaS companies adopting AI, because it mirrors the recurring challenge of delivering consistent outcomes on continuously changing data and model behavior.
The role is best suited to senior engineers who prefer ambiguous problem spaces and are comfortable setting technical direction across teams rather than optimizing a single model in isolation. It will appeal to practitioners who enjoy pairing deep hands-on building with mentorship and cross-functional partnership, especially where production readiness, monitoring, and safety practices are central to shipping AI in SaaS.
The section above is editorial commentary from The SaaS Jobs, provided to help SaaS professionals understand the role in a broader industry context.
Job Description
Staff Machine Learning Engineer – AI Tech Lead
Location: USA
The proliferation of AI and machine log data has the potential to give organizations unprecedented real-time visibility into their infrastructure and security operations. With this opportunity comes significant technical challenges around ingesting, managing, and reasoning over massive, heterogeneous, high-velocity data streams at global scale.
As a Staff Machine Learning Engineer – AI Tech Lead, you will lead the design and delivery of the next generation of Agentic AI systems for Security Operation Center (Agentic SOC). You will evaluate, prototype, and productionize state-of-the-art agentic AI technologies and build scalable multi-agent architectures that reason over large-scale machine data to drive real-time detection, investigation, and response.
This is a highly technical leadership role with deep ownership of AI agent architecture, evaluation, LLM fine-tuning, and production AI infrastructure. You will help define the technical direction for Sumo Logic’s agentic AI platform and play a key role in bringing advanced AI capabilities to customers at global scale.
Responsibilities
- Lead and partner with fellow leadership members and teams on technical evaluation and adoption of cutting-edge agentic AI platforms, including Anthropic (Claude), LangChain/LangGraph, AWS Bedrock, and other emerging agent frameworks.
- Architect, prototype, and productionize multi-agent AI systems for Agentic SOC use cases, including detection, triage, investigation, and response workflows.
- Own the design of core agent architecture components, including planning, execution, tool orchestration, memory, context engineering, and long-running agent workflows.
- Lead AI agent evaluation systems, including offline and online evaluation pipelines, golden datasets, synthetic data generation, human- and LLM-based judging, and continuous quality monitoring.
- Drive LLM fine-tuning and alignment efforts to improve domain-specific reasoning, accuracy, and reliability for security and observability use cases.
- Design scalable LLMOps and AI agent infrastructure, including inference routing, latency optimization, cost control, and production observability for agent systems.
- Partner with product, security, and data platform leadership and teams to deliver end-to-end AI agent capabilities from prototype to customer-facing production systems.
- Lead and partner on technical direction and mentorship for AI engineers working on agentic AI and LLM systems.
- Define and implement best practices for AI safety, reliability, evaluation, and monitoring in production agentic systems.
- Operate as a senior technical owner in ambiguous problem spaces—setting technical direction, breaking down complex problems, and driving delivery across teams.
Required Qualifications
- B.Tech, M.Tech, or Ph.D. in Computer Science, Machine Learning, Data Science, or a related technical field.
- 5+ years of hands-on industry experience building, operating, and leading production ML/AI systems, with demonstrated technical leadership and ownership.
- Strong foundation in machine learning, distributed systems, data pipelines, and large-scale system design.
- Deep industry understanding of LLMs, prompt engineering, context engineering, agentic AI design patterns, and reasoning workflows.
- Strong proficiency in Python and modern ML/AI ecosystems.
- Experience designing and operating evaluation frameworks for ML/LLM systems (offline + online).
- Proven ability to lead complex technical initiatives across teams and influence architecture decisions.
- Excellent communication skills and ability to translate complex AI systems into business impact.
Desired Qualifications
- Hands-on experience building and scaling agentic AI systems or multi-agent architectures in production.
- Experience with modern agent frameworks such as LangGraph, LangChain, CrewAI, or similar.
- Experience with major foundation model platforms such as Anthropic, OpenAI, AWS Bedrock, or Vertex AI.
- Experience with LLM fine-tuning pipelines (SFT, RLHF/RLAIF, preference learning, domain adaptation).
- Strong background in LLMOps, including inference optimization, latency/cost management, observability, and production monitoring.
- Experience with ML infrastructure and tooling such as PyTorch, MLflow, Airflow, Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure).
- Experience applying AI/ML to security, observability, or large-scale log/telemetry data is a strong plus.
About Us
Sumo Logic, Inc. empowers the people who power modern, digital business. Sumo Logic enables customers to deliver reliable and secure cloud-native applications through its Sumo Logic SaaS Analytics Log Platform, which helps practitioners and developers ensure application reliability, secure and protect against modern security threats, and gain insights into their cloud infrastructures. Customers worldwide rely on Sumo Logic to get powerful real-time analytics and insights across observability and security solutions for their cloud-native applications. For more information, visit www.sumologic.com.
Sumo Logic Privacy Policy. Employees will be responsible for complying with applicable federal privacy laws and regulations, as well as organizational policies related to data protection.
The expected annual base salary range for this position is $221,000 - $260,000. Compensation varies based on a variety of factors, which include (but aren’t limited to) role level, skills and competencies, qualifications, knowledge, location, and experience. In addition to base pay, certain roles are eligible to participate in our bonus or commission plans, as well as our benefits offerings and equity awards.
Must be authorized to work in the United States at the time of hire and for the duration of employment. At this time, we are not able to offer non-immigrant visa sponsorship for this position.
