Why This Job is Featured on The SaaS Jobs
Sumo Logic sits in a mature segment of SaaS where cloud-native observability and security analytics depend on continuously interpreting high-volume machine data. This role is featured because it is positioned at the intersection of production ML and modern LLM-based “agentic” systems, applied to log and event streams that are inherently noisy, heterogeneous, and operationally consequential. The scale described, including multi-region AWS microservices and petabyte-level ingestion, makes the ML work tightly coupled to real-world platform constraints.
For a SaaS career, the value here is in learning how intelligent features are shipped and sustained inside a core product, not as a side experiment. Ownership across dataset strategy, evaluation rigor, deployment reliability, and ongoing observability reflects the full lifecycle that many SaaS companies are now formalizing as LLM Ops. Experience gained in latency, cost, and quality tradeoffs tends to transfer well to other cloud products introducing AI-assisted workflows.
This role suits engineers who prefer applied research tempered by measurable outcomes, and who enjoy collaborating across product, data, and infrastructure boundaries. It aligns with professionals ready to operate with autonomy in ambiguous problem spaces while still grounding decisions in testing, monitoring, and incremental delivery.
The section above is editorial commentary from The SaaS Jobs, provided to help SaaS professionals understand the role in a broader industry context.
Job Description
Senior Machine Learning Engineer II
Sumo Logic is a cloud-native SaaS data analytics platform that solves complex observability and security problems. Customers choose our product because it allows them to easily monitor, optimize, and secure their applications, systems, and infrastructures. Our microservices architecture, hosted on AWS, ingests petabytes of data daily across multiple geographic regions. Millions of queries a day analyze hundreds of petabytes of data.
What can you expect to do?
As a Machine Learning Engineer, you’ll build the intelligence behind the next generation of agentic AI systems and related AI systems that reason over massive, heterogeneous log data. You’ll combine machine learning, prompt engineering, and rigorous evaluation to create autonomous AI agents that help organizations understand and act on their data in real time.
You’ll be part of a small, high-impact team shaping how AI agents understand complex machine data. This is an opportunity to work on cutting-edge LLM infrastructure and contribute to defining best practices in context engineering and AI observability.
Responsibilities
- Design, implement, and optimize agentic AI components, including context engineering, memory management, and prompts.
- Develop and maintain golden datasets by defining sourcing strategies, working with data vendors, and ensuring quality and representativeness at scale.
- Prototype and evaluate novel prompting strategies and reasoning chains for model reliability and interpretability.
- Collaborate cross-functionally with product, data, and infrastructure teams to deliver end-to-end AI-powered insights.
- Operate autonomously in a fast-paced, ambiguous environment - defining scope, setting milestones, and driving outcomes.
- Ensure reliability, performance, and observability of deployed agents through rigorous testing and continuous improvement.
- Maintain a strong bias for action—delivering incremental, well-tested improvements that directly enhance customer experience.
Required Qualifications
- B.Tech, M.Tech, or Ph.D. in Computer Science, Data Science, or a related field.
- 4-6 years of hands-on industry experience with demonstrable ownership and delivery.
- Strong understanding of machine learning fundamentals, data pipelines, and model evaluation.
- Proficiency in Python and ML/data libraries (NumPy, pandas, scikit-learn); familiarity with JVM languages is a plus.
- Working knowledge of LLM core concepts, prompt design, and agentic design patterns.
- Prior experience building and deploying AI agents or LLM applications in production.
- Familiarity with modern agentic AI frameworks (e.g., LangGraph, LangChain, CrewAI).
- Experience with ML infrastructure and tooling (PyTorch, MLflow, Airflow, Docker, AWS).
- Exposure to LLM Ops - infrastructure optimization, observability, latency, and cost monitoring.
- Strong communication skills and a passion for shaping emerging AI paradigms.
Desired Qualifications:
- Authored research/white papers and published in conferences.
- Mentored junior engineers in guiding ML applications
About Us
Sumo Logic, Inc. helps make the digital world secure, fast, and reliable by unifying critical security and operational data through its Intelligent Operations Platform. Built to address the increasing complexity of modern cybersecurity and cloud operations challenges, we empower digital teams to move from reaction to readiness—combining agentic AI-powered SIEM and log analytics into a single platform to detect, investigate, and resolve modern challenges. Customers around the world rely on Sumo Logic for trusted insights to protect against security threats, ensure reliability, and gain powerful insights into their digital environments. For more information, visit www.sumologic.com.
Sumo Logic Privacy Policy. Employees will be responsible for complying with applicable federal privacy laws and regulations, as well as organizational policies related to data protection.
The expected annual base salary range for this position is $148,000 - $173,200. Compensation may vary based on a variety of factors, which include (but aren’t limited to) role level, skills and competencies, qualifications, knowledge, location, and experience. In addition to base pay, certain roles are eligible to participate in our bonus or commission plans, as well as our benefits offerings and equity awards.
Must be authorized to work in the United States at the time of hire and for the duration of employment. At this time, we are not able to offer new non-immigrant visa sponsorship for this position.
