Why This Job is Featured on The SaaS Jobs
This Senior or Staff Software Engineer role sits at the intersection of modern SaaS data platforms and production machine learning, where “inference” becomes a customer facing capability rather than an internal tool. Snowflake’s focus on bringing ML and LLM workloads natively into its platform reflects a broader shift in SaaS toward integrated AI features that must meet enterprise expectations for governance, security, and predictable performance.
From a SaaS career perspective, the work maps closely to challenges that recur across platform companies: building shared infrastructure that many product teams and customers depend on, translating research advances into reliable services, and operating systems with clear availability and latency commitments. Experience shaping roadmaps with architects and product partners also develops the cross-functional influence that platform engineers often need as organizations standardize ML tooling.
This position tends to fit engineers who enjoy deep systems work and can balance model serving concerns with distributed systems realities. It also suits those comfortable making technical tradeoffs in areas like inference engines, orchestration, and cost-performance tuning, while keeping an eye on how platform primitives will be consumed by internal teams and end users.
The section above is editorial commentary from The SaaS Jobs, provided to help SaaS professionals understand the role in a broader industry context.
Job Description
Snowflake is about empowering enterprises to achieve their full potential — and people too. With a culture that’s all in on impact, innovation, and collaboration, Snowflake is the sweet spot for building big, moving fast, and taking technology — and careers — to the next level.
Build the future of data. Join the Snowflake team.
The Snowflake Machine Learning Platform team’s mission is to enable customers to bring their machine learning and deep learning workloads to Snowflake. Our customers want to build powerful models with the ever-increasing data in Snowflake but face several challenges including infrastructure optimizations, orchestration, performance, and security. The team aims to solve these challenges by building highly integrated platform solutions that are simple, secure, and enable end-to-end ML workflows. We are on an early journey to build the most scalable machine learning and data platform without sacrificing the benefits of a single platform and governance.
We are looking for outstanding technical leaders who will join our ML Platform team to build the next-generation platform and play a pivotal role in this journey by understanding Snowflake’s core platform architecture and evolving it to enable state-of-the-art machine learning and LLM workloads. Join us to define strategies, set technical directions, design and execute, engage and deliver innovation, and unlock the power of AI for thousands of enterprise customers. This position is based in Menlo Park, CA, and Bellevue, WA
RESPONSIBILITIES:
Help define and own the roadmap, working collaboratively and proactively with senior architects, PMs, and team leadership. The initiatives include platforms and tools that enable customers to do state-of-the-art machine learning on Snowflake natively.
Collaboratively build and execute a vision for incorporating new advances in machine learning in ways that best achieve the team’s business objectives.
Ensure operational excellence of the services and meet the commitments to our customers regarding reliability, availability, and performance.
Collaborate across other ML partner teams to continuously improve ML development velocity and capabilities at Snowflake.
Support team members in delivering a high level of technical quality.
IDEAL REQUIREMENTS & QUALIFICATIONS:
Have 7+ years of industry experience designing, building, and supporting Internet serving infrastructure, machine learning platforms, machine learning services, and frameworks.
Strong track record of working with machine learning systems and/or platforms.
Experience in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and knowing tradeoffs between them.
Experience serving fine-tuned LLMs (PEFT, DPO, RL).
Experience with several of the following frameworks: SKLearn, XGBoost, PyTorch, Tensorflow, MLflow is a plus.
Previous experience in building batch and real-time ML serving systems preferred.
Have built a roadmap and vision around machine learning teams, and led technical decision making with help of architects and PMs and team.
BS/MS/PhD in Computer Science or related majors, or equivalent experience
Snowflake employee is expected to follow the company’s confidentiality and security standards for handling sensitive data. Snowflake employees must abide by the company’s data security plan as an essential part of their duties. It is every employee's duty to keep customer information secure and confidential.
Snowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.
How do you want to make your impact?
For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com