Why This Job is Featured on The SaaS Jobs
This role sits at a key intersection of modern SaaS and AI infrastructure: building the data layer that enables large-scale model training and evaluation. In the current SaaS ecosystem, where AI capabilities are increasingly delivered as developer-facing platforms, ownership of storage, throughput, and dataset performance becomes a product differentiator rather than a back-office concern.
For a SaaS career, the long-term value is in developing repeatable infrastructure judgment under real constraints: cost, latency, reliability, and rapid iteration cycles. Experience spanning object stores and POSIX backends, distributed processing frameworks, and Kubernetes storage primitives maps directly to how many SaaS companies operationalise data-intensive workloads. The collaboration surface with modeling and research functions also builds fluency in translating platform needs into measurable infrastructure outcomes.
This position is best suited to engineers who prefer deep systems work and enjoy making ambiguous performance problems tractable. It will fit someone who likes being close to internal platform customers, is comfortable balancing build versus buy decisions, and wants to specialise in data infrastructure that underpins production-grade AI services.
The section above is editorial commentary from The SaaS Jobs, provided to help SaaS professionals understand the role in a broader industry context.
Job Description
Who are we?
Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what’s best for our customers.
Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.
Join us on our mission and shape the future!
Why this role?
We're building the data infrastructure behind some of the most demanding AI training workloads in the world, and we want sharp, curious people to help us do it. In this role, you'll build and maintain the high-performance data layer our Modeling teams rely on for training and evaluation jobs.
As a Software Engineer, Data Infrastructure, you will:
Work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it.
Collaborate daily with researchers and engineers who are some of the best in the world at what they do.
You may be a good fit if you have:
4+ years of experience working on data storage infrastructure
Strong command of Python
Kubernetes experience, especially on the storage side (Persistent Volumes, CSI drivers, etc.)
The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX
Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink
[Nice-to-have] Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt
Genuine excitement about AI. You follow the research, have opinions, and enjoy being in the weeds
Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimize what already exists
If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!
We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.
Full-Time Employees at Cohere enjoy these Perks:
🤝 An open and inclusive culture and work environment
🧑💻 Work closely with a team on the cutting edge of AI research
🍽 Weekly lunch stipend, in-office lunches & snacks
🦷 Full health and dental benefits, including a separate budget to take care of your mental health
🐣 100% Parental Leave top-up for up to 6 months
🎨 Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
🏙 Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
✈️ 6 weeks of vacation (30 working days!)
