TL;DR
We’re hiring a Senior Backend Engineer to build and scale the infrastructure behind the deepset AI Platform, our enterprise-grade product for LLM-powered applications. You’ll own features end to end, develop systems to process millions of documents and 100s of user requests per second, and contribute directly to both our SaaS platform and the open-source Haystack framework. Ideal for someone who thrives in fast-paced, high-impact environments and wants to shape real-world AI adoption through clean, scalable backend systems.
Why deepset
At deepset, we’re on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We’re remote-first, flexible, and built on a culture of trust and ownership. You’ll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.
What you will do
- Design and build a scalable AI platform that helps users solve real business problems with LLMs
- Develop infrastructure to support thousands of LLM applications, processing millions of documents and handling 100s of user requests per second
- Own backend features end to end—from architecture and CI/CD to testing, monitoring, and customer feedback
- Collaborate with the Open Source team to improve and contribute to Haystack
- Partner with the infrastructure team on performance, observability, and debugging
- Help resolve high-priority production issues with customer-facing impact
- Improve reliability by maintaining strong debugging tools and processes
- Mentor other engineers and support their technical growth
What you bring to the team
- 5+ years of backend development experience, ideally in Python
- Strong knowledge of REST APIs, SQL databases, CI/CD, Kubernetes, and cloud services
- Experience with Infrastructure-as-Code tools (e.g., Terraform or Crossplane)
- Proven ability to write clean, testable, observable, and maintainable code
- Skilled at fast troubleshooting in high-pressure, cross-functional settings
- Comfortable dealing with customer-facing production issues
- Proactive, collaborative, and aligned with team-wide decisions
Nice to have
- Experience in early-stage or high-growth startups
- Familiarity with open-source development
- Background in NLP, machine learning, or LLM technologies
- Exposure to building or scaling B2B SaaS products
Benefits
- Remote-first setup with flexible hours & tech of your choice
- 30 days vacation + extra days for family sick leave
- Competitive salary & stock options for every team member
- Monthly sports & mental health support allowance with Oliva
- Annual learning & development budget
- Monthly team socials & in-person meetups
- Dog-friendly Berlin HQ
About us
Founded in 2018, deepset builds open and enterprise-grade tools that help teams turn language into action. From Haystack, our open-source framework, to the deepset AI Platform, we give developers and organizations the building blocks to solve real problems with LLMs. Backed by GV and Balderton, we’re trusted by startups and global enterprises alike.
Visit us to learn more: Website | GitHub | Linkedin | X (Twitter)