Remote

Senior Product Engineer (Backend)

Berlin, Germany
,
Barcelona, Spain
,
Remote
,
Permanent employee
Full-time
TL;DR

We’re hiring a Senior Backend Engineer to build and scale the infrastructure behind the deepset AI Platform, our enterprise-grade product for LLM-powered applications. You’ll own features end to end, develop systems to process millions of documents and 100s of user requests per second, and contribute directly to both our SaaS platform and the open-source Haystack framework. Ideal for someone who thrives in fast-paced, high-impact environments and wants to shape real-world AI adoption through clean, scalable backend systems.

Why deepset

At deepset, we’re on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We’re remote-first, flexible, and built on a culture of trust and ownership. You’ll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.

What you will do
  • Design and build a scalable AI platform that helps users solve real business problems with LLMs
  • Develop infrastructure to support thousands of LLM applications, processing millions of documents and handling 100s of user requests per second
  • Own backend features end to end—from architecture and CI/CD to testing, monitoring, and customer feedback
  • Collaborate with the Open Source team to improve and contribute to Haystack
  • Partner with the infrastructure team on performance, observability, and debugging
  • Help resolve high-priority production issues with customer-facing impact
  • Improve reliability by maintaining strong debugging tools and processes
  • Mentor other engineers and support their technical growth
What you bring to the team
  • 5+ years of backend development experience, ideally in Python
  • Strong knowledge of REST APIs, SQL databases, CI/CD, Kubernetes, and cloud services
  • Experience with Infrastructure-as-Code tools (e.g., Terraform or Crossplane)
  • Proven ability to write clean, testable, observable, and maintainable code
  • Skilled at fast troubleshooting in high-pressure, cross-functional settings
  • Comfortable dealing with customer-facing production issues
  • Proactive, collaborative, and aligned with team-wide decisions
Nice to have
  • Experience in early-stage or high-growth startups
  • Familiarity with open-source development
  • Background in NLP, machine learning, or LLM technologies
  • Exposure to building or scaling B2B SaaS products
Benefits
  • Remote-first setup with flexible hours & tech of your choice
  • 30 days vacation + extra days for family sick leave
  • Competitive salary & stock options for every team member
  • Monthly sports & mental health support allowance with Oliva
  • Annual learning & development budget
  • Monthly team socials & in-person meetups
  • Dog-friendly Berlin HQ

About us

Founded in 2018, deepset builds open and enterprise-grade tools that help teams turn language into action. From Haystack, our open-source framework, to the deepset AI Platform, we give developers and organizations the building blocks to solve real problems with LLMs. Backed by GV and Balderton, we’re trusted by startups and global enterprises alike.

Visit us to learn more: Website | GitHub | Linkedin | X (Twitter)

About us

Our mission is to build technology that transforms how enterprises harness generative AI, making custom AI solutions accessible to any organization. We transform complex LLM development into intuitive building blocks, helping teams solve mission-critical business challenges while maintaining full control of their AI systems.

Apply now

Name*
Email*
Phone*
Location*
Pronouns
Earliest Start Date*
Current Time Zone*
Are you willing to relocate? Please specify.*
Github
LinkedIn*
Twitter
Are you part of the deepset or Haystack community (GitHub, Slack,...)?
How did you become aware of this open position?*
Do you have previous experience with open source? If so, please share more details:*
Additional: Do you consent deepset to keep your personal data for future opportunities?*
Expected salary*
Documents
Please upload your CV as well as a brief cover letter (in total max. 20 MB).
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form. Please try again or get in contact with us.