Member of Technical Staff - Research Infrastructure Engineer

Black Forest Labs · Freiburg (Germany) · Posted Sep 18, 2025


Transparency

Dead

Online for 61 weeks and never reposted. Jobs this old or reposted this often rarely lead to a hire. It may be filled already.

First seen
Oct 6, 2026
Offered for
428 days

Overview

Category
IT & infrastructure
Employment type
Permanent
Workplace type
On-site
Country
Germany
Seniority
Staff
Schedule
Full time
Salary
EU: €100,000–€230,000 / year, plus equity US: $150,000–$300,000 / year, plus equity

Key skills

Large‑scale training platform engineering
Design, build, and operate GPU clusters for multi‑week model training.
Kubernetes orchestration
Deploy and manage workloads and operators across cloud and datacenter fleets.
Cloud infrastructure as code
Provision and maintain environments on AWS and GCP using IaC practices.
Distributed systems performance debugging
Identify and resolve bottlenecks and capacity hotspots in large fleets.
Telemetry and monitoring
Implement visibility with OTel and Prometheus for performance and cost metrics.
Scripting and automation
Write production scripts in Python, Bash, and Go for reliability tasks.

Key phrases

  • large-scale training platforms
  • large scale compute clusters (GPUs)
  • Kubernetes
  • Nvidia GPU drivers
  • OTel
  • Prometheus
  • SLURM
  • AWS
  • GCP
  • distributed systems at scale
  • infrastructure reliability
  • capacity hotspots
  • incident response
  • performance bottlenecks

From the posting

About Black Forest Labs

We’re the team building the foundational layer for visual intelligence: multimodal models trained jointly on images, video, audio, and action to see, generate, and understand the world.

Our founding team pioneered latent diffusion and Stable Diffusion, the breakthroughs that made generative AI accessible to millions. With FLUX, we're pushing into generative media at scale, machines that act in the physical world, and emerging applications in computer use.

Our FLUX models top public benchmarks and run in production in some of the world's biggest platforms. We're a small, fast growing research lab competing with the largest companies in the world. From our labs in Freiburg to San Francisco, we're building what comes next.

Why This Role

We're looking for engineers to build and maintain the engine that powers our mission to develop visual intelligence. From maintaining and scaling clusters, to building research platforms to accelerate the rate of innovation, this team operates with large breadth and depth. We build the systems to make multi-week/month long training possible, to orchestrate resources at scale, and at the same time efficiently, enabling the next breakthrough model. If you’re obsessed with distributed systems at scale, infrastructure reliability, scalability, security, and continuous improvement, this team would be perfect for you.

What You’ll Work On

  • Maintain research infrastructure, ensuring health, and optimizing components to extract peak performance from the system (both on application, and infrastructure side)

  • Scale infrastructure to meet growing research demands while maintaining reliability and performance

  • Collaborate with research teams to deeply understand their infrastructure needs, and design solutions that balance performance with cost efficiency.

  • Identify and resolve performance bottlenecks and capacity hotspots through deep analysis of distributed systems at scale.

  • Build and evolve telemetry and monitoring systems to provide deep visibility into infrastructure performance, utilization, and costs across our cloud and datacenter fleets.

  • Participate in on-call rotations and incident response to maintain system reliability

Technical Focus

  • Python, Bash, Go

  • Kubernetes

  • Nvidia GPU drivers, and operators

  • OTel, Prometheus

What We’re Looking For

  • Experience building or operating large-scale training platforms

  • Worked with large scale compute clusters (GPUs)

  • Proven ability to debug performance and reliability issues across large distributed fleets

  • Strong problem-solving skills and ability to work independently

  • Strong communication skills and the ability to work effectively with both internal and external partners

  • Deep knowledge of modern cloud infrastructure including Kubernetes, Infrastructure as Code, AWS, and GCP

  • Experience with SLURM

  • Experience building or operating large-scale training platforms

How We Work Together

We’re a distributed team with real offices that people actually use. You’ll be based in Europe or the US and work from your home location, with one week each month spent with us in Freiburg or San Francisco to stay connected with the team.

Everything we do is grounded in four values:

  • Obsessed. We are a frontier research lab. The science has to be right, the understanding deep, the product beautiful.

  • Low Ego. The work speaks. The best idea wins, no matter who said it. Credit is shared. Nobody is above any task.

  • Bold. We take the ambitious bet. We ship, we do not wait for conditions to be perfect.

  • Kind. People over politics. We treat each other with genuine warmth. Agency without empathy creates chaos.

If this sounds like work you’d enjoy, we’d love to hear from you.

Base Annual Salary:

EU €100,000 - €230,000 + Equity

US $150,000 - $300,000 + Equity

This role is based in our Freiburg / San Francisco office. We operate a hybrid model and cover reasonable travel costs — relocation is encouraged but not required. We do expect a meaningful in-person presence, and we'll discuss what that looks like for your situation during the process.

Note: We may use AI-assisted tools to help organize applications. All hiring decisions are always made by our team.

More jobs at Black Forest Labs

Research Lead, Evaluations

Black Forest Labs · 2 days ago | Freiburg (Germany) | On-site · Lead · Full time

Create CV

Machine Learning Engineer - AI Safety

Black Forest Labs · 4 days ago | San Francisco (United States) | On-site · Staff · Full time

Create CV

Member of Technical Staff - Infrastructure Security

Black Forest Labs · 4 days ago | Remote, San Francisco (United States), Freiburg (Germany) | $220K–$280K / year | Remote · Staff · Full time

Create CV

Member of Technical Staff - Workforce Security

Black Forest Labs · 4 days ago | Remote, San Francisco (United States), Freiburg (Germany) | $180K–$225K / year | Remote · Staff · Full time

Create CV

Privacy & Product Counsel

Black Forest Labs · 2 weeks ago | Freiburg (Germany), Berlin (Germany), San Francisco (United States) +3 | Remote · Senior · Full time

Create CV
See all 17 jobs at Black Forest Labs