Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity · San Francisco, Remote (United States), Toronto +2 · Posted Oct 28, 2026


Transparency

Stale

Online for 3 weeks and never reposted. The first wave of applicants is in, so a reply is less likely. Apply if it's a strong fit.

First seen
Oct 28, 2026
Offered for
23 days

Overview

Category
Software engineering
Employment type
Permanent
Workplace type
Remote
Country
United States
Seniority
Staff
Schedule
Full time
Salary
250000–485000 USD / 1 YEAR; Commission

Key skills

Kubernetes GPU orchestration
Write custom operators and CRDs and manage many multi-provider GPU clusters so the platform behaves identically everywhere.
GPU fleet operations
Own provisioning, lifecycle, reliability and capacity integration of GPU compute across several cloud providers.
GPU scheduling and placement
Build scheduling logic that finds scarce capacity across providers, packs it efficiently and matches workloads to hardware.
Distributed training and inference
Keep long-running training jobs healthy while guaranteeing availability and latency of production inference services on one fleet.
Self-serve compute platform
Design systems that let engineers launch training jobs and run inference services without managing infrastructure details.
Fault tolerance and autoscaling
Build failover, autoscaling and observability so workloads survive node loss, provider issues and capacity shifts unattended.

Key phrases

  • Kubernetes
  • GPU clusters
  • CUDA
  • InfiniBand
  • RoCE
  • distributed systems
  • scheduling
  • resource allocation
  • fault tolerance
  • custom operators
  • CRDs
  • multi-cluster federation
  • CoreWeave
  • inference
  • training jobs

From the posting

Perplexity serves hundreds of millions of queries a month, and every one of them fans out into multiple AI inference requests running in real time. Behind that sits a large GPU fleet spread across several cloud providers. Today, our inference engineers and researchers build models while also managing networking, securing capacity, and operating the underlying GPU clusters, responsibilities we want a dedicated platform team to own. Your job is to take ownership of that infrastructure and hide its complexity behind a unified, self-serve platform for running training and inference workloads.

Responsibilities

  • Build a self-serve compute platform. Design and own the systems that let inference engineers and researchers launch training jobs and operate inference services without managing GPU provisioning, cluster configuration, or provider-specific infrastructure.

  • Operate the GPU fleet. Own provisioning, lifecycle management, reliability, and capacity integration across providers, giving teams a consistent way to use compute regardless of where it runs.

  • Solve for GPU scarcity. Build the scheduling and placement logic that finds available capacity across providers, packs it efficiently, and gets the right workload onto the right hardware under real constraints.

  • Support two very different workloads. Keep long-running distributed training jobs healthy while simultaneously guaranteeing the availability and latency of production inference services on the same fleet.

  • Own the Kubernetes for GPU orchestration. Write the operators and CRDs, and manage many clusters across providers so the platform behaves the same everywhere we run.

  • Make failure boring. Build the fault tolerance, autoscaling, and observability that keep the fleet utilized and let workloads survive node loss, provider hiccups, and capacity shifts without human intervention.

  • Set technical direction across teams. Partner with inference and cloud infrastructure engineers to turn operational constraints into a coherent platform architecture and roadmap.

Qualifications

We expect you to have real depth in most of these:

  • Deep Kubernetes experience — custom operators, CRDs, and multi-cluster federation, not just running kubectl apply.

  • You've managed GPU clusters at scale: NVIDIA hardware, CUDA, and the networking that makes them fast (InfiniBand or RoCE).

  • You've orchestrated compute across multiple clouds (CoreWeave, AWS, GCP, or similar) and understand how different each one really is.

  • Strong distributed systems fundamentals: scheduling, resource allocation, and fault tolerance under load.

  • You write infrastructure and systems-level code in Go, Rust or C++.

  • You've supported both long-running training jobs and high-availability inference services, and you know why they pull infrastructure in opposite directions.

  • You own problems end-to-end and do well when the path forward isn't laid out for you.

Additional experience we value

  • Inference serving stacks: vLLM, SGLang, or TensorRT-LLM.

  • Slurm or other HPC schedulers.

  • GPU kernel work in CUDA or Triton — not required, but notable.

  • High-speed interconnects: InfiniBand, RoCE, or RDMA in production.

  • Observability for ML workloads: Prometheus, Grafana, or Weights & Biases.

More jobs at Perplexity

Member of Technical Staff (Index Engineer, Search Crawler)

Perplexity · 2 days ago | London, Belgrade, Ireland | Remote · Staff · Full time

Create CV

Enterprise Account Executive, Financial Services

Perplexity · 2 days ago | San Francisco | $240K–$400K / year | On-site · Senior · Full time

Create CV

Enterprise Account Executive, Legal

Perplexity · 2 days ago | San Francisco, Austin, New York City | $240K–$400K / year | Hybrid · Senior · Full time

Create CV

Enterprise Account Manager

Perplexity · 2 days ago | San Francisco, Austin, New York City | $240K–$400K / year | Hybrid · Senior · Full time

Create CV

Strategic Sourcing Lead

Perplexity · 3 days ago | San Francisco | 190000–240000 USD / 1 YEAR; EquityPercentage | Hybrid · Lead · Full time

Create CV
See all 145 jobs at Perplexity