AI Researcher — Inference Optimization

Featherless AI · Remote (world) · Posted Jan 23, 2026


Transparency

Dead

Online for 43 weeks and never reposted. Jobs this old or reposted this often rarely lead to a hire. It may be filled already.

First seen
Oct 10, 2026
Offered for
301 days

Overview

Category
AI & machine learning
Employment type
Permanent
Workplace type
Remote
Country
United States
Seniority
Senior
Schedule
Full time

Key skills

Inference optimization
Design and implement techniques to reduce latency and improve throughput of large models.
Model quantization and pruning
Apply quantization, pruning, and KV‑cache compression to make models more efficient.
Systems-level inference engineering
Build dynamic batching, kernel fusion, and multi‑GPU pipelines for production.
Benchmarking and experimental design
Create reproducible benchmarks across accelerators and analyze results.
Production deployment of inference pipelines
Integrate research improvements into scalable, reliable inference services.

Key phrases

  • inference optimization
  • large neural networks
  • latency, throughput, memory efficiency
  • quantization
  • pruning
  • KV-cache optimization
  • dynamic batching
  • kernel fusion
  • multi-GPU inference
  • Triton
  • TensorRT
  • vLLM
  • ONNX Runtime
  • distributed and multi-GPU inference

From the posting

Role Overview

We are seeking an AI Researcher with deep experience in inference optimization to design, evaluate, and deploy high-performance inference systems for large-scale machine learning models. You will work at the intersection of model architecture, systems engineering, and hardware-aware optimization, improving latency, throughput, and cost efficiency across real-world production environments.

Key Responsibilities

  • Research and develop techniques to optimize inference performance for large neural networks.

  • Improve latency, throughput, memory efficiency, and cost per inference.

  • Design and evaluate model-level optimizations (quantization, pruning, KV-cache optimization, architecture-aware simplifications).

  • Implement systems-level optimizations (dynamic batching, kernel fusion, multi-GPU inference, prefill vs decode optimization).

  • Benchmark inference workloads across hardware accelerators.

  • Collaborate with engineering teams to deploy optimized inference pipelines.

  • Translate research insights into production-ready improvements.

Required Qualifications

  • Strong background in machine learning, deep learning, or AI systems.

  • Hands-on experience optimizing inference for large-scale models.

  • Proficiency in Python and modern ML frameworks (e.g., PyTorch).

  • Experience with inference tooling (e.g., Triton, TensorRT, vLLM, ONNX Runtime).

  • Ability to design experiments and communicate results clearly.

Preferred / Nice-to-Have Qualifications

  • Experience deploying production inference systems at scale.

  • Familiarity with distributed and multi-GPU inference.

  • Experience contributing to open-source ML or inference frameworks.

  • Authorship or co-authorship of peer-reviewed research papers in machine learning, systems, or related fields.

  • Experience working close to hardware (CUDA, ROCm, profiling tools).

What Success Looks Like

  • Measurable gains in latency, throughput, and cost efficiency.

  • Optimized inference systems running reliably in production.

  • Research ideas successfully translated into deployable systems.

  • Clear benchmarks and documentation that inform product decisions.

Relevant Research Areas (Bonus)

  • Long-context inference optimization

  • Speculative decoding

  • KV-cache compression and paging

  • Efficient decoding strategies

  • Hardware-aware inference design

More jobs at Featherless AI

Founding Sales Engineer

Featherless AI · Last month | Remote (US & Canada), Atlanta, Tampa +23 | 150000–190000 USD / 1 YEAR | Remote · Mid level · Full time

Create CV

Founding Business Development Rep (AI Cloud US/CA)

Featherless AI · 2 months ago | Remote (US & Canada), Atlanta, Los Angeles +26 | Remote · Junior · Full time

Create CV

Founding Account Executive (AI Cloud)

Featherless AI · 2 months ago | Remote (US & Canada), Atlanta, Los Angeles +17 | $180K–$240K / year | Remote · Mid level · Full time

Create CV

Customer Experience & Community Relations

Featherless AI · 2 months ago | Australia | A$85K–A$103K / year | Remote · Junior · Full time

Create CV

Chief of Staff

Featherless AI · 3 months ago | San Francisco Office, Remote (US & Canada) | Hybrid · Executive · Full time

Create CV
See all 17 jobs at Featherless AI