Senior AI/LLM Platform Engineer

Avenga · Sofia · Posted Nov 4, 2026


Transparency

Stale

Online for 2 weeks and never reposted. The first wave of applicants is in, so a reply is less likely. Apply if it's a strong fit.

First seen
Nov 5, 2026
Offered for
16 days

Overview

Category
AI & machine learning
Employment type
Permanent
Workplace type
Hybrid
Country
Bulgaria
Seniority
Senior
Schedule
Full time
Salary
Not listed

Key skills

Deploy and serve open-weight LLMs
Build and run APIs to host models like Llama, Qwen, Mistral, or Gemma using inference engines.
Inference optimization
Apply quantization, batching and multi‑GPU techniques to maximize throughput and reduce latency.
GPU infrastructure and Kubernetes scheduling
Manage NVIDIA drivers, CUDA and schedule GPU workloads on Kubernetes clusters.
Infrastructure as code
Provision on‑premise and cloud environments with Docker, Kubernetes and Terraform/OpenTofu.
AI coding tool usage
Utilize modern AI assistants such as Claude Code, Codex, Cursor or GitHub Copilot in development.
LLM platform administration
Handle upgrades, capacity planning, access control, quotas and maintain the model catalog.

Key phrases

  • open-weight models
  • Llama
  • Qwen
  • Mistral
  • Gemma
  • vLLM
  • SGLang
  • Ollama/llama.cpp
  • quantization
  • batching
  • multi-GPU deployment
  • NVIDIA drivers and CUDA
  • GPU scheduling on Kubernetes
  • Terraform/OpenTofu
  • LiteLLM

From the posting

Avenga is an international engineering firm helping businesses operate with AI at the core. With 6,000+ experts worldwide, we combine engineering expertise with AI-native thinking to turn ambitious ideas into real-world impact across industries, technologies, and markets.

At the core of the role

We’re looking for an experienced platform engineer to build and run the environments where our AI runs. You will set up on-premise and cloud LLM platforms, deploy and serve open-weight models, optimize them to run efficiently on GPUs, and administer the platform as it grows.

Your platform will power AI-native engineering and business use cases across client projects. You will work hands-on with GPU infrastructure and modern inference stacks, with room to explore new models, inference engines and hardware as the field evolves.



Core skills you’ll bring

  • 5+ years of experience in platform engineering, DevOps, infrastructure, or ML infrastructure.

  • Hands-on experience deploying and serving open-weight models (e.g. Llama, Qwen, Mistral, Gemma) with inference engines such as vLLM, SGLang, Ollama/llama.cpp.

  • Practical knowledge of inference optimization, such as quantization, batching and multi-GPU deployment, and matching models to available hardware.

  • Experience with GPU infrastructure - NVIDIA drivers and CUDA, GPU scheduling on Kubernetes, and monitoring GPU utilization.

  • Experience with on-premise infrastructure and at least one cloud provider (AWS, GCP or Azure), including their GPU and AI services.

  • Strong Docker and Kubernetes skills and infrastructure as code (Terraform/OpenTofu).

  • Hands-on experience with at least one modern AI coding tool, such as Claude Code, Codex, Cursor or GitHub Copilot.

  • Fluent English.

Nice-to-have

  • LLM gateways and routing (e.g. LiteLLM) and LLM observability.

The impact you'll create

  • Design and build on-premise and cloud environments for hosting LLMs.

  • Deploy, serve and scale open-weight models behind standard APIs (e.g. OpenAI-compatible endpoints).

  • Optimize models and serving configuration for throughput, latency and GPU cost, and benchmark the results.

  • Administer the platform: upgrades, capacity planning, access control, quotas and the model catalog.

  • Monitor performance, GPU utilization, usage and cost.

  • Evaluate new models, inference engines and hardware, and recommend what to adopt.

  • Secure the environment, including isolating client data and controlling access.

  • Support engineering teams and AI agents that use the platform.

 What supports your journey

Guided by our values, we aim to provide you with the tools, autonomy, trust, and support you need to excel. Our benefits include private health insurance, well-being programs, flexible and hybrid work arrangements, laptops and equipment, training opportunities, social events, great offices, and more.

People are at the core of Avenga. We provide equal opportunities regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to a respectful environment where everyone can be themselves, share their ideas, and feel that they belong.

More jobs at Avenga

Senior Test Manager

Avenga · 2 days ago | Prague, Ostrava, Brno | Hybrid · Manager · Full time

Create CV

Full-Stack GenAI / AI Engineer

Avenga · 2 days ago | North Macedonia | On-site · Senior · Full time

Create CV

Microsoft 365 & Intune Administrator

Avenga · 2 days ago | Banja Luka, Bitola, Belgrade +6 | Hybrid · Mid level · Full time

Create CV

Senior Backend Engineer(Ruby on Rails / Go)

Avenga · 2 days ago | Banja Luka, Belgrade, Bitola +12 | On-site · Senior · Full time

Create CV

Junior .Net Engineer

Avenga · 3 days ago | Sofia | Hybrid · Junior · Full time

Create CV
See all 70 jobs at Avenga