Software Engineer, AI Gateway

Kong · Milan, Italy · Posted Oct 23, 2026


Transparency

Stale

Online for 4 weeks and never reposted. The first wave of applicants is in, so a reply is less likely. Apply if it's a strong fit.

First seen
Oct 24, 2026
Offered for
28 days

Overview

Category
Software engineering
Employment type
Permanent
Workplace type
Hybrid
Country
Italy
Seniority
Mid level
Schedule
Full time
Salary
63750–78750 EUR / 1 YEAR; EquityPercentage; Bonus

From the posting

Are you ready to unlock intelligence?

If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.

The Mission

You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation. As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more.

What You’ll Do

  • Partake in the entire lifecycle of core AI Gateway features, from design to production rollout.

  • Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua.

  • Implement gateway features such as multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic.

  • Design integrations with LLM providers and AI platforms, filling the gaps between Kong and third-party deployment platforms and tooling.

  • Troubleshoot production issues in the hot path.

  • Work with product management and other engineering teams to turn customer requirements into reliable, documented product features.

What You’ll Bring

The Toolkit

  • 3+ years of programming in server-side applications and components, in a language such as Rust or Go.

  • Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.

  • Knowledge of networking fundamentals and protocols on both L4 and L7 (TCP/IP, HTTP/2, gRPC).

  • Familiarity with cutting-edge AI models concepts, agentic AI protocols, and AI applications development.

  • Solid hands-on expertise in Linux systems.

The Kong DNA

  • Ownership: You have a strong sense of ownership, including the documentation: engineers at Kong write the documentation for their products.

  • Collaboration: You have excellent verbal and written communication skills and are comfortable working with a remotely distributed team.

Bonus Points

  • Proficiency with Lua.

  • Hands-on experience with NGINX and OpenResty.

  • Familiarity with cloud-native environments (Kubernetes, Docker, AWS/GCP/Azure).

#LI-EA1

About Kong:

Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com.

More jobs at Kong

Senior Director, Solutions Engineering

Kong · 2 days ago | United States | EquityPercentage; 330000–400000 USD / 1 YEAR; Commission | Remote · Director · Full time

Create CV

Staff Solutions Engineer

Kong · 2 days ago | New York, United States, France, London, England, United Kingdom +6 | On-site · Staff · Full time

Create CV

Director Partner Programs & Operations Manager

Kong · 3 days ago | California, United States, Washington, United States, Texas, United States +2 | 150000–220000 USD / 1 YEAR; EquityPercentage; Bonus | Remote · Director · Full time

Create CV

Regional Sales Director, Financials

Kong · 3 days ago | Illinois, United States | $154K–$220K / year | Remote · Director · Full time

Create CV

Regional Sales Director, ISV

Kong · 3 days ago | California, United States | $154K–$220K / year | Hybrid · Director · Full time

Create CV
See all 95 jobs at Kong