Production Support Engineer - LLM Platform

Qube Research & Technologies · New York, Chicago, Chicago, NYC · Posted Nov 4, 2026


Transparency

Stale

Online for 2 weeks and never reposted. The first wave of applicants is in, so a reply is less likely. Apply if it's a strong fit.

First seen
Nov 5, 2026
Offered for
16 days

Overview

Category
IT & infrastructure
Employment type
Permanent
Workplace type
On-site
Country
United States
Seniority
Mid level
Schedule
Full time
Salary
Not listed

Key skills

Production Support
Provide first‑ and second‑line incident resolution for the LLM platform following established procedures.
API Troubleshooting
Diagnose HTTP errors, authentication, rate limiting, timeouts and streaming issues in API‑driven services.
Monitoring and Log Analysis
Use dashboards, metrics, logs and tools to detect latency, error‑rate and availability problems.
Scripting Automation
Write Python, Bash or PowerShell scripts for operational checks, log parsing and support utilities.
SQL Querying
Query PostgreSQL databases to investigate application issues and retrieve operational records.
LLM Platform Knowledge
Understand LLM APIs, token usage, model identifiers and streaming responses to assist users.

Key phrases

  • first- and second-line support
  • incident resolution
  • existing dashboards, logs and alerts
  • availability, latency and error-rate problems
  • runbooks
  • gateway and model-provider issues
  • authentication failures
  • rate limits
  • streaming failures
  • regional performance differences
  • PostgreSQL
  • Python
  • Bash
  • PowerShell
  • Grafana

From the posting

Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. We are a technology and data driven group implementing a scientific approach to investing. Combining data, research, technology and trading expertise has shaped QRT’s collaborative mindset which enables us to solve the most complex challenges. QRT’s culture of innovation continuously drives our ambition to deliver high quality returns for our investors.

You will provide day-to-day production support for QRT’s platform for accessing internally hosted and external LLMs. Based in the US, you will support users during US business hours and coordinate with colleagues in other regions to ensure effective incident handovers.

This is a hands-on support role, focused on incident resolution, user assistance and established operational procedures-not platform architecture, model development or infrastructure engineering.

Your future role within QRT:

  • Provide first- and second-line support for QRT’s platform for accessing internally hosted and external LLMs, investigating issues raised by engineering and business users, maintaining support tickets and following issues through to resolution or engineering escalation.
  • Monitor platform health using existing dashboards, logs and alerts; identify availability, latency and error-rate problems and perform approved recovery actions using established runbooks.
  • Troubleshoot gateway and model-provider issues, including authentication failures, rate limits, timeouts, connection resets, streaming failures and regional performance differences.
  • Determine whether incidents originate in a user’s client or configuration, the platform gateway, an internally hosted model or an external LLM provider; collect diagnostic evidence and coordinate escalation to the appropriate team or vendor.
  • Support coding assistants, API clients and developer workspaces connected to QRT’s LLM platform, including Claude Code, Codex CLI, OpenCode, PI and Coder; investigate compatibility issues following client or vendor updates.
  • Help users configure supported integrations, select the appropriate regional endpoint and migrate API access from Open WebUI to the direct gateway.
  • Investigate access and model-availability queries, check user permissions and escalate provisioning or entitlement issues through established support and governance processes.
  • Carry out operational checks for releases and configuration changes, including non-production validation, post-release smoke testing and approved rollback procedures, in coordination with platform engineering.
  • Use existing observability tools to investigate time to first token, time per output token, percentile latency and failure rates; flag recurring issues and monitoring gaps to the platform team.
  • Maintain runbooks, troubleshooting guides and known-issue records; provide clear incident updates and reliable handovers between regional support teams.
  • Maintain small support scripts and diagnostic utilities to reduce repetitive checks and improve evidence collection.

Your present skillset:

  • Relevant experience in production support, application support or platform operations, with the ability to investigate routine incidents independently and recognise when specialist escalation is required.
  • Practical Linux troubleshooting skills and familiarity with Windows-based developer environments.
  • Working proficiency in Python, Bash and/or PowerShell for operational checks, log analysis and straightforward support automation.
  • Experience using SQL to investigate application issues and query operational records, ideally in PostgreSQL.
  • Practical experience interpreting metrics, logs, traces and dashboards to distinguish a platform-wide incident from a user-, client-, model- or region-specific issue.
  • Confidence troubleshooting API-driven services, including HTTP errors, authentication, networking, timeouts, retries, rate limiting and streaming connections.
  • Hands-on experience supporting LLM-based platforms or services, with a working understanding of LLM APIs, including prompts, context limits, token usage, model identifiers and streaming responses.
  • Familiarity with public-cloud services, ideally AWS, and the ability to inspect containerised workloads using established tools and procedures.
  • Clear communication with technical and non-technical users, including concise incident updates, realistic expectations and well-documented escalations.
  • Awareness of access controls, sensitive-data handling and safe diagnostic practices, including avoiding exposure of prompts, credentials or confidential content in support records.
  • A methodical approach to troubleshooting, prioritisation and cross-region handovers

Nice to have:

  • Experience supporting AWS Bedrock or other managed model APIs.
  • Experience supporting AI coding assistants, API clients or developer workspaces such as Claude Code, Codex CLI, OpenCode, PI or Coder.
  • Familiarity with Grafana, Coralogix or equivalent monitoring and log-analysis tools.
  • Exposure to LLM gateways or proxies such as LiteLLM, or internally hosted inference services such as vLLM.
  • Experience troubleshooting containerised services on ECS or Kubernetes.
  • Familiarity with identity and access provisioning, particularly Okta, SCIM and application-level permissions.
  • Experience supporting multi-region services and working with globally distributed support and engineering teams.
  • Experience coordinating support cases with cloud providers or software vendors during service degradation.

 

Base salary range for this position is $150,000 to $220,000 per year. 

QRT Total Compensation includes discretionary performance-based bonuses and a competitive benefits package.

 

 

More jobs at Qube Research & Technologies

Technology Talent Acquisition Partner

Qube Research & Technologies · 3 days ago | Sydney | On-site · Senior · Full time

Create CV

Trading Systems Engineer

Qube Research & Technologies · Last week | London, New York, NYC | On-site · Senior · Full time

Create CV

Software Engineer - Data Platforms

Qube Research & Technologies · Last week | Hong Kong | On-site · Senior · Full time

Create CV

Infrastructure Support Engineer - AWS

Qube Research & Technologies · Last week | Sydney | On-site · Senior · Full time

Create CV

Lead Production Engineer

Qube Research & Technologies · Last week | Hong Kong | On-site · Lead · Full time

Create CV
See all 158 jobs at Qube Research & Technologies