Site Reliability Engineer - Vice President

iCapital · Lisbon, Portugal, PT - Lisbon · Posted Oct 28, 2026


Transparency

Stale

Online for 3 weeks and never reposted. The first wave of applicants is in, so a reply is less likely. Apply if it's a strong fit.

First seen
Oct 29, 2026
Offered for
23 days
Posted in
2 locations

Overview

Category
IT & infrastructure
Employment type
Permanent
Workplace type
Hybrid
Country
Portugal
Seniority
VP
Schedule
Full time
Salary
Not listed

Key skills

Kubernetes reliability engineering
Design and enforce reliability standards, health checks, scaling patterns, and safe rollouts for Kubernetes services.
Incident response and postmortems
Lead high‑severity incidents, act as Incident Commander, conduct retrospectives and implement systemic fixes.
Infrastructure as Code (Terraform)
Create reusable Terraform modules and monitors‑as‑code to automate provisioning and monitoring standards.
Observability and telemetry
Define SLOs/SLIs and manage Prometheus, OpenTelemetry pipelines, and related monitoring dashboards.
Linux and cloud networking troubleshooting
Diagnose complex failures across application, container, Kubernetes, and AWS networking layers.

Key phrases

  • Kubernetes-based services
  • AWS
  • Terraform
  • monitors as code
  • Incident Commander
  • SLOs
  • SLIs
  • Prometheus
  • OpenTelemetry
  • ArgoCD ApplicationSets
  • Helm charts
  • Kinesis streams
  • Lambda functions
  • runbooks
  • postmortems

From the posting

About the Role

The Site Reliability Engineering team at iCapital is fundamental to ensuring our platform delivers consistent, reliable service to our client base. Our services run on Kubernetes in AWS, and this role focuses on keeping them healthy in production.

We're looking for the hands-on engineer others turn to when production is broken and the cause isn't obvious. You'll troubleshoot across the full stack (the application, its containers, Kubernetes, and the underlying cloud infrastructure) and turn what you learn into lasting improvements: stronger reliability standards, safer rollouts, sharper alerts, and automation that prevents repeat failures. You'll rely on metrics, logs, and traces every day, but the heart of this role is diagnosing and fixing what they reveal.

Responsibilities

  • Act as a senior escalation point for complex production issues in Kubernetes-based services, leading hands-on investigation across application, container, Kubernetes, and AWS layers through to root cause.
  • Partner with the teams that own our cluster infrastructure to resolve platform-level issues, and feed what you learn back into reliability standards and improvements.
  • Define and implement reliability and operability standards for Kubernetes-based services, including resource sizing, health checks, scaling patterns, rollout safety, and baseline monitoring, as part of service onboarding.
  • Serve as Incident Commander or senior technical lead for high-severity incidents, lead postmortems, and drive systemic improvements through action items and measurable follow-through.
  • Turn recurring investigations into runbooks, diagnostic tooling, and automated remediation that shorten time to resolution and eliminate toil.
  • Coach engineers in systematic troubleshooting and Kubernetes best practices through reviews, game days, and knowledge sharing.
  • Define, implement, and iterate service level objectives (SLOs) and service level indicators (SLIs) that reflect customer and business expectations.
  • Standardize monitoring and alerting through “monitors as code” (Terraform preferred), including quality gates such as severity, ownership, and runbook links.
  • Operate and tune OpenTelemetry pipelines, including sanitizing data, managing cardinality, and enriching telemetry with consistent fields.
  • Maintain the infrastructure behind our monitoring stack, including Helm charts, ArgoCD ApplicationSets, Kinesis streams, Lambda functions, and Prometheus.
  • Participate in on-call rotations with a focus on improving reliability, reducing alert noise, and increasing signal quality over time.

What You'll Need (Must-Haves)

  • 5+ years in SRE or related roles, with evidence of technical seniority across multiple services and teams.
  • 3+ years of hands-on experience running and troubleshooting production workloads on Kubernetes, with a deep understanding of how Kubernetes schedules, connects, scales, and rolls out workloads.
  • Proven ability to independently diagnose complex failures in distributed systems running on Kubernetes, spanning application, configuration, resource, networking, and scaling issues, including cases where the root cause wasn't obvious.
  • Strong Linux and networking fundamentals, with the ability to troubleshoot below the container layer.
  • Strong production experience with AWS, including how cloud networking and access controls affect workloads running in Kubernetes.
  • Strong incident response skills, including leading retrospectives/postmortems and following through on systemic fixes.
  • Strong IaC skills (Terraform preferred), with examples of reusable modules, monitors-as-code patterns, or similar standardization work, and the coding ability to build automation and diagnostic tooling.
  • Track record of defining SLOs/SLIs and using an observability stack (such as Prometheus/Grafana, New Relic, Splunk, or similar) to drive decisions and find root causes quickly.
  • Clear written and verbal communication, with the ability to influence engineering teams through standards, tooling, and practical guidance.

Nice to Have

  • Kubernetes certification (CKA or CKS) or equivalent depth.
  • Experience improving rollout safety and autoscaling behavior for Kubernetes workloads.
  • Familiarity with common data stores (Postgres, MongoDB, DynamoDB) and how they fail in distributed systems.
  • OpenTelemetry instrumentation experience at scale.

We believe the best ideas and innovation happen when we are together. Employees in this role will work in the office four days, with the flexibility to work remotely one day (Friday). 

Benefits

iCapital offers a comprehensive benefits package that includes a total compensation program consisting of competitive salary, annual performance bonus, and equity for all full-time employees; healthcare with 100% employer-paid health and dental insurance; and generous paid time off (PTO).

For additional information on iCapital Network, please visit https://www.icapitalnetwork.com/about-us  Twitter: @icapitalnetwork | LinkedIn: https://www.linkedin.com/company/icapital-network-inc

 

More jobs at iCapital

Product Manager - Assistant Vice President

iCapital · 2 days ago | New York, New York, United States, US NY - New York City | $130K–$160K / year | Hybrid · VP · Full time

Create CV

Market Data Analyst - Assistant Vice President

iCapital · 2 days ago | Lisbon, Portugal, PT - Lisbon | Hybrid · VP · Full time

Create CV

Actuarial Software Engineer II - Associate

iCapital · 2 days ago | IN - Jaipur, Salt Lake City, Utah, United States, CA ON - Toronto +4 | Hybrid · Mid level · Full time

Create CV

Vice President, Platform Infrastructure

iCapital · 3 days ago | New York, New York, United States, US NY - New York City | Hybrid · VP · Full time

Create CV

Accounting Operations & Technical Accounting, Assistant Vice President

iCapital · 3 days ago | Greenwich, Connecticut, United States, US CT - Greenwich, US NY - New York City +1 | $110K–$140K / year | Hybrid · VP · Full time

Create CV
See all 167 jobs at iCapital