Senior Data Platform Engineer — Diegem, Belgium
ILIAS Solutions · Diegem · Posted Oct 13, 2026
Transparency
DeadOnline for 5 weeks and never reposted. Jobs this old or reposted this often rarely lead to a hire. It may be filled already.
- First seen
- Oct 14, 2026
- Offered for
- 38 days
Overview
- Category
- Data
- Employment type
- Permanent
- Workplace type
- Hybrid
- Country
- Belgium
- Seniority
- Mid level
- Schedule
- Full time
- Salary
- Not listed
Key skills
- Python and Spark runtime engineering
- Own and operate Python and Spark runtimes, ensuring reliable execution of data jobs in production.
- Object storage and lakehouse formats
- Manage MinIO or S3‑compatible storage and use Iceberg or Hudi lakehouse tables for data persistence.
- Operational PostgreSQL management
- Perform backup, recovery, diagnostics and schema management for PostgreSQL under security constraints.
- CI/CD pipelines and quality gates
- Define and enforce CI/CD processes with rigorous quality gates for each release.
- Security constraints and FIPS validation
- Embed security requirements, validate builds in FIPS and non‑FIPS environments, and address findings.
- Instrumentation and runbook creation
- Instrument stack components with metrics, logs and health checks and write runbooks for independent recovery.
Key phrases
- Python
- Spark
- MinIO
- PostgreSQL
- lakehouse table formats
- Iceberg
- Hudi
- FIPS
- non-FIPS
- CI/CD
- quality gates
- runbooks
- air-gapped
- shipboard
- NATO security clearance
From the posting
Opportunity
Hybrid (2 days on-site) · Permanent, full-timeAbout the roleWhen a warship cuts its last network link, or a forward air base goes dark, your platform still has to work. At ILIAS Solutions, you will engineer the data infrastructure, built on Python, Spark, MinIO, PostgreSQL and lakehouse table formats, that naval and air defence operators depend on in air-gapped, shipboard and disconnected environments.Your Mission
What you'll do- Keep the production data stack and the backend services built on top of it reliable and observable in production.
- Define and document deployment patterns, backup procedures and tested recovery runbooks that customer teams can execute independently.
- Instrument the full stack, Spark drivers and executors, PostgreSQL, MinIO and the JVM, with metrics, logs, health checks and clear failure diagnostics.
- Embed security constraints into platform design and address security findings before each release.
- Validate releases across HTTP/HTTPS and FIPS/non-FIPS environments, keeping CI/CD quality gates rigorous and release behaviour predictable.
At twelve months, FIPS and non-FIPS validation is a routine gate, not a release risk, and the runbooks you have written are the authoritative reference, not you.What you bring
- Eligibility to obtain and maintain the required national or NATO security clearance for this role (we support candidates through the clearance process).
- Production-depth Python and Spark: you own and operate runtimes, not just write jobs against them.
- Hands-on experience with object storage such as MinIO or S3-compatible stores, and lakehouse table formats such as Iceberg or Hudi.
- Operational PostgreSQL knowledge: backup, recovery, diagnosability and schema management under constraints.
- CI/CD and quality gates, rigour around releases, independent of platform; containerised development in deployment contexts.
- Degree in computer science or software engineering, or equivalent professional experience, the or-equivalent clause is genuine.
- Clear written and verbal communication with both engineers and product stakeholders; you will own design and runbook decisions and explain them.
- Air-gapped delivery experience: offline install bundles, signed packages or tooling such as Zarf; STIG-hardened hosts or FIPS-validated crypto library constraints.
- Kafka, Airflow or comparable streaming/orchestration; Scala sufficient to read Spark source and stack traces; Docker Swarm migration experience.
- Constrained-hardware deployments: single-node or few-node clusters, edge or shipboard scheduling, remote shuffle services and shuffle-heavy job tuning.
Build Your Future with ILIAS
Why ILIAS SolutionsThis role carries full end-to-end ownership of a data platform runtime that most platform engineers encounter only in parts: from lakehouse storage and Spark execution through PostgreSQL operations, security hardening and FIPS validation, all the way to the runbooks a customer team uses when you are not in the room. The deployment contexts, shipboard, air-gapped, disconnected forward bases, are technically demanding and genuinely rare. You will have the autonomy to make design decisions that hold up in environments where there is no fallback to a cloud provider and no option to escalate.EligibilityBecause of the nature of our work, this role may require eligibility under applicable export-control regulations and the ability to obtain national or NATO security clearance. We assess eligibility lawfully and on a role-by-role basis; specific requirements are discussed during the selection process. We do not exclude candidates on the basis of nationality except where mandated by applicable export-control or security-clearance law.How to applyApply via this page. Questions before you apply? Reach out to Tim van Dam at tim.van.dam@ilias-solutions.com.More jobs at ILIAS Solutions
See all 13 jobs at ILIAS Solutions
