Data Infra Platform Engineer
Tasks
- Build and operate lakehouse on Apache Iceberg
- Build cloud infrastructure as code
- Build data self service provisioning for Kafka topics and credentials
- Define and measure SLI and SLO
- Deploy and operate data platform services
- Deploy and secure managed databases on Kubernetes
- Detect root cause for platform failures
- Enforce data naming standards and access policies
- Implement GitOps reconciliation and drift detection
- Manage Polaris catalog and Trino access
- Operate data catalog and metadata layer
- Operate event streaming on Apache Kafka
- Operate lifecycle upgrades for brokers and engines
- Orchestrate workflows with Apache Airflow
- Perform safe upgrades without data loss
- Provide Iceberg tables catalogs and query access
- Provision and configure Kubernetes clusters
- Set up data retention and governance controls
- Trace failures to root cause
- Write incident runbooks and lead incident response
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | Access Management | Apache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Apache Superset | Apache Trino | Argo CD | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Key Vault | Azure Kubernetes | Azure Kubernetes Service | Bash | CI/CD | CloudNativePG | Data Lake Storage Gen2 | Data Modeling | Datahub | Elasticsearch | Elasticsearch Kibana | Entra ID | FinOps | FluxCD | GitLab | GitOps | Go | Grafana | Identity and Access Management | Identity and access | Incident Response | Key Vault | Kibana | Kubernetes | Kubernetes Service | Least Privilege | Linux | Microsoft Entra | Microsoft Entra ID | Network Segmentation | OpenTofu | Polaris | Private Endpoint | Python | RBAC | SLI | SLO | SQL | Secrets management | Strimzi | Supply Chain | Supply chain security | Terraform
Education
Roles
Data Platform | Data Platform Engineer | Engineer | Platform | Platform Engineer
Related jobs
-
Mid-level Full TimeSingapore, SG8h ago
-
AWS | Anomaly Detection | Azure | Docker | Feature EngineeringSenior-level Full TimeSingapore, Singapore8h ago
-
Senior-level Full TimeSingapore, Singapore8h ago
-
R&D Engineer, Training Infrastructure SGD 90K-117KDistributed Computing | Kuberay | Kubernetes | Machine Learning | RayMid-level Full TimeSingapore, Singapore10h ago
-
Data Modeling | Data integration | Java | LLM Agents | Language ModelsEntry-level Full TimeSingapore, Singapore10h ago
-
Senior Data Engineer, Product Analytics, Payments SGD 153K-204KAI workflows | Analytics infrastructure | Automation | Data Architecture | Data GovernanceSenior-level Full TimeSingapore11h ago
-
Data & Integration Engineer (GenAI) SGD 74K-74KBatch Processing | CI/CD | Cloudera | Confluence | Control-MSenior-level Full TimeSingapore, Singapore, Singapore23h ago
-
Batch Processing | CI/CD | Cloudera | Confluence | Control-MSenior-level Full TimeSingapore, Singapore, Singapore23h ago
-
Lead AI Engineer SGD 165K-238KAPI Development | Agent workflows | Artificial Intelligence | Distributed tracing | EvaluationSenior-level Full TimeSingapore - Technology Centre23h ago
-
Data Scientist SGD 120K-190KActor-critic | Amazon S3 | Apache Airflow | Apache Spark | Attention MechanismsMid-level Full TimeSingapore - Suntec23h ago
-
.NET | Azure | Azure DevOps | Azure Functions | Azure OpenAIMid-level Full TimeSingapore, Singapore1d ago
-
C++ | Dynamic Obstacle Avoidance | Embedded Systems | Footstep planning | LocalizationEquitySenior-level Full TimeSingapore1d ago
-
AI | Container Orchestration | Distributed Computing | HPC | KubernetesMid-level Full TimeSingapore1d ago
-
Data Pipelines | Domain Randomization | Dynamics Modeling | Imitation Learning | IsaacGymMid-level Full TimeSingapore1d ago
-
AI Engineer (Staff/Principal) GBP 100K-160KAPI Development | API Integration | Agentic Workflows | By Design | Claude CodeElectric car scheme | Enhanced pension contributions | Healthcare support | Parental leave | Unlimited annual leaveSenior-level Full TimeSingapore, Singapore1d ago
-
Software Engineer - Product (Technical Leadership) SGD 90K-170KAI tools | Agent Orchestration | C# | C++ | Code reviewSenior-level Full TimeSingapore1d ago
-
Senior-level Full TimeSingapore1d ago
-
API Gateway | BGP | Cloud Networking | Encryption | Firewall policiesSenior-level Full TimeSingapore1d ago
-
Apache Spark | CI/CD | Data Governance | Databricks | Delta LakeMid-level Full TimeSingapore1d ago
-
AI Agent | AI agent orchestration | API Gateway | Access Management | Active DirectoryContinuous learning | Professional developmentMid-level Full TimeSingapore1d ago
-
AIOps | Apache Spark | Azure Machine Learning | Cloud ML | Cloud ML servicesMid-level Full TimeSingapore1d ago
-
AWS | Agent Orchestration | Agent systems | Agentic AI | AnonymizationExecutive-level Full TimeSingapore1d ago
-
Sr. Solutions Engineer (Indonesia) SGD 175K-225KApache Spark | Big Data | Big data analytics | Cloud Computing | Data analyticsSenior-level Full TimeSingapore1d ago
-
AI Engineer - FDE (Forward Deployed Engineer) SGD 180K-225KAWS | Agent systems | Apache Spark | Azure | Cloud platformSenior-level Full TimeSingapore1d ago
-
[Lta-Itcd] Senior Ai Engineer / Ai Engineer SGD 74K-74KAgentic AI | Cloud Computing | Computer Vision | Data Governance | Deep learningSenior-level Full TimeLTA HSO B6 02, Singapore1d ago