Data Infra Platform Engineer
Tasks
- Build and operate lakehouse on Apache Iceberg
- Build cloud infrastructure as code
- Build data self service provisioning for Kafka topics and credentials
- Define and measure SLI and SLO
- Deploy and operate data platform services
- Deploy and secure managed databases on Kubernetes
- Detect root cause for platform failures
- Enforce data naming standards and access policies
- Implement GitOps reconciliation and drift detection
- Manage Polaris catalog and Trino access
- Operate data catalog and metadata layer
- Operate event streaming on Apache Kafka
- Operate lifecycle upgrades for brokers and engines
- Orchestrate workflows with Apache Airflow
- Perform safe upgrades without data loss
- Provide Iceberg tables catalogs and query access
- Provision and configure Kubernetes clusters
- Set up data retention and governance controls
- Trace failures to root cause
- Write incident runbooks and lead incident response
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | Access Management | Apache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Apache Superset | Apache Trino | Argo CD | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Key Vault | Azure Kubernetes | Azure Kubernetes Service | Bash | CI/CD | CloudNativePG | Data Lake Storage Gen2 | Data Modeling | Datahub | Elasticsearch | Elasticsearch Kibana | Entra ID | FinOps | FluxCD | GitLab | GitOps | Go | Grafana | Identity and Access Management | Identity and access | Incident Response | Key Vault | Kibana | Kubernetes | Kubernetes Service | Least Privilege | Linux | Microsoft Entra | Microsoft Entra ID | Network Segmentation | OpenTofu | Polaris | Private Endpoint | Python | RBAC | SLI | SLO | SQL | Secrets management | Strimzi | Supply Chain | Supply chain security | Terraform
Education
Roles
Data Platform | Data Platform Engineer | Engineer | Platform | Platform Engineer
Related jobs
-
Senior-level Full TimeSingapore, Singapore5h ago
-
Agile | Application Insights | Azure DevOps | Azure Log Analytics | Azure ResourceCareer development support | Training opportunitiesEntry-level Full TimeSingapore, Singapore5h ago
-
Entry-level Full TimeSINGAPORE, Singapore19h ago
-
AWS | Agentic Systems | Azure | CI/CD | Computer VisionSenior-level Full TimeLTA ITSC L4, Singapore19h ago
-
AWS | Access Control | Alerting | Amazon SageMaker | Audit LoggingSenior-level Full TimeLTA ITSC L4, Singapore19h ago
-
AWS Glue | Access Control | Airflow | Anonymization | Apache KafkaSenior-level Full TimeLTA ITSC L4, Singapore19h ago
-
C++ | CAN bus | Clean architecture | Code review | Computer VisionCollaborative research environment | Innovation showcases | Mentorship opportunities | Student project involvementSenior-level Full TimeRepublic Polytechnic, Singapore19h ago
-
Mid-level Full TimeSJ Campus, Singapore19h ago
-
Computer Vision Engineer SGD 120K-198K3D Point Clouds | Agile | Anomaly Detection | CAD | CUDAAllowance benefits | Certification training | Company Transport Provided | Dental benefits | Employee scholarship programMid-level Full TimeSG-01-SINGAPORE-061 ~ 61 Seletar Aerospace View …19h ago
-
Control Theory | Domain Adaptation | Domain Randomization | Imitation Learning | Isaac LabMid-level Full TimeSingapore1d ago
-
C++ | Dynamic Obstacle Avoidance | Embedded Systems | Footstep planning | LocalizationEquity | Open source contributionsSenior-level Full TimeSingapore1d ago
-
C++ | Contact Rich Control | Control Theory | Data collection | Grasp PlanningCompetitive compensation | Equity | Open source contributionsMid-level Full TimeSingapore1d ago
-
Senior Consultant-Senior Software Engineer SGD 96K-114KAnalytics | Apache Hive | Apache Spark | Application Security | Application Security TestingSenior-level Full TimeSingapore, Singapore, Singapore1d ago
-
Mid-level Full TimeSingapore, Singapore, Singapore1d ago
-
Apache Hadoop | Apache Kafka | Apache Spark | Data Ingestion | Distributed SystemsCredit bearing internshipEntry-level InternshipSingapore, Singapore1d ago
-
Data Scientist / Data Engineer SGD 72K-144KData Processing | Embeddings | Error Analysis | Evaluation methodology | Experimental DesignSenior-level Full TimeSingapore1d ago
-
AI Solution Architect SGD 100K-165KAgentic Workflows | AutoGPT | CrewAI | Efficient Fine Tuning | Fine TuningSenior-level Full TimeSingapore1d ago
-
AI Engineer, Data Infra SGD 60K-108KAWS Glue | AWS Organizations | Amazon Athena | Amazon EMR | Amazon QuickSightMid-level Full TimeNTU Main Campus, Singapore1d ago
-
Data Engineer- A26266 SGD 128K-168KData Processing | Embeddings | Error Analysis | Experiment design | Generative AICareer progression | Certification support | Employee wellness programmes | Flexi place | Flexi-timeSenior-level Full TimeSingapore, Singapore, Singapore1d ago
-
.NET | AKS | App Service | Azure App | Azure App ServiceMid-level Full TimeSingapore, Singapore2d ago
-
Azure | Azure Data | Azure Data Explorer | Azure DevOps | Azure SynapseOnsite work scheduleMid-level Full TimeSingapore, Singapore2d ago
-
.NET | API Design | Agent Orchestration | App Service | Azure AppSenior-level Full TimeSingapore, Singapore2d ago
-
AI Fullstack Engineer SGD 60K-108KAPI Integration | Antv | CI/CD | D3.js | EChartsCareer development opportunities | Global teamwork opportunitiesMid-level Full TimeSingapore2d ago
-
Apache Flink | Apache Hive | Apache Spark | Computer Vision | Deep learningEntry-level InternshipSingapore2d ago
-
Apache Hive | Apache Spark | Big Data | Computer Vision | Data ModelingEntry-level Full TimeSingapore2d ago