Senior Data Engineer, Unified Platform
Tasks
- Backfill datasets and rerun batch jobs
- Contribute to on-call rotation
- Coordinate vendor change management
- Design & build data pipelines
- Develop monitoring and quality control software
- Develop self-service data capabilities
- Handle dead letter queues
- Implement data governance discovery cost sharing usage tracking access controls quality control
- Manage data pipeline orchestration and operational tasks
- Model, build, and manage data products
- Monitor data ingestion pipelines and data quality
- Onboard and manage new data sources
- Own technical aspects of vendor ingestion pipelines
- Perform routine data operations
- Respond to user requests and identify platform gaps
- Triage data quality control and correct data gaps
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Apache Airflow | Apache Arrow | Apache Flink | Apache Kafka | Apache Spark | Apache Thrift | Argo Workflows | Avro | Batch Processing | Cassandra | ClickHouse | Data Governance | Data Modeling | Data Quality | Data Transformation | Data orchestration | Dead Letter | Dead-letter queues | Delta Lake | GRPC | Iceberg | JSON | Java | Kubernetes | NoSQL | Parquet | Protobuf | Python | Relational databases | SQL | Streaming processing
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeSingapore-CapitaSky12h ago
-
Lead of Agentic AI SGD 74K-74KAI Agents | API Integration | Agent systems | Continuous Improvement | Language ModelsSenior-level Full TimeDownstream - Golden Agri Plaza, Singapore …12h ago
-
Agentic AI Engineer / Specialist SGD 100K-100KAPI Integration | Agent Orchestration | Data Ingestion | Data Processing | DatabasesMid-level Full TimeDownstream - Golden Agri Plaza, Singapore …12h ago
-
Machine Learning Engineer Graduate (TikTok Shop Global E-Commerce, Recommendation) - 2026 Start (PhD) SGD 84K-91KBoosting trees | C plus plus | Collaborative Filtering | Data Pipelines | Data ProcessingEntry-level Full TimeSingapore1d ago
-
AI Customer Engineer, Telecommunications, Google Cloud SGD 160K-220KAI Agent Development Kit | Agent Development Kit | As-a-Service | Audit Logging | Cloud NetworkingConference participation | Travel opportunitiesSenior-level Full TimeSingapore1d ago
-
Data Engineer, ANZSA SGD 150K-210KAPI Integration | Amazon Redshift | CI/CD | Data Governance | Data ModelingMid-level Full TimeSingapore1d ago
-
Lead Software Engineer, Perception (Robotics) SGD 155K-238K3D Perception | C++ | Camera | Camera Calibration | Cause analysisBirthday leave | FlexWork | Insurance | Medical insurance | Parental leaveSenior-level Full TimeSingapore, Singapore1d ago
-
Senior Data Engineer SGD 160K-216KAccess Management | Apache Airflow | Apache Kafka | Apache Spark | Cloud Security1 plus 1 year contractSenior-level Full TimeHDB HUB, Singapore1d ago
-
Data Analysis | Data Assimilation | Data Processing | Data Quality | Data quality controlEntry-level Full TimeNTU Main Campus, Singapore1d ago
-
Mid-level Full TimeSingapore2d ago
-
Software Engineer, Machine Learning SGD 74K-74KBias Mitigation | Data Structures | Ethical AI | Graph theory | IndexingSenior-level Full TimeSingapore2d ago
-
Senior LLM Inference Performance & Evaluation Engineer TWD 1700K-2300KBenchmarking | CI/CD | Concurrency | Dashboards | GPU UtilizationDevelopment opportunities | Inclusive environment | Mentoring | Training opportunitiesSenior-level Full TimeSingapore, SG / Penang, MY / …2d ago
-
Senior Inference Runtime Engineer TWD 1900K-2500KCUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory OptimizationFlexible work culture | Inclusive environment | Training and mentoringSenior-level Full TimeSingapore, SG / Penang, MY / …2d ago
-
Cloud Storage Engineer TWD 1700K-2500KBeeGFS | CI/CD | Caching | Capacity Planning | CephAutonomy | Fast growth learning opportunities | Inclusive environment | Training and mentoring | Welfare benefitsSenior-level Full TimeSingapore, SG / Penang, MY / …2d ago
-
Machine Learning & Data Engineering Intern SGD 36K-48KC++ | Data Modeling | Data analytics | Machine Learning | PythonCommunity volunteer opportunities | Gym access | On site recreation facilities | Yoga classes | Zumba classesEntry-level InternshipShugart, SG2d ago
-
AI Integration Engineer SGD 60K-108KAPI Key | Audit Logging | BACnet | Code Integration | EncryptionFlexible working arrangements | Professional developmentMid-level Full TimeSJ Campus, Singapore2d ago
-
Domain Randomization | Imitation Learning | IsaacGym | IsaacLab | JAXFast feedback cycles | High impact work on real robots | Open source contributionsMid-level Full TimeSingapore3d ago
-
C++ | Localization | Mapping | Motion Planning | NavigationCompetitive compensation | EquitySenior-level Full TimeSingapore3d ago
-
Autonomy | C++ | Contact Rich Control | Control Theory | Data collectionCompetitive compensation | Equity | Open source contributionsMid-level Full TimeSingapore3d ago
-
AI Engineer (GenAI / RAG / LangGraph / Python) SGD 74K-74KAgent systems | Anthropic Claude | Azure OpenAI | CI/CD | ChromaSenior-level Contract Full TimeSingapore, Singapore, Singapore3d ago
-
Classifier Modeling | Data Mining | Data Structures | Data Structures and Algorithms | Machine LearningSenior-level Full TimeSingapore4d ago
-
Tech Expert/Backend Engineer - Global Live (LLM) SGD 150K-190KAmazon RDS | Big Data | C++ | Golang | JavaSenior-level Full TimeSingapore4d ago
-
C++ | Cloud Computing | Data Modeling | Data Pipelines | ETLSenior-level Full TimeSingapore4d ago
-
Senior Databricks Consulting Engineer SGD 175K-221KAWS | Apache Kafka | Apache Spark | Azure | Cloud ArchitectureContinuous learning and certification support | Remote friendly working environmentSenior-level Full TimeSingapore4d ago
-
APIs | Azure | Azure Data | Azure Data Explorer | Azure DevOpsOnsite workMid-level Full TimeSingapore, Singapore4d ago