Lead Data Engineer (Autonomy)
Tasks
- Collaborate on data schemas and quality gates
- Design and maintain data ingestion pipelines
- Develop dataset versioning and lineage systems
- Maintain AWS storage and compute infrastructure
- Optimize data pipelines for throughput and cost
- Validate and transform raw multimodal logs
Perks/Benefits
- Assistance Programme
- Birthday leave
- FlexWork
- Life insurance
- Medical insurance
- Parental leave
- Volunteering leave
Skills/Tech-stack
AWS | Apache Spark | Dask | Data Compression | Data Formats | Data Processing | Data Versioning | Data pipeline | Data schema | Data schema design | Infrastructure as Code | ML data formats | Monitoring and Alerting | Ray | Schema Design | Serialization Formats | “as-code”
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Software Engineer, Data Platform SGD 139K-143KBig Data | C++ | Data Infrastructure | Data Management | Data ProcessingSenior-level Full TimeSingapore16h ago
-
Cloud Computing | Data Governance | Data Pipeline Development | Data Quality | Data Quality ChecksEntry-level InternshipSingapore, SG1d ago
-
AI | API Development | Blockchain | Data Processing | GolangMid-level Full TimeSingapore2d ago
-
Senior Data Engineer - Databricks SGD 180K-203KCI/CD | Cloud Platforms | Data Governance | Data Modeling | Data pipelineFlexible work hours | Professional development opportunitiesSenior-level Full TimeSingapore, Singapore, Singapore2d ago
-
AI | AWS | Agile | Autodesk | AzureSenior-level Full TimeLTA HSO B6 02, Singapore2d ago
-
Artificial Intelligence | Content Safety | Data Processing | Defensive architecture | Deploying systemsMid-level Full TimeSingapore2d ago
-
Data Governance | Data Lake | Data Modeling | Data Pipeline Development | Data PrivacyInclusive culture | Professional development supportMid-level Full TimeSingapore, Singapore2d ago
-
Data Engineer SGD 118K-162KAI | Azure | Data Lineage | Data Modeling | Data ProcessingFlexible work hours | Health insurance | Learning and development programsSenior-level Full TimeSingapore,SGP3d ago
-
AWS | Azure | CI/CD | Computer Vision | Deep learningSenior-level Full TimeNTU Main Campus, Singapore4d ago
-
ML Ops / AI Integration Engineer SGD 138K-143KAPI Integration | AWS | Docker | Generative AI | KubernetesMid-level Full TimeSingapore, Singapore, Singapore4d ago
-
Data Engineers (Familiar with LLM, ML or GenAI apps) SGD 70K-100KAPI Design | AWS | Airflow | Athena | BICareer growth | Learning cultureMid-level Contract Full TimeSingapore, Singapore, Singapore4d ago
-
Senior-level Full TimeKallang, Singapore4d ago
-
Big Data | Data Management | Data integration | Data pipeline | Distributed SystemsEntry-level Full TimeSingapore, Singapore4d ago
-
Mid-level Full TimeSingapore5d ago
-
Senior Data Engineer SGD 147K-180KApache Iceberg | Apache Spark | CD pipelines | CI/CD | CI/CD pipelinesCommunity initiatives | Flexible benefits | Professional development | Wellbeing programsSenior-level Full TimeSGP-TC 2, Singapore5d ago
-
Apache Kafka | Apache Spark | Avro | Azure Data | Azure Data ExplorerFlexible working hours | Health insurance | Professional development opportunitiesSenior-level Full TimeSingapore, Singapore5d ago
-
Solutions Engineer SGD 162K-203KAWS | Azure | Data Analysis | GCP | JavaComprehensive benefits | Diverse and inclusive cultureSenior-level Full TimeSingapore6d ago
-
AI Engineer SGD 147K-180KA/B | A/B Testing | API Development | B testing | Data ValidationFlexible working hours | Learning opportunitiesSenior-level Full TimeSingapore, SG6d ago
-
AI Engineer SGD 147K-180KAPI Development | Containerization | Data Pipeline Engineering | Data cleaning | Data pipelineCollaborative environment | Flexible working hours | Learning and development support | Remote work optionsSenior-level Full TimeSingapore, SG6d ago
-
AWS | Azure | Deep learning | GCP | Language ModelsCollaborative environment | Professional developmentSenior-level Full TimeNTU Main Campus, Singapore6d ago
-
AWS Lambda | AWS S3 | Azure | Cloud Platforms | Cloud Platforms (AWSEmployee wellness program | Fun working environment | Growth opportunities | Structured development frameworkMid-level Contract Full TimeSingapore, Singapore, Singapore6d ago
-
AWS | Agile | Ansible | Automation | AzureCulture of continuous learning | Cutting-edge AI/ML infrastructure | Professional development opportunitiesSenior-level Full TimeNTU Main Campus, Singapore6d ago
-
Storage Cloud Engineer, Aladdin Engineering, Associate SGD 112K-185KAI | AWS | Automation (Ansible) | Azure | Backup SoftwareFlexible time off | Healthcare | Hybrid work model | Retirement plan | Tuition reimbursementMid-level Full TimeSN6-Singapore - 20 Anson Road6d ago
-
AI Engineer SGD 103K-139KAPIs | AWS | Algorithms | Azure | Conversational AICollaboration environment | Continuous learningEntry-level Full TimeSingapore, Raffles City Tower9d ago
-
Senior Data Engineer - Databricks (m/f/*) SGD 148K-203KAWS | Airflow | Azure | Azure DevOps | Delta LakeFlexible-hybrid work | Global collaboration | Impactful projects | International team events | Learning opportunitiesSenior-level Full TimeSingapore9d ago