Data Engineer (Big Data Processing)
Tasks
- Build and experiment with agentic AI systems
- Design and build scalable data pipelines
- Ensure data integrity and quality
- Implement data engineering best practices
- Ingest crucial data
- Maintain data governance
- Optimize pipeline performance
- Participate in technical discussions
- Test orchestrate and monitor pipelines
- Troubleshoot data pipeline issues
Perks/Benefits
Skills/Tech-stack
Apache Hadoop | Apache Kafka | Apache Kudu | Apache Spark | Autonomous Agents | Data Governance | Data Quality | Data pipeline | Elasticsearch | High Throughput | Java | LLM workflows | Low Latency | Performance optimization | Scala | System monitoring | Workflow Orchestration
Education
N/A
Roles
Related jobs
-
Machine Learning | Model Evaluation | Performance optimization | Python | Software ArchitectureMid-level Full TimeSingapore, Singapore6h ago
-
AWS | Analytical Skills | Artificial Intelligence | C++ | CI/CDMindfulness programs | Training and development | Wellness programsSenior-level Full TimeSingapore, Singapore, Singapore16h ago
-
Senior-level Full TimeSingapore, Singapore, Singapore19h ago
-
BigQuery | Cloud Data Catalog | Cloud Functions | Cloud Storage | Cloud platformMid-level Full TimeSingapore, Singapore1d ago
-
Benchmarking | Cloud Computing | Data Storage | Debugging | Design reviewSenior-level Full TimeSingapore1d ago
-
Entry-level Full TimeSingapore-Yishun1d ago
-
Mid-level Full TimeSG Ensign Kallang Place, L9 (Right …1d ago
-
Senior-level Full TimeSingapore, Singapore2d ago
-
ANSI SQL | Apache Iceberg | Apache Spark | Avro | CI/CDExecutive-level Full TimeSingapore, Singapore, Singapore2d ago
-
Data Engineering, Lakehouse and AI Data Platform Engineer, Analyst/ Associate, Singapore SGD 147K-180KANSI SQL | Apache Iceberg | Apache Spark | Avro | CI/CDSenior-level Full TimeSingapore, Singapore, Singapore2d ago
-
Lead Algorithm Engineer - Search & Recommendation SGD 140K-160KAd Targeting | C++ | Computer Vision | Experimentation | JavaSenior-level Full TimeSingapore2d ago
-
Data Engineer - A26137 SGD 60K-92KAPI Development | Agile | ArcGIS Server | Batch Processing | Continuous DeliveryCoaching and mentoring | Employee wellness program | Fun working environment | Growth opportunities | Structured development frameworkMid-level Full TimeSingapore, Singapore, Singapore2d ago
-
Azure Data | Azure Data Factory | Azure DevOps | Data Factory | Data GovernanceSenior-level Contract Full TimeSingapore, Singapore, Singapore2d ago
-
Software Engineer (Embedded) SGD 54K-57KAgile Development | C# | Continuous Delivery | Continuous integration | DebuggingEntry-level Full TimeSINGAPORE, Singapore2d ago
-
AIX | Access Control | Actifio | Automation | Backup and RecoveryExecutive-level Full TimeSGP-TC 2, Singapore2d ago
-
Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DB | Azure DataHybrid work | Relocation package | Visa supportMid-level Full TimeSingapore, Singapore3d ago
-
Data Engineer SGD 61K-92KABAC | AWS | AWS Athena | AWS Redshift | AWS S3Annual leave | Birthday leave | Family care | Learning cultureMid-level Full TimeSingapore, Singapore, Singapore3d ago
-
AI Engineer - FDE (Forward Deployed Engineer) SGD 139K-143KAWS | Agent systems | Apache Spark | Apache Spark MLlib | Apache Spark SQLSenior-level Full TimeSingapore3d ago
-
VP, Applied AI Engineer, AI Alpha Group SGD 120K-200KAWS | Data Governance | Data Modeling | Data Quality | DatabricksFlexible work schedule | In person collaboration four days per week | Work from home optionsExecutive-level Full TimeSingapore, SG3d ago
-
Agentic AI | Autogen | BF16 | Big Data | CI/CDSenior-level Full TimeFab 10A, Singapore3d ago
-
Entry-level Full TimeSingapore, Singapore4d ago
-
Data Engineer SGD 107K-139KAPIs | Alerting | BigQuery | DBT | Data GovernanceAutonomy | Flat structure | Growth opportunities | TrustMid-level Full TimeSingapore5d ago
-
Data Architecture | Data Catalog | Data Classification | Data Fusion | Data GovernanceSenior-level Contract Full TimeHealth Promotion Board, Singapore6d ago
-
Apache Spark | Azure | Computer Vision | Decision Tree | Deep learningEmployee volunteerism | Medical coverage | Subsidised accommodation rates | Training and development | Wellness programmesSenior-level Contract Full TimeCapital Tower, Singapore6d ago
-
Apache Spark | Computer Vision | Decision Trees | Deep learning | Generative AIMedical coverage | Subsidised accommodation rates | Training and development | Volunteerism support | Wellness programmesSenior-level Contract Full TimeCapital Tower, Singapore6d ago