BigData Engineer
Singapore, Singapore, Singapore
SGD 96K-120K (estimate) Senior-level Full Time
Tasks
- Build Spark batch and streaming pipelines
- Develop and maintain enterprise big data applications
- Follow Apache Spark best practices
- Implement functional and non functional requirements in Apache Spark
- Integrate and process multiple data formats
- Tune and optimize Spark job performance
- Use CI CD workflows for data platform changes
- Write Linux shell scripts for data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Amazon S3 | Apache Flink | Apache Kafka | Apache Spark | Avro | Bitbucket | CI/CD | Cloudera | Git | HDFS | Hadoop | Hive | Hortonworks | Impala | JSON | Java | Jenkins | Linux Shell | Microservices | ORC | Parquet | Presto | Relational databases | YARN
Education
Roles
Related jobs
-
Lead AI Engineer SGD 112K-148KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningCareer growth support | Inclusive culture | Interactive development programs | Learning and developmentSenior-level Full TimeSingapore, Singapore19h ago
-
Mid-level Full TimeCrimson House Singapore22h ago
-
Data Engineer - A26171 SGD 70K-100KAWS | AWS Database | AWS Database Migration Service | AWS Glue | AWS LambdaCertification support | Flexible work arrangement | Health and wellness | Learning programs | Medical insuranceMid-level Full TimeSingapore, Singapore, Singapore1d ago
-
Manager/Assistant Director (Data Platform Engineer) SGD 163K-240KAccess Management | Agile | Amazon Web Services | Azure | Azure SynapseExecutive-level Full TimeSFA - JEM, Singapore1d ago
-
Associate Platform and Data Engineer SGD 60K-100KAWS Glue | AWS Lambda | Agile | Amazon Web Services | Apache SparkMid-level Full TimeSG Ensign Kallang Place, L9 (Left …1d ago
-
Data Engineer - (Public Sector) SGD 90K-115KAWS DMS | AWS Glue | AWS Lambda | Access Control | AlgorithmsSenior-level Contract Full TimeSingapore, Singapore, Singapore1d ago
-
AI Engineer（Senior Level） SGD 147K-180KFaiss | Information Retrieval | Intent Classification | Java | Machine LearningSenior-level Full Time新加坡2d ago
-
Senior Big Data Engineer SGD 96K-130KAlgorithms | Apache Spark | C++ | Data Modeling | Data StructuresSenior-level Full Time Internship新加坡2d ago
-
Algorithms | ClickHouse | Computer Architecture | Data Structures | Elasticsearch24x7 on-call rotation | Incident response participationMid-level Full Time新加坡2d ago
-
Mid-level Full TimeSingapore2d ago
-
M18 - Data Engineer SGD 100K-139KAWS Glue | Amazon Athena | Amazon RDS | Amazon S3 | Amazon SageMakerMid-level Full TimeSingapore2d ago
-
Senior-level Full TimeSingapore2d ago
-
Professional Services Engineer SGD 72K-123KAPI Integration | Amazon Web Services | Apache Tomcat | Authentication | CI/CDMid-level Full TimeSingapore, SG2d ago
-
Mid-level Full TimeSingapore2d ago
-
API | Airflow | CI/CD | Data Deduplication | Data LineageSenior-level Full TimeNgee Ann Polytechnic, Clementi Campus, Singapore2d ago
-
Mid-level Full TimeLand - 249 Jalan Boon Lay, …2d ago
-
Senior-level Full TimeSingapore3d ago
-
Algorithm Software Engineer - Robotics System Specialization (Campus Recruitment/Intern) SGD 41K-50KC++ | CI/CD | CMake | Cameras | DDSInternshipEntry-level Internship新加坡4d ago
-
APIs | Azure | Azure Data | Azure Data Explorer | Azure Data FactoryOnsite workMid-level Full TimeSingapore, Singapore5d ago
-
.NET | App Service | Azure | Azure App | Azure App ServiceMid-level Full TimeSingapore, Singapore5d ago
-
AWS | Alicloud | Java | Kafka | LinuxEducation subsidy | Healthcare | Learning and development | Meal allowance | Wellness allowanceSenior-level Full TimeHong Kong, Hong Kong SAR; Singapore, …5d ago
-
WXG - Big Data Development Engineer Intern SGD 66K-78KApache Hive | Apache Iceberg | Apache Kafka | Apache Pulsar | Apache SparkEntry-level Full Time InternshipSingapore-CapitaSky5d ago
-
Senior-level Full TimePACS | Singapore - Labrador Tower …5d ago
-
Senior Software Engineer SGD 147K-180KAlgorithms | CI/CD | Code Quality | Data Structures | Design PatternsSenior-level Full TimeSingapore - Singapore - Block 33 …5d ago
-
Arduino | C++ | CSS | Computer Vision | Deep learningSenior-level Full TimeSingapore6d ago