BigData Engineer
Singapore, Singapore, Singapore
SGD 96K-120K (estimate) Senior-level Full Time
Tasks
- Build Spark batch and streaming pipelines
- Develop and maintain enterprise big data applications
- Follow Apache Spark best practices
- Implement functional and non functional requirements in Apache Spark
- Integrate and process multiple data formats
- Tune and optimize Spark job performance
- Use CI CD workflows for data platform changes
- Write Linux shell scripts for data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Amazon S3 | Apache Flink | Apache Kafka | Apache Spark | Avro | Bitbucket | CI/CD | Cloudera | Git | HDFS | Hadoop | Hive | Hortonworks | Impala | JSON | Java | Jenkins | Linux Shell | Microservices | ORC | Parquet | Presto | Relational databases | YARN
Education
Roles
Related jobs
-
Machine Learning Engineer SGD 54K-60KAlgorithms | Data Structures | Java | Language Processing | Machine LearningEntry-level Full Time新加坡19h ago
-
Senior Big Data Engineer SGD 96K-130KAlgorithms | As-a-Service | C++ | Data Structures | Data TransformationSenior-level Full Time Internship新加坡19h ago
-
Algorithms | Backend Development | ClickHouse | Data Structures | ElasticsearchIncident response support | On-call rotationMid-level Full Time新加坡19h ago
-
Forward Deployment Engineer SGD 160K-203KAI code generation | Anthropic | Apache Spark | Artificial Intelligence | Code generationSenior-level Full TimeSingapore1d ago
-
Amazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Cloud PlatformsMid-level Full TimeSingapore, Singapore, Singapore1d ago
-
AWS | CI/CD | Cloud deployment | Data Preparation | DatabricksMid-level Full TimeNanyang Polytechnic, Singapore1d ago
-
Manager, Data & Digital SGD 100K-143KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon BedrockMid-level Full TimeSGP Keppel Bay Tower, Singapore1d ago
-
Member of Technical Staff (Data): World Models SGD 165K-214KAccess Control | Annotations | Apache Spark | Backward Compatibility | Data CatalogSenior-level Full TimeUS, Singapore, Remote R1d ago
-
C# | C++ | Cloud Computing | DNS | Distributed SystemsFlexible working hours | On-call rotation | Travel up to 15 percentSenior-level Full TimeSingapore2d ago
-
C plus plus | C# | Code reading | Code writing | DNSOn-call schedule | Travel up to 15 percentMid-level Full TimeSingapore2d ago
-
Agentic AI Developer SGD 85K-170KAPI Integration | Agent systems | Cloud Computing | Embeddings | Evaluation PipelinesMid-level ContractSingapore, Singapore2d ago
-
Mid-level Full TimeSingapore2d ago
-
Apache Hive | Azure | Azure Data | Azure Data Explorer | Azure Data FactoryOnsite workMid-level Full TimeSingapore, Singapore3d ago
-
Software Engineer III, China LLM Enablement SGD 139K-167KAPI Gateway | AWS Bedrock | AWS Lambda | Agile | Amazon EC2Senior-level Full TimeSingapore3d ago
-
Quantitative Developer - AI Implementation USD 150K-200KAPI Development | CSV | Data Modeling | Data Pipelines | GitMid-level Full TimeChicago OR London OR Miami OR …3d ago
-
AI Platform Engineer #AIDA SGD 60K-60KAPI Gateway | Active Directory | Agent Orchestration | Backup Systems | CI/CDMid-level Full TimeSingapore, Singapore3d ago
-
(Internship Jul 26) DEC/AI Factory - AI Engineer SGD 100K-135KAI Agents | AWS | Azure | Cloud platform | Data PipelinesEntry-level Full Time InternshipSingapore, Singapore, Singapore4d ago
-
Software Engineer, Robotic Test Automation SGD 100K-143KAI | Artificial Intelligence | C++ | Exploratory Testing | JavaMid-level Full TimeSingapore5d ago
-
Senior Software Engineer, Robotic Test Automation SGD 122K-191KArtificial Intelligence | C plus plus | C# | Data Storage | Distributed ComputingSenior-level Full TimeSingapore5d ago
-
Data Engineer SGD 100K-143KApache Kafka | BigQuery | Cloud PubSub | DBT | Data LakesAutonomy | Growth opportunities | High ownership | Impact | TrustMid-level Full TimeSingapore5d ago
-
Apache Airflow | Apache Spark | Bias Mitigation | Dataset Distillation | Prompt engineeringMid-level Full TimeSingapore6d ago
-
Data Catalog | Data Governance | Data Security | Distributed Systems | JavaEntry-level InternshipSingapore, Singapore6d ago
-
C++ | Cloud Native | Cloud platform | Data Modeling | Data integrationMid-level Full TimeSingapore6d ago
-
AI Engineer (Transcribe) SGD 85K-133KAWS | CI/CD | Cloud Computing | Database Administration | DockerEmployee wellness programs | Flexible work arrangements | Leave benefitsMid-level Full TimeSingapore, Singapore, Singapore6d ago
-
Data Engineer - (Public Sector) SGD 108K-150KAWS DMS | AWS ECS | AWS Glue | AWS Lambda | Access ControlSenior-level Contract Full TimeSingapore, Singapore, Singapore6d ago