BigData Engineer
Singapore, Singapore, Singapore
SGD 96K-120K (estimate) Senior-level Full Time
Tasks
- Build Spark batch and streaming pipelines
- Develop and maintain enterprise big data applications
- Follow Apache Spark best practices
- Implement functional and non functional requirements in Apache Spark
- Integrate and process multiple data formats
- Tune and optimize Spark job performance
- Use CI CD workflows for data platform changes
- Write Linux shell scripts for data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Amazon S3 | Apache Flink | Apache Kafka | Apache Spark | Avro | Bitbucket | CI/CD | Cloudera | Git | HDFS | Hadoop | Hive | Hortonworks | Impala | JSON | Java | Jenkins | Linux Shell | Microservices | ORC | Parquet | Presto | Relational databases | YARN
Education
Roles
Related jobs
-
AWS Athena | AWS Glue | AWS SageMaker | Agile | Amazon RDSEmployee wellness program | Growth opportunities | Structured development frameworkMid-level Full TimeSingapore, Singapore, Singapore21h ago
-
AWS | CI/CD | Experiment design | Exploratory research | FastAPICoaching and mentoring | Employee wellness program | Equal opportunity workplace | Growth opportunities | Structured development frameworkMid-level Full TimeSingapore, Singapore, Singapore21h ago
-
APIs | Azure | Azure Data | Azure Data Explorer | Azure DevOpsOnsite workMid-level Full TimeSingapore, Singapore1d ago
-
AWS | Agile | Apache Airflow | Apache Flink | Apache SparkMid-level Full TimeSingapore, Singapore1d ago
-
Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeSingapore, Singapore1d ago
-
Backend Developer(.Net) SGD 111K-160K.Net Core | Amazon Web Services | Apache Kafka | C# | Cloud platformSenior-level Full TimeSingapore, Singapore, Singapore1d ago
-
Data Mining | Data Modeling | Data Visualization | Data Warehousing | Distributed SystemsSenior-level Full TimeSingapore, Singapore1d ago
-
Automation | C# | C++ | Cloud Networking | Code debuggingGlobal team support | On-call rotation | Travel up to 15 percentMid-level Full TimeSingapore1d ago
-
Mid-level Full TimeSingapore, Singapore, Singapore1d ago
-
API | AWS | Apache Hadoop | Apache Spark | Deep learningMid-level Full TimeSingapore, Singapore1d ago
-
Senior Software Engineer, Data Platform & AI Enablement SGD 147K-180KApache Flink | Apache Spark | Checkpointing | Data Streaming | Distributed SystemsSenior-level Full TimeSG - Singapore1d ago
-
Entry-level Full TimeSINGAPORE, Singapore1d ago
-
Senior Manager (AI Engineer) (Future Capabilities) SGD 100K-120KAgentic AI | Agile | Artificial Intelligence | CrewAI | Data GovernanceSenior-level Full TimeBCA-JEM, Singapore1d ago
-
Machine Learning Engineer SGD 48K-60KAlgorithms | Data Structures | Exploration | Java | Language ProcessingTeam collaborationEntry-level Full Time新加坡2d ago
-
Senior Big Data Engineer SGD 102K-130KAlgorithms | As-a-Service | C++ | Data Structures | Data TransformationSenior-level Full Time Internship新加坡2d ago
-
Algorithms | ClickHouse | Data Structures | Elasticsearch | Go24x7 on-call rotation | Incident ResponseMid-level Full Time新加坡2d ago
-
Automation | C# | C++ | CloudNetworking | DNSOn-call rotation | Travel up to 15 percentSenior-level Full TimeSingapore2d ago
-
Customer Solutions Engineer, High Touch, Database, Storage, Google Cloud (English, Mandarin) SGD 105K-142KApp Development | C# | C++ | Cloud Networking | Cloud platformGlobal team support | On-call rotation | Travel opportunitiesSenior-level Full TimeSingapore2d ago
-
Data Engineer SGD 65K-70KApache Spark | Audit trails | Azure | Azure DevOps | Azure Machine LearningHybrid workEntry-level Full TimeSingapore, Singapore, Singapore2d ago
-
Apache Hadoop | Apache Kafka | Apache Kudu | Apache Spark | Autonomous AgentsEngineering culture | Opportunity for innovation | Work-life balanceMid-level Full TimeSingapore, Singapore2d ago
-
Senior Software Engineer (Big Data Processing) SGD 147K-180KAgentic AI | Design Patterns | Docker | Elasticsearch | JavaEmpower to innovate | Engineering and operational excellence | Engineering excellence culture | Modern technology | Purposeful meaningful workSenior-level Full TimeSingapore, Singapore2d ago
-
AWS | Apache Spark | Azure | Delta Lake | Distributed ComputingInternal training programs | On-call rotationSenior-level Full TimeSingapore2d ago
-
Senior-level Full TimeSingapore2d ago
-
Lead AI Engineer SGD 108K-143KArtificial Intelligence | CI/CD | Data Preprocessing | Data Versioning | Deployment FrameworkSenior-level Full TimeSingapore2d ago
-
Data Analysis | Data Modeling | Java | Keras | Machine LearningAccess to cutting-edge technology | Collaborative and inclusive work environment | Flexible working hours | Health and wellness benefits | Paid time offSenior-level Full TimeSingapore, Singapore, Singapore2d ago