Data Engineer
SGD 107K-143K (estimate) Senior-level Full Time Found 6d ago
Tasks
- Build scalable ingestion processes
- Collaborate with cross-functional teams
- Design data pipelines
- Develop monitoring dashboards
- Develop reusable templates and processors
- Ensure regulatory compliance
- Implement data security patterns
- Implement real-time and batch data ingestion
- Integrate governance and security tools
- Maintain data lineage and audit systems
- Maintain data transformation workflows
- Operate within Cloudera environment
- Optimize Spark jobs and SQL queries
- Support deployment and production support
- Troubleshoot performance bottlenecks
- Write automation scripts
Perks/Benefits
- N/A
Skills/Tech-stack
Apache NiFi | Automation | Batch Processing | Cloudera | Data Governance | Data Modeling | Data Processing | Distributed data | Distributed data processing | HBase | HDFS | Hive | Impala | Kafka | Monitoring | Oozie | Performance optimization | Python | Ranger | Real Time | Real-time Ingestion | SQL | Scala | Security Protocols | Shell Scripting | Spark | Troubleshooting | YARN
Education
Bachelor's | Engineering | Master's in Computer Science | Related Discipline
Roles
Related jobs
-
Senior Big Data Engineer SGD 102K-130KAutomation | C++ | Data Architecture | Data Engineering | Data pipelineSenior-level Full Time Internship新加坡10h ago
-
Software Engineer, Data Storage & Data Lake - Singapore SGD 170K-240KBatch and Stream Processing | Data Architecture | Data Management | Data management tools | Distributed SystemsSenior-level Full TimeSingapore, Singapore16h ago
-
Machine Learning Engineer - AI Search - Singapore SGD 90K-130KAI Development | Agent | Automation | Chatbot | Deep learningSenior-level Full TimeSingapore, Singapore16h ago
-
Software Engineer - Data Storage & Data Lake - Singapore SGD 170K-200KBatch Processing | Data Architecture | Data Management | Distributed Systems | HBaseSenior-level Full TimeSingapore, Singapore16h ago
-
AI Optimization | Algorithm competition | C++ | Deep learning | Deep learning frameworksEntry-level Full Time InternshipSingapore1d ago
-
AI Algorithm Engineer SGD 70K-90KAI Development | C/C++ | Computer Vision | Data Storytelling | Deep learningEntry-level Full Time InternshipSingapore1d ago
-
Mid-level Full TimeSingapore1d ago
-
Forward Deployment Engineer SGD 112K-148KAWS | Airflow | Azure | CI/CD | CamundaCollaborative culture | Growth opportunities | Innovative environmentSenior-level Full TimeSingapore, Singapore2d ago
-
Mid-level Full TimeSingapore, Singapore, Singapore2d ago
-
AI Engineer SGD 140K-201KAPI Development | Arcpy | Data Pipelines | Deep learning | FMEComprehensive benefits | Flexible work options | Global project opportunities | Training and development programsSenior-level Full TimeSingapore, Singapore2d ago
-
AWS | Apache Spark | Azure | Cloud Platforms | CommunicationCompetitive benefits | Global impact projects | Inclusive work environment | Professional development | Work-life balanceMid-level Full TimeAero - 600 West Camp Road, …3d ago
-
AES | Audit Log | Audit Log Analysis | Azure DevOps | Azure MonitorSenior-level Full TimeNgee Ann Polytechnic, Clementi Campus, Singapore3d ago
-
APIs | Airflow | CI/CD | Data Quality | Data quality frameworksSenior-level Full TimeNgee Ann Polytechnic, Clementi Campus, Singapore3d ago
-
Algorithm & ML Staff Engineer SGD 96K-132KAlgorithm Development | Automation Pipelines | CI/CD | Cloud infrastructure | Communication skillsSenior-level Full TimeSingapore - Singapore - Block 33 …3d ago
-
Azure DevOps | Azure Synapse | Big Data | DAX | Data IngestionMid-level Full TimeSingapore, Singapore3d ago
-
ACR | Agile | Application Insights | Aqua | Azure DevOpsCollaborative team | Impactful AI products | Shape DevOps/MLOps cultureSenior-level Full TimeSingapore, Singapore3d ago
-
Data Analysis | Data Systems | Data Systems Design | Distributed Systems | High PerformanceMid-level Full TimeSingapore, Singapore3d ago
-
AWS | Airflow | DBT | Data Modeling | Data PipelinesSenior-level Full TimeSingapore3d ago
-
Senior-level Full TimeCrimson House Singapore4d ago
-
Senior Production/ Production Engineer (Contract) SGD 100K-120KAWS | Agile methodologies | Ansible | Apache | BitbucketSenior-level Contract Full TimeMAS: MAS Building, Singapore4d ago
-
Staff Machine Learning Engineer SGD 106K-148KAI/ML | AI/ML algorithms | AWS | Azure | Data AnalysisComprehensive benefits | Financial security support | Flexible work culture | Healthcare coverage | Mental health resourcesSenior-level Full TimeSGP - Central Singapore - Corp …4d ago
-
Big Data | Big-data frameworks | Data Frameworks | Data Management | Data StorageMid-level Full TimeSingapore, Singapore4d ago
-
Senior-level Full TimeSingapore, Singapore, Singapore4d ago
-
AI Engineer SGD 150K-203KAPI Development | Arcpy | AutoCAD Civil | AutoCAD Civil 3D | BIMDental | Disability benefits | Employee assistance | Employee stock purchase | Flexible workSenior-level Full TimeSingapore, Singapore5d ago
-
AI | Computational Algorithms | Generative AI | Machine Learning | NumPyCompetitive rates | Experience with advanced AI projects | Flexible remote work | Part-time | Portfolio enhancementMid-level FreelanceSingapore - Remote R5d ago