Data Engineer III - Python/Spark/AWS
Tasks
- Automate deployments and testing
- Build event-driven architectures
- Collaborate with business partners
- Deploy and maintain applications
- Design data storage and access
- Develop and maintain microservices
- Develop data pipelines
- Document data requirements
- Ensure data accuracy, completeness, and timeliness
- Implement cloud data solutions
- Integrate data into analytics platforms
- Process large scale data
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Certified | AWS Certified Data Engineer | AWS Certified Data Engineer Associate | AWS Certified Solutions Architect | AWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS Step Functions | Agile | Amazon Athena | Amazon EKS | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Spark | BigQuery | CI/CD | Certified Solutions Architect | Continuous Delivery | Continuous integration | DBT | Data Lakehouse | Data Warehousing | Databricks | Distributed Systems | Docker | End to End | End-to-End Testing | Infrastructure as Code | Integration Testing | Kafka | Kubernetes | NoSQL | PySpark | Python | REST APIs | SDLC | SQL | Snowflake | Solutions architect | Spark Structured Streaming | Step Functions | Structured Streaming | Terraform | Trino | Unit Testing | Web Services | “as-code”
Roles
Related jobs
-
Senior Machine Learning Engineer - Perception SGD 149K-220KBuild systems | Code review | Computer Vision | Control Management | Deep learningSenior-level Full TimeSingapore, Central, Singapore7h ago
-
Entry-level Full TimeSingapore R11h ago
-
AI machine learning | Advanced Analytics | Alerting | Anomaly Detection | Data GovernanceCareer growth opportunities | Mentorship | Platinum customer support exposureSenior-level Full TimeSingapore1d ago
-
Tech Lead, Machine Learning Engineer - Search E-commerce SGD 120K-165KAlgorithms | Behavioral Data | Computer Vision | Data Analysis | Data StructuresSenior-level Full TimeSingapore1d ago
-
Data Engineer SGD 100K-132KAWS Glue | AWS Lambda | AWS S3 | Amazon Athena | Apache AirflowFlexible work arrangements | Hybrid work environment | Innovation opportunities | Professional development | Wellbeing supportSenior-level Full TimeNLB National Library Building, Singapore1d ago
-
Anomaly Detection | CI/CD | Data Ingestion | Data Transformation | Data WarehousingAgile team environment | In-office four days per week | Professional growth | Work from home flexibilityEntry-level Full TimeSingapore, SG R1d ago
-
WeChat - Data & AI Analytics Intern SGD 65K-67KAI Agents | Apache Hive | Apache Spark | Data Pipelines | Data VisualizationFull-time employment | Mentorship | Paid internship | Work on real-world projectsEntry-level Full Time InternshipSingapore-CapitaSky1d ago
-
Big Data Development Engineer Intern SGD 72K-91KApache Flink | Apache Spark | C plus plus | ClickHouse | GoEntry-level Full Time InternshipSingapore-CapitaSky1d ago
-
ADS-B | Data Science | Deep learning | Machine Learning | OptimizationSenior-level Full TimeNTU Main Campus, Singapore1d ago
-
Critical Thinking | Data Analysis | Data Visualization | Design of Experiments | JMPCleanroom environment | Cross-functional collaborationEntry-level Full TimeSingapore2d ago
-
.NET | Azure DevOps | C# | Docker | FlutterMid-level Full TimeSingapore, Singapore2d ago
-
Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOps | Azure SynapseOnsite workMid-level Full TimeSingapore, Singapore2d ago
-
.NET | AKS | Agent Orchestration | Agent systems | App ServiceSenior-level Full TimeSingapore, Singapore2d ago
-
Domain Randomization | Imitation Learning | IsaacGym | IsaacLab | JAXMid-level Full TimeSingapore2d ago
-
C plus plus | Contact Rich Control | Control Theory | Data collection | Grasp PlanningCompetitive compensation | Equipment access | Equity | Open source contributionsMid-level Full TimeSingapore R2d ago
-
C++ | Dynamic Obstacle Avoidance | Embedded Systems | Footstep planning | Global planningCompetitive compensation | Equity | Open source contributionsSenior-level Full TimeSingapore2d ago
-
DevSecOps Engineer SGD 140K-170KAWS | Anonymization | Automated testing | Cloud Security | Data PrivacySenior-level Full TimeSingapore2d ago
-
Forward Deployed Engineer, Data, GenAI, Google Cloud SGD 112K-200KBatch Processing | BigQuery | DBT | Data Lakes | Data ModelingMid-level Full TimeSingapore2d ago
-
APIs | AWS | Authentication | CI/CD | CachingHigh travel opportunitiesSenior-level Full TimeSingapore2d ago
-
Customer Success Physicist SGD 72K-90KAtoms | Control Systems | Experimental quantum information | Experimental quantum information science | Information scienceTravel for customer engagementMid-level Full TimeSingapore, SG2d ago
-
Lead Data Engineer, Analytic Platform SGD 162K-245KAPI Wrappers | Agent systems | Asyncio | Backend system architecture | Cost OptimizationBirthday leave | Employee assistance program | Flexible work arrangements | Medical insurance | Parental leaveSenior-level Full TimeSingapore, Singapore2d ago
-
AI/ML Customer Engineer SGD 175K-225KAgentic Workflows | Air-gapped | Air-gapped networks | C# | C++Access to emerging hardware technologies | Open Source contribution | Remote work flexibility | Technical career growthSenior-level Full TimeSingapore R2d ago
-
Artificial Intelligence | Cloud Computing | Data Analysis | Data Mining | Data VisualizationEntry-level Full TimeFab 10A, Singapore2d ago
-
Data Science & AI Automation Lead SGD 162K-216KAPI Integration | Cloud | Data Engineering | Generative AI | Intelligent AutomationSenior-level Full TimeSG003 Science Park Drive (Ascent), Singapore2d ago
-
Actuator integration | BACnet | Block programming | C# | C++Cross-disciplinary collaboration | Industry consultancy experience | Professional development trainingSenior-level Full TimeNgee Ann Polytechnic, Clementi Campus, Singapore2d ago