Data engineer (Azure)
Tasks
- Build Power BI reports and dashboards
- Connect source systems using on prem databases APIs and IoT devices
- Deploy pipeline artifacts using Azure Devops
- Design and manage data storage using file systems and SQL servers
- Develop Pyspark scripts
- Implement row level security using DAX
- Integrate data using table joins
- Orchestrate data pipelines
- Perform batch ingestion using copy data activities
- Test and troubleshoot data pipelines
Perks/Benefits
Skills/Tech-stack
Azure | Azure Data | Azure Data Explorer | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Copy Data | Copy Data Activity | DAX | Data Explorer | Data Warehouse | Database Table Joins | ETL | HANA | Hadoop | Power BI | PySpark | Python | Row Level Security | SQL | Synapse Analytics | Table Joins
Education
Roles
Related jobs
-
.NET | AKS | App Service | Azure App | Azure App ServiceMid-level Full TimeSingapore, Singapore5h ago
-
.NET | API Design | Agent Orchestration | App Service | Azure AppSenior-level Full TimeSingapore, Singapore5h ago
-
Analyst - Data Science SGD 143K-220KC++ | Data Processing | Deep learning | Experimentation | Generative AICareer growth | Holistic well-being support | Leadership development | Learning opportunitiesMid-level Full TimeSingapore16h ago
-
Machine Learning Engineer SGD 150K-220KArgo CD | Azure DevOps | CI/CD | Cloud Build | Cloud NetworkingCareer coaching | Employee assistance programme | Flexible working hours | Hybrid work | Internal tech communitiesMid-level Full TimeSingapore, Singapore16h ago
-
Mid-level Full TimeSingapore, Singapore, Singapore18h ago
-
Engineer (Robotics) / School of Engineering SGD 74K-74K6DoF Pose Estimation | Actuator Drivers | Body Dynamics | C++ | Circuit debuggingSenior-level Full TimeTemasek Polytechnic, Singapore18h ago
-
Data Engineer SGD 75K-108KABAC | API Design | AWS | Amazon Athena | Amazon RedshiftAnnual leave | Birthday leave | Collaborative environment | Family care leave | Learning cultureMid-level Full TimeSingapore, Singapore, Singapore18h ago
-
AI Solution Architect - BytePlus SGD 90K-165KApache Flink | Apache Spark | Caching | Docker | FastAPISenior-level Full TimeSingapore, Singapore1d ago
-
Machine Learning Engineer Graduate (Global E-Commerce, Recommendation) - 2026 Start (BS/MS) SGD 70K-91KA/B | A/B Testing | B testing | Data Pipelines | Data ProcessingEntry-level Full TimeSingapore, Singapore1d ago
-
Anomaly Detection | Data Analysis | Data Pipelines | Fraud Detection | Machine LearningEntry-level Full TimeSingapore, Singapore1d ago
-
Data Mining | Data Modeling | Data Visualization | Distributed Systems | ETLSenior-level Full TimeSingapore, Singapore1d ago
-
Data Mining | Data Modeling | Data Visualization | Distributed Systems | HadoopSenior-level Full TimeSingapore, Singapore1d ago
-
Apache Hadoop | Apache Spark | Data Mining | Data Modeling | Data VisualizationSenior-level Full TimeSingapore, Singapore1d ago
-
Apache Kafka | Data Engineering | Go | Hadoop | JavaEntry-level Full TimeSingapore, Singapore1d ago
-
Compiler optimization | Deep learning | Distributed Systems | Elastic Scheduling | GPU ComputingMid-level Full TimeSingapore, Singapore1d ago
-
Data integration | Distributed Systems | Java | Metadata Management | PythonEntry-level Full TimeSingapore, Singapore1d ago
-
Machine Learning Engineer Graduate (Global E-Commerce, Recommendation Alliance) - 2026 Start (BS/MS) SGD 66K-68KData Mining | Data Modeling | Data pipeline | ETL | Language ProcessingEntry-level Full TimeSingapore, Singapore1d ago
-
Machine Learning Engineer - Search E-Commerce SGD 56K-80KA/B | A/B Testing | B testing | Computer Vision | Data AnalysisEntry-level Full TimeSingapore, Singapore1d ago
-
Anti-Fraud | Computer Vision | Data Engineering | Data Pipelines | Deep learningEntry-level Full TimeSingapore, Singapore1d ago
-
Big Data | Data Modeling | Data Warehouse | ETL | Real TimeSenior-level Full TimeSingapore, Singapore1d ago
-
Senior-level Full TimeSingapore, Singapore1d ago
-
Cause analysis | Go | Java | Linux | MonitoringCareer development | Mentorship | On-the-job trainingEntry-level InternshipSingapore, Singapore1d ago
-
Data Mining | Data Processing | ETL | Experimentation | Information RetrievalEntry-level Full TimeSingapore, Singapore1d ago
-
Data Pipelines | Domain Randomization | Imitation Learning | IsaacGym | IsaacLabMid-level Full TimeSingapore1d ago
-
C++ | Contact Rich Control | Control Theory | Data collection | Grasp PlanningCompetitive compensation | Equity | Open Source contributionMid-level Full TimeSingapore1d ago