Data engineer (Azure)
Tasks
- Connect to source systems
- Deploy pipeline artifacts with Azure Devops
- Design Pyspark scripts
- Develop Power BI reports and dashboards
- Implement row level security
- Ingest batch data using copy data activities
- Integrate data using table joins
- Manage data in storage and database systems
- Orchestrate data pipelines
- Test and troubleshoot data pipelines
Perks/Benefits
Skills/Tech-stack
API | Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics | DAX | Data Explorer | Data Factory | Data Warehouse | ETL | HANA | Hadoop | IoT | Power BI | PySpark | Python | Row Level Security | SQL | Synapse Analytics
Education
Roles
Related jobs
-
Capacity Planning | Computer Vision | Deep reinforcement learning | LLM | Language ModelsMid-level Full TimeSingapore, Singapore8h ago
-
Data Center Production Operations Engineer SGD 150K-203KBash | DHCP | DNS | Data analytics | Data center24/7 on-call rotation | Travel up to 15 percentSenior-level Full TimeSingapore9h ago
-
Data Center Production Operations Engineer SGD 53K-96KAutomation | Bash | Cause analysis | DHCP | DNS247 on call rotation | Travel up to 15 percent timeMid-level Full TimeSingapore9h ago
-
Backend Software Engineer, Manus SGD 140K-143KAPI Design | AWS | Azure | Best practices | Bias MitigationMid-level Full TimeSingapore9h ago
-
AI Engineer (Data and Analytics Department) SGD 140K-200KCI/CD | Continuous Training | Data Drift | Data Drift Detection | Deep learningSenior-level Full TimeEMA HQ, Singapore21h ago
-
Data Engineer (Data and Analytics Department) SGD 18K-27KAWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3None Full TimeEMA HQ, Singapore21h ago
-
Manager/Assistant Director (Data Platform Engineer) SGD 245K-375KAWS | Access Management | Agile | Azure | Azure SynapseExecutive-level Full TimeSFA - JEM, Singapore21h ago
-
Finance Operations (FinOps) Analytics Architect (with Agentic AI Expertise) - Vice President SGD 120K-185KAWS | Agent systems | Anomaly Detection | Azure | BudgetingHybrid workSenior-level Full Time3 CHANGI BUSINESS PARK CRESCENT CHANGI …21h ago
-
Software Engineering, Machine Learning (Singapore) SGD 60K-108KAgent Orchestration | Artificial Intelligence | Bias Mitigation | Data Mining | JavaScriptEntry-level Full TimeSingapore1d ago
-
Data Engineer SGD 57K-70KApache Hive | Apache Spark | Azure DevOps | Azure Machine Learning | CI/CDEntry-level Full TimeSingapore, Singapore, Singapore1d ago
-
Staff Data Engineer SGD 108K-180KApache Airflow | Apache Flink | Apache Kafka | Data Governance | Data ManagementEquity | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeSG - Singapore1d ago
-
Director, Compliance Data Science & AI SGD 160K-250KAML detection | Anomaly Detection | Blockchain data | Customer Risk Rating | Graph analyticsCompany events | Education subsidy | Healthcare coverage | L and D programs | Meal allowancesExecutive-level Full TimeSingapore, Singapore1d ago
-
Senior Engineer Team Lead (Data Science) SGD 96K-132KData Exploration | Data Pipelines | Data Validation | Data Visualization | Data dashboardsSenior-level Full TimeSingapore, SG1d ago
-
AWS | Azure | CI/CD | Cloud platform | Computer VisionCollaborative work culture | MentorshipEntry-level Full TimeNTU Main Campus, Singapore1d ago
-
Entry-level Full TimeNTU Main Campus, Singapore1d ago
-
Computational Neuroscience | Data Analysis | Deep learning | Deep reinforcement learning | Experiment designMid-level Full TimeNTU Main Campus, Singapore1d ago
-
AWS | Ansible | Azure | Bash | CI/CDContinuous learning | Mentorship opportunities | Professional developmentMid-level Full TimeNTU Main Campus, Singapore1d ago
-
AWS | Ansible | Azure | Bash | CI/CDContinuous learning | Professional developmentMid-level Full TimeNTU Main Campus, Singapore1d ago
-
AWS | Agile | Ansible | Azure | BashContinuous learning | Flexible experimentation culture | Mentorship opportunities | Professional developmentMid-level Full TimeNTU Main Campus, Singapore1d ago
-
AWS | Ansible | Azure | Bash | CI/CDContinuous learning | Professional developmentMid-level Full TimeNTU Main Campus, Singapore1d ago
-
Senior-level Contract Full TimeSingapore, Singapore, Singapore1d ago
-
Capacity | Cost modeling | Cross Sectional Prediction | Cross-validation | Data CurationSenior-level Full TimeEISG | Singapore – Marina One1d ago
-
Senior Software Engineer SGD 160K-221KAPI Design | Agile | C++ | Deep learning | Development Life CycleSenior-level Full TimeSingapore, Singapore1d ago
-
Senior Executive, AI Engineer SGD 108K-150KAgentic Workflows | Anomaly Detection | Artificial Intelligence | Attack surface monitoring | Cyber Kill ChainSenior-level Full TimeSingapore, SG1d ago
-
ARM Templates | Azure DevOps | Azure Key Vault | Azure Kubernetes | Azure Kubernetes ServiceCollaborative team | Impactful AI and data products | Shape DevOps and MLOps cultureSenior-level Full TimeSingapore, Singapore2d ago