Data engineer (Azure)
Tasks
- Build Power BI reports and dashboards
- Connect to source systems using databases APIs and IoT
- Deploy pipeline artifacts with Azure Devops
- Design and develop Pyspark scripts
- Implement row level security with DAX
- Ingest data using copy data activities
- Integrate data using table joins
- Manage data in storage and database solutions
- Orchestrate data pipelines
- Test and troubleshoot data pipelines
Perks/Benefits
Skills/Tech-stack
API | Azure | Azure Data | Azure Data Explorer | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Copy Data | Copy Data Activity | DAX | Data Explorer | Data Mart | Data Warehouse | ETL | Hadoop | Power BI | PySpark | Python | Row Level Security | SAP HANA | SQL | Synapse Analytics
Education
Roles
Related jobs
-
.NET | AKS | Azure DevOps | Azure Functions | Azure OpenAIMid-level Full TimeSingapore, Singapore3h ago
-
Data Warehouse Engineer - Data Platform - TikTok SGD 128K-165KApache Flink | Apache Hive | Apache Kafka | Apache Spark | JavaSenior-level Full TimeSingapore5h ago
-
Data Engineer, Product Analytics SGD 136K-204KAgent Orchestration | Artificial Intelligence | Bias Mitigation | C# | C++Senior-level Full TimeSingapore6h ago
-
Lead AI Engineer SGD 153K-216KAgent automation | CI/CD | Clean Code | Generative AI | Knowledge Grounded Language ModelsSenior-level Full TimeSingapore17h ago
-
Ansible | ArgoCD | Automation | Bash | BitbucketSenior-level Full TimeDBS Asia Hub, Singapore17h ago
-
Algorithms | Bayesian statistics | Deep learning | Formal Methods | Language ModelsResearch collaboration opportunities | Research funding grant support | Teaching opportunitiesMid-level Full TimeNTU Main Campus, Singapore17h ago
-
Mid-level Full TimeSingapore, Singapore, Singapore17h ago
-
Control Theory | Domain Randomization | Dynamics | Imitation Learning | IsaacGymMid-level Full TimeSingapore1d ago
-
C++ | Dynamic Obstacle Avoidance | Embedded Systems | Footstep planning | LocalizationCompetitive compensation | EquitySenior-level Full TimeSingapore1d ago
-
VP of Research, Machine Learning SGD 120K-270KAgent systems | GPU | JAX | Knowledge Distillation | Machine LearningExecutive-level Full TimeSingapore R2d ago
-
Technical Lead, Machine Learning SGD 160K-225KBatch inference | Bias Evaluation | DPO | Data Pipelines | Fine TuningSenior-level Full TimeSingapore R2d ago
-
Staff Machine Learning Engineer SGD 150K-220KBias Evaluation | DPO | Data Pipelines | Evaluation | GPU OptimizationSenior-level Full TimeSingapore R2d ago
-
Senior Associate, Data Analytics and Machine Learning SGD 150K-238KCloud Computing | Cybersecurity | Dashboard Development | Data Engineering | Data GovernanceTransport providedSenior-level Full TimeSingapore - MTO AML2d ago
-
AWS | Anomaly Detection | Azure | Classification | ClusteringSenior-level Full TimeSingapore, Singapore3d ago
-
Senior-level Full TimeSingapore, Singapore3d ago
-
Agile | Application Insights | Azure DevOps | Azure Monitor | Azure ResourceCareer development resources | Training opportunitiesEntry-level Full TimeSingapore, Singapore3d ago
-
.NET | AKS | App Service | Azure App | Azure App ServiceMid-level Full TimeSingapore, Singapore3d ago
-
Capacity Planning | Distributed Systems | Docker | Grafana | KubernetesMid-level Full TimeSingapore, Singapore3d ago
-
Big Data | Data Catalog | Data pipeline | Distributed Systems | JavaEntry-level Full TimeSingapore, Singapore3d ago
-
API Design | Data Pipelines | Distributed Systems | Java | LinuxMid-level Full TimeSingapore, Singapore3d ago
-
TikTok LIVE - AI Data Operation Specialist SGD 140K-165KData Analysis | Data Preparation | Data Visualization | Data cleaning | Data labelingSenior-level Full TimeSingapore3d ago
-
Senior Data Engineer, Product Analytics, Payments SGD 162K-216KAnalytics infrastructure | Artificial Intelligence | Data Architecture | Data Governance | Data ModelingSenior-level Full TimeSingapore3d ago
-
Foundation Engineering, AI Platform, GenAI Search and Document Management Developer, Associate, Singapore SGD 146K-256KConcurrent programming | Distributed Systems | Elasticsearch | GRPC | JavaEntry-level Full TimeSingapore, Singapore, Singapore3d ago
-
Principal / Senior Engineer, Data Analytics & Management, Technical Operations Management SGD 120K-160KATDF | Automation | Cloud Architecture | Clustering Analysis | DashboardingSenior-level Full TimeSingapore, Singapore3d ago
-
Senior Data Analyst SGD 175K-204KAWS Athena | AWS Glue | Amazon EMR | Amazon QuickSight | Amazon RedshiftSenior-level Full TimeSingapore, Singapore3d ago