Data engineer (Azure)
Tasks
- Build Power BI reports and dashboards
- Create data ingestion pipelines
- Deploy pipeline artifacts with Azure Devops
- Design data connections to on prem databases APIs and IoT devices
- Develop Pyspark scripts
- Implement row level security
- Ingest data using copy data activities
- Integrate data with database joins
- Manage data in storage and database solutions
- Orchestrate data pipelines
- Test and troubleshoot data pipelines
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Explorer | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Copy Data Activity | DAX | Data Explorer | Data Ingestion | Data Marts | Data Warehouse | Data pipeline | Data pipeline orchestration | ETL | Hadoop | Pipeline Orchestration | Power BI | PySpark | Python | Row Level Security | SAP HANA | SQL | SQL Server | Synapse Analytics
Education
Roles
Related jobs
-
Automation | Distributed Systems | Linux | Monitoring | Performance AnalysisCareer development | MentorshipEntry-level InternshipSingapore, Singapore6h ago
-
Core Engineering, Applied AI, Senior AI/ML Quant Research Engineer, Vice President, Singapore SGD 150K-186KContainerization | Continuous Deployment | Continuous integration | Data Pipelines | Deep learningSenior-level Full TimeSingapore, Singapore, Singapore15h ago
-
Containerization | Continuous Deployment | Continuous integration | Data Pipelines | Deep learningMid-level Full TimeSingapore, Singapore, Singapore16h ago
-
Analytics | Application Programming | Application Programming Interfaces | Backend Development | Cloud ComputingMid-level Full TimeSingapore, Singapore, Singapore1d ago
-
Data Engineer (Data Programme) - A26110 SGD 60K-80KCloud infrastructure | Data Architecture | Data Pipelines | Database Administration | DevOpsEmployee wellness program | Growth opportunities | Structured development framework | Work in Singapore Government Agencies projectsMid-level Contract Full TimeSingapore, Singapore, Singapore1d ago
-
AWS S3 | Azure Blob | Azure Blob Storage | Backup Retention | Backup administration24x7 on-call rotation | Contract positionSenior-level Contract Full TimeMAS: MAS Building, Singapore1d ago
-
Principal Engineer, Machine Learning, SMAI SGD 96K-155KAgentic AI | Auto RL | Autogen | BF16 | Big DataSenior-level Full TimeFab 10A, Singapore1d ago
-
Amazon Web Services | Apache Avro | Apache Beam | Apache Flink | Apache HadoopSenior-level Full TimeSingapore, Singapore2d ago
-
BigQuery | Cloud Data Catalog | Cloud Functions | Cloud Storage | Cloud platformMid-level Full TimeSingapore, Singapore2d ago
-
Mid-level Full TimeSingapore, Singapore2d ago
-
ARM Templates | Alerting | Application Insights | Aqua Security | Azure ContainerSenior-level Full TimeSingapore, Singapore2d ago
-
Machine Learning Engineer - Search E-Commerce SGD 30K-36KComputer Vision | Information Retrieval | Language Processing | Machine Learning | Model DeploymentMid-level Full TimeSingapore, Singapore2d ago
-
Senior Data Management Professional - Data Engineering - Listed Derivatives Data, Singapore SGD 113K-142KAmazon S3 | Business Rules | Data Governance | Data Pipelines | Data QualitySenior-level Full TimeSingapore2d ago
-
Senior-level Full TimeSingapore, Singapore2d ago
-
Data collection | Deep learning | Feature Engineering | Foundation Models | Language ProcessingCredit bearing internshipEntry-level InternshipSingapore, Singapore2d ago
-
Senior-level Full TimeSingapore2d ago
-
Senior-level Full TimeFab 10A, Singapore2d ago
-
Associate Machine Learning Engineer SGD 95K-140KAWS | Azure | CI/CD | Data Preprocessing | Data VisualizationMid-level Full TimeSG Ensign Kallang Place, L9 (Right …2d ago
-
Senior Staff Machine Learning Engineer SGD 120K-135KA/B | A/B Testing | AWS | AWS Batch | Amazon RDSHybrid work schedule | Remote work flexibilitySenior-level Full TimeSingapore - All - Fully Flexible2d ago
-
Entry-level Full TimeSINGAPORE, Singapore2d ago
-
Mid-level Full TimeSingapore3d ago
-
Data Engineer Intern SGD 65K-65KAzure AI | CRM | Data Preparation | Data cleaning | Data labelingCross-functional projects | Mentorship | Portfolio buildingEntry-level Full Time InternshipSingapore3d ago
-
Component Engineer – Data Analytics SGD 78K-95KAPI Integration | Azure Data | Azure Data Factory | BOM | DAXMid-level Full TimeSingapore, Singapore, Singapore4d ago
-
AWS Athena | AWS Glue | AWS SageMaker | Agile | Amazon RDSEmployee wellness program | Growth opportunities | Structured development frameworkMid-level Full TimeSingapore, Singapore, Singapore4d ago
-
AWS | Azure | Cloud platform | Data Pipelines | Data WarehousingEmployee wellness program | Fun working environment | Growth opportunities | Structured development frameworkMid-level Full TimeSingapore, Singapore, Singapore4d ago