Data Engineer (IT Consulting)
Tasks
- Build data platforms
- Collaborate on data requirements
- Deliver secure reusable code
- Deploy and manage data platform on AWS
- Deploy and manage data platform on Azure
- Deploy and manage data platform on GCP
- Design ETL pipelines
- Develop data transformations
- Ensure data availability
- Ensure data integrity
- Improve data engineering practices
- Maintain data pipelines
- Manage Hadoop clusters
- Manage Kafka
- Manage Spark clusters
- Monitor data pipelines
- Translate requirements into technical specifications
- Troubleshoot data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Kafka | Apache Spark | Cloud platform | Data Visualization | ETL | Google Cloud | Google Cloud Platform | Hadoop | Microsoft Azure | Pentaho | Power BI | Python | SQL | SSIS | Tableau | Talend
Education
Roles
Related jobs
-
Software Engineer in Data (Senior) IDR 103200K-120000KAWS | Amazon Redshift | Apache Airflow | Apache Beam | Apache FlinkInternational team collaboration | Portfolio opportunity | Technical mentorshipSenior-level Full TimeJakarta, Jakarta, Indonesia12h ago
-
BJAK - Back End, AI SGD 140K-225KAPI Development | Alerting | Anthropic | Batching | CachingCash compensation | Equity compensation | Remote workSenior-level Full TimeEurope (remote) R2d ago
-
Technical Lead, Machine Learning THB 840K-840KDPO | Data Pipelines | Distributed Training | Fine Tuning | GPU infrastructureCareer growth opportunities | Equity compensation | Remote workSenior-level Full TimeRemote Europe R2d ago
-
Software Engineer, Data Infrastructure & Acquisition - Surabaya, Indonesia IDR 120000K-180000KBash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeSurabaya, Indonesia3d ago
-
Mid-level Full TimeJakarta Pusat, Indonesia4d ago
-
Entry-level Full TimeJakarta, Jakarta, Indonesia6d ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami7d ago
-
Mid-level Full TimeJakarta, South Jakarta, Indonesia7d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous work culture | Flexible, hands-off management | Friendly laid-back atmosphere | Work on socially impactful productMid-level Full TimeJakarta, Indonesia8d ago
-
Mid-level Full TimeJakarta Selatan, Jakarta, Indonesia12d ago
-
Applied AI Engineer (Indonesia) IDR 84000K-108000KAutomation | CRM | Compliance | Evaluation | Fraud DetectionEnglish working language | Fast hiring process | Remote workMid-level Full TimeIndonesia12d ago
-
Applied AI Engineer - AI Neobank App (Indonesia) IDR 78000K-108000KAPI Integration | Automation | Data integration | Evaluation | Fallback strategiesEnglish communication support | Remote workMid-level Full TimeIndonesia12d ago
-
AI Engineer Research & Innovation (Surabaya) IDR 78000K-108000KComputer Vision | Data Analysis | Generative AI | Hugging Face | Language ProcessingMid-level Full TimeSurabaya, East Java, Indonesia13d ago
-
Mid-level Full TimeJakarta, ID15d ago
-
Mid-level Full TimeJakarta, ID15d ago
-
Alerting | Amazon Web Services | Ansible | Cloud platform | DockerMid-level Full TimeJakarta, ID15d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Hands-off management | Portfolio and LinkedIn submission supportMid-level Full TimeYogyakarta, Indonesia18d ago
-
Mid-level Full TimeSurabaya, East Java, ID19d ago
-
Senior-level Full TimeJakarta, Indonesia20d ago
-
Mid-level Full TimeJakarta, Jakarta, Indonesia22d ago
-
Change Data Capture | Data Capture | Data loading | Database Views | ETLSenior-level Full TimeJakarta, Indonesia22d ago
-
CI/CD | ChatOps | Developer Portal | Distributed Systems | Event DrivenSenior-level Full TimeJakarta, Indonesia24d ago
-
Agile | Apache Spark | Azure Cognitive | Azure Cognitive Search | Azure DataMid-level Full TimeJakarta, Indonesia1mo ago
-
Staff Data Engineer IDR 86400K-103200KAgile | Amazon Redshift | Apache Airflow | Apache Kafka | BigQueryAgile working environment | Cross-functional collaboration | Mentorship and coachingSenior-level Full TimeJakarta1mo ago
-
AI/Machine Learning Engineer IDR 43510K-51979KAWS | Airflow | Amazon SageMaker | Apache Spark | CI/CDHybrid work with dedicated full office hours | MentorshipSenior-level Contract Full TimeJakarta, Jakarta, Indonesia1mo ago