Engineer - Data Engineering
Tasks
- Apply DevOps principles across software lifecycle
- Build and maintain data pipelines
- Collaborate in cross-functional agile team
- Design and develop data solutions
- Develop and maintain ETL/ELT pipelines
- Ensure code quality using software engineering best practices
- Follow continuous integration and continuous delivery
- Implement distributed highly available data processing applications
- Implement streaming data processing
- Integrate multiple source systems and targets
- Process large volumes of data
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Airflow | Amazon EMR | Amazon Web Services | Apache Hive | Apache Kafka | Apache Spark | Apache Storm | BigQuery | Cloud Composer | Cloud DataStream | Cloud Dataflow | Cloud Dataproc | Cloud Functions | Cloud PubSub | Cloud Run | Cloud platform | Data pipeline | ELT | ETL | Google Cloud | Google Cloud Platform | Google Cloud PubSub | NoSQL Databases | PubSub | Python | Relational databases | SQL | Shell | Streaming | Web Services
Education
Roles
Related jobs
-
AI Engineer LKR 720K-960KAI Agent framework | AI Foundry | AI Services | API Integration | Agent FrameworkHybrid workEntry-level Full TimeColombo, Western Province, Sri Lanka1d ago
-
Mid-level Full TimeKotugoda, Sri Lanka1d ago
-
CI/CD | Dashboard Development | Data Governance | Data Quality | Data ValidationCulture of growth | Exceptional peers | Flexible working arrangements | Impactful work | State-of-the-art resourcesEntry-level Contract InternshipColombo7d ago
-
AWS | Azure | CI/CD | Cloud Native | Cloud Native ArchitectureCareer growth | Flexible working environment | Inclusive culture | Remote-friendly cultureSenior-level Full TimeColombo8d ago
-
Associate DevOps Engineer LKR 960K-960KAmazon Web Services | Ansible | CI/CD | Cloud platform | DockerFlexible work schedule | On-site workMid-level Full TimeBattaramulla, Sri Lanka20d ago
-
Software Engineer LKR 960K-960KDistributed Systems | GRPC | Go | Helm | JavaCareer growth | Flexible working environment | Mentorship | Remote-friendly cultureMid-level Full TimeColombo25d ago
-
Applied AI Engineer - IFS Loops LKR 960K-960KAI orchestration | API | Application Integration | CRM | Data FlowHybrid workMid-level Full TimeColombo, Western Province, Sri Lanka28d ago
-
AWS CloudFormation | AWS DocumentDB | AWS RDS | Amazon ECS | Amazon Web ServicesOn-call support rotationMid-level Full TimeLK-1-Colombo1mo ago
-
CI/CD | Cloud Computing | Containerization | Experiment tracking | Feature StoreEntry-level Full TimeColombo, LK1mo ago
-
Agile | Apache Hadoop | Apache Spark | Azure | Azure DataEntry-level Full TimeColombo, LK1mo ago
-
AI Services | AWS ECS | AWS Fargate | AWS Lambda | AWS S3Hybrid workSenior-level Full TimeSysco LABS - Sri Lanka1mo ago
-
Senior-level Full TimeLK-1-Colombo1mo ago
-
AWS | Agent Orchestration | CI/CD | Django | DockerDiversity and inclusion focus | Hybrid work options | Inclusive workplace | Sustainability-focused organizationSenior-level Full TimeColombo, Western Province, Sri Lanka1mo ago