Lead Data Engineer
Tasks
- Build and maintain ETL/ELT pipelines
- Collaborate with ML and analytics teams to operationalize ML workflows
- Create and manage scalable feature stores
- Design and deliver cloud native data solutions on AWS
- Improve production data platform performance reliability and scalability
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Batch | AWS Lambda | AWS Wrangler | Bash | Boto3 | Data Governance | Data Modeling | Data Privacy | Data Quality | ELT | ETL | Linux | MLOps | Model Deployment | Monitoring | NumPy | Pandas | Python | Query Optimization | S3 | SQL | Serverless | Version control
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
APIs | Design Patterns | FastAPI | Flask | Generative AIAccess to training | Flexible work environment | Long-term employment opportunity | Work with global clientsMid-level Full TimeColombo, Sri Lanka4h ago
-
AWS | Automated testing | Azure | CI/CD | Data EngineeringHybrid work | Night shiftSenior-level Full TimeBattaramulla, Sri Lanka R5d ago
-
Senior-level Full TimeColombo, Sri Lanka7d ago
-
Senior-level Full TimeColombo, Sri Lanka12d ago
-
Senior-level Full TimeColombo, Sri Lanka12d ago
-
Software Engineer I (Data Science AI) LKR 960K-960KData Visualization | Deep learning | Docker | Kubernetes | Language ProcessingEntry-level Full TimeSL Sri Jayewardenepura Kotte, Sri Lanka14d ago
-
Mid-level Full TimeLK-1-Colombo17d ago
-
Senior-level Full TimeLK-1-Colombo17d ago
-
Senior-level Full TimeLK-1-Colombo17d ago
-
API Gateway | AWS | AWS Well Architected | AWS Well-Architected Framework | AgileCareer growth plan | Flexible work options | Internal conferences | Knowledge sharing sessions | MentorshipSenior-level Full TimeColombo, Sri Lanka R20d ago
-
Mid-level Full TimeColombo, Sri Lanka20d ago
-
Senior-level Full TimeSL Sri Jayewardenepura Kotte, Sri Lanka20d ago
-
Senior-level Full TimeColombo, Sri Lanka21d ago
-
Mid-level Full TimeColombo, Sri Lanka21d ago
-
AWS | Access Control | Apache Spark | Audit Logging | ContainerizationCareer excellence program | Employee assistance program | Engagement events | Flexible work | Fruits and nuts Mondays and WednesdaysSenior-level Full TimeColombo, Sri Lanka21d ago
-
Associate/ Engineer - Artificial Intelligence LKR 960K-960KAgentic AI | Data Pipelines | Deep learning | Feature Engineering | Generative AIOn-site workMid-level Full TimeBattaramulla, Sri Lanka24d ago
-
Azure Fabric | Business Intelligence | Cloud services | Data Pipelines | Data TransformationInternational exposure | Medical insurance | Open work culture | Recognition appreciation | Recreational activities and eventsSenior-level Full TimeColombo, Western Province, Sri Lanka - … R25d ago
-
Azure | Azure Data | Azure Data Factory | Azure Fabric | Business IntelligenceInternational exposure | Medical insurance | Open work culture | Recreational activities | Training fundedSenior-level Full TimeColombo, Western Province, Sri Lanka - … R25d ago
-
Agent Orchestration | Artificial Intelligence | Distributed Systems | Embeddings | Graph DatabasesSenior-level Full TimeColombo, Sri Lanka1mo ago
-
AI Engineer LKR 720K-960KAI Agent framework | AI Foundry | AI Services | API Integration | Agent FrameworkHybrid workEntry-level Full TimeColombo, Western Province, Sri Lanka1mo ago
-
AWS | Azure | CI/CD | Cloud Native | Cloud Native ArchitectureCareer growth | Flexible working environment | Inclusive culture | Remote-friendly cultureSenior-level Full TimeColombo1mo ago
-
Associate DevOps Engineer LKR 960K-960KAmazon Web Services | Ansible | CI/CD | Cloud platform | DockerFlexible work schedule | On-site workMid-level Full TimeBattaramulla, Sri Lanka1mo ago
-
Software Engineer LKR 960K-960KDistributed Systems | GRPC | Go | Helm | JavaCareer growth | Flexible working environment | Mentorship | Remote-friendly cultureMid-level Full TimeColombo1mo ago