Lead Data Engineer
Tasks
- Build and maintain ETL/ELT pipelines
- Collaborate with ML and analytics teams to operationalize ML workflows
- Create and manage scalable feature stores
- Design and deliver cloud native data solutions on AWS
- Improve production data platform performance reliability and scalability
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Batch | AWS Lambda | AWS Wrangler | Bash | Boto3 | Data Governance | Data Modeling | Data Privacy | Data Quality | ELT | ETL | Linux | MLOps | Model Deployment | Monitoring | NumPy | Pandas | Python | Query Optimization | S3 | SQL | Serverless | Version control
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
AWS | Access Control | Apache Spark | Audit Logging | ContainerizationCareer excellence program | Employee assistance program | Engagement events | Flexible work | Fruits and nuts Mondays and WednesdaysSenior-level Full TimeColombo, Sri Lanka23h ago
-
Associate/ Engineer - Artificial Intelligence LKR 960K-960KAgentic AI | Data Pipelines | Deep learning | Feature Engineering | Generative AIOn-site workMid-level Full TimeBattaramulla, Sri Lanka3d ago
-
Azure Fabric | Business Intelligence | Cloud services | Data Pipelines | Data TransformationInternational exposure | Medical insurance | Open work culture | Recognition appreciation | Recreational activities and eventsSenior-level Full TimeColombo, Western Province, Sri Lanka - … R5d ago
-
Azure | Azure Data | Azure Data Factory | Azure Fabric | Business IntelligenceInternational exposure | Medical insurance | Open work culture | Recreational activities | Training fundedSenior-level Full TimeColombo, Western Province, Sri Lanka - … R5d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeColombo, Sri Lanka6d ago
-
Software Engineer LKR 960K-960KGRPC | Go | Helm | JVM | JavaFlexible working hours | Remote-friendly policiesMid-level Full TimeColombo8d ago
-
Agent Orchestration | Artificial Intelligence | Distributed Systems | Embeddings | Graph DatabasesSenior-level Full TimeColombo, Sri Lanka13d ago
-
AI Engineer LKR 720K-960KAI Agent framework | AI Foundry | AI Services | API Integration | Agent FrameworkHybrid workEntry-level Full TimeColombo, Western Province, Sri Lanka14d ago
-
Senior-level Full TimeColombo17d ago
-
AWS | Azure | CI/CD | Cloud Native | Cloud Native ArchitectureCareer growth | Flexible working environment | Inclusive culture | Remote-friendly cultureSenior-level Full TimeColombo22d ago
-
Access Control | Always On | Apache | Automation | Backup and RecoverySenior-level TemporaryColombo, Sri Lanka1mo ago
-
Associate DevOps Engineer LKR 960K-960KAmazon Web Services | Ansible | CI/CD | Cloud platform | DockerFlexible work schedule | On-site workMid-level Full TimeBattaramulla, Sri Lanka1mo ago
-
Software Engineer LKR 960K-960KDistributed Systems | GRPC | Go | Helm | JavaCareer growth | Flexible working environment | Mentorship | Remote-friendly cultureMid-level Full TimeColombo1mo ago
-
Engineer - Data Engineering LKR 960K-960KAWS Glue | AWS Lambda | Airflow | Amazon EMR | Amazon Web ServicesMid-level Full TimeSysco LABS - Sri Lanka1mo ago
-
Applied AI Engineer - IFS Loops LKR 960K-960KAI orchestration | API | Application Integration | CRM | Data FlowHybrid workMid-level Full TimeColombo, Western Province, Sri Lanka1mo ago
-
CI/CD | Cloud Computing | Containerization | Experiment tracking | Feature StoreEntry-level Full TimeColombo, LK1mo ago
-
Agile | Apache Hadoop | Apache Spark | Azure | Azure DataEntry-level Full TimeColombo, LK1mo ago