Lead Data Engineer ID71008
Medellín, Colombia
R
COP 84000K-94620K (estimate) Senior-level Full Time
Tasks
- Define data lake architecture
- Deploy and manage data workloads on Kubernetes
- Design near real time processing
- Design partitioning and file formats
- Design schema and data type strategy
- Drive AWS data ecosystem
- Lead developers and align engineering practices
- Manage DAG dependencies and triggers
- Orchestrate batch workflows with Airflow
- Own ETL pipelines
- Partner with DevOps on requirements
- Review pull requests and enforce code quality
Perks/Benefits
Skills/Tech-stack
AWS | Amazon Athena | Amazon S3 | Apache Airflow | BigQuery | ClickHouse | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | ORC | Object storage | Parquet | PostgreSQL | Presto | Python | REST | Schema Design | Snowflake | Spark SQL | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Senior Full Stack Engineer ID78855 COP 80000K-89988KCI/CD | Cloud Computing | Databases | Docker | KubernetesAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimePereira, Colombia R20h ago
-
Senior Full Stack Engineer ID78855 COP 80000K-89988KCI/CD | Cloud Computing | Databases | Docker | KubernetesChallenging projects | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeBucaramanga, Colombia R20h ago
-
Senior Full Stack Engineer ID78855 COP 80000K-89988KCI/CD | Claude Code | Cloud | Cursor | DatabasesAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeCartagena, Colombia R20h ago
-
Senior Full Stack Engineer ID78855 COP 80000K-89988KCI/CD | Cloud | Database | Docker | KubernetesAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeCali, Colombia R20h ago
-
Senior Full Stack Engineer ID78855 COP 80000K-89988KCI/CD | Cloud | Databases | Docker | KubernetesAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipSenior-level Full TimeBogota, Colombia R20h ago
-
Senior Full Stack Engineer ID78855 COP 80000K-89988KAI | CI/CD | Cloud | Databases | DockerChallenging projects | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeBarranquilla, Colombia R20h ago
-
Senior Full Stack Engineer ID78855 COP 80000K-89988KCI/CD | Cloud Computing | Databases | Docker | KubernetesAnnual learning budget | Challenging projects | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeMedellín, Colombia R20h ago
-
Senior Full Stack Engineer ID78855 COP 80000K-89988KCI/CD | Cloud Computing | Databases | Docker | KubernetesAnnual learning budget | Challenging projects | Flexible hours | Mentorship | People focused supportSenior-level Full TimeVillavicencio, Colombia R20h ago
-
Senior Full Stack Engineer ID78855 COP 80000K-89988KCI/CD | Cloud Computing | Databases | Docker | KubernetesFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeManizales, Colombia R20h ago
-
Azure Data Lake (ADLS) Data Platform Specialist COP 50004K-54000KAccess Control | Access Control Lists | Apache Spark | Azure Data | Azure Data FactoryContinued education support | Employee recognition program | Flexible working | Healthcare | Learning and developmentMid-level Full TimeCO, BOGOTA, Office, Colombia, LATAM R1d ago
-
Senior-level Full TimeAnywhere Colombia, Colombia R1d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS EKS | Amazon S3 | Apache Airflow | Athena | BigQueryFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeVillavicencio, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAI Development | AI development tools | AWS Bedrock | Amazon EKS | Amazon S3Flexible hours | Internal TechTalks | Learning budget | Mentorship | People focused supportSenior-level Full TimeManizales, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Amazon Athena | Amazon EKS | Amazon S3 | Apache AirflowFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeCartagena, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Airflow | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workSenior-level Full TimeCali, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Airflow | Athena | BigQuery | Claude CodeFlexible hours | Internal technical talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeBarranquilla, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Airflow | Amazon Athena | Amazon S3 | Apache SparkAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimePereira, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS Athena | Airflow | Amazon S3 | Apache Spark | BigQueryAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeBucaramanga, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAmazon EKS | Amazon S3 | Apache Airflow | Apache Parquet | AthenaAnnual learning budget | Flexible hours | Internal technical talks | Mentorship | People focused supportSenior-level Full TimeBogota, Colombia R2d ago
-
Lead Data Scientist, AdTech COP 72000K-73200KAWS | Ad Tech Modeling | Ad-Tech | Collaborative Filtering | Content-Based FilteringSenior-level Full TimeBarranquilla, Colombia (remote); Bogota, Colombia (remote); … R3d ago
-
Lead Applied Scientist, Marketing COP 72000K-73200KAWS | Adtech | Collaborative Filtering | Content-Based Filtering | Content-basedSenior-level Full TimeBarranquilla, Colombia (remote); Bogota, Colombia (remote); … R3d ago
-
Data Engineer COP 39600K-39600KAWS Glue | AWS Step Functions | Amazon Athena | Amazon S3 | Batch IngestionAt home medical assistance | Christmas kit | Day off for academic graduation | Family day | Forgivable education loansMid-level Full TimeBogotá, Bogota, Colombia R3d ago
-
Senior AI Engineer (LLMs & Agentic AI) COP 89364K-94620KAgentic AI | Anthropic API | CI/CD | Context Management | GPU AccelerationConfidentiality per EEO guidelines | Remote work with overlapping business hoursSenior-level Full TimeBogotá, Bogota, Colombia R3d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Data CatalogAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workMid-level Full TimeBarranquilla, Colombia R3d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportMid-level Full TimeManizales, Colombia R3d ago