Lead Data Engineer ID71008
Cali, Colombia
R
COP 84000K-94620K (estimate) Senior-level Full Time
Tasks
- Build ETL pipelines for extraction transformation validation
- Define partitioning file format schema strategies
- Deploy and operate AWS data lake stack
- Design analytical architecture for OLAP workloads
- Implement near real time processing
- Integrate with Athena for serverless queries
- Lead developers and align engineering practices
- Manage Airflow pipeline structure dependencies triggering
- Orchestrate scheduled batch workflows with DAGs
- Own data pipeline design
- Partner with DevOps for functional and non functional requirements
- Review pull requests and enforce code quality
- Run services on EKS Kubernetes
- Use S3 backed data lake
Perks/Benefits
- Annual learning budget
- Flexible hours
- Internal tech talks
- Mentorship
- Remote work
- Well-being programs
Skills/Tech-stack
AWS | Airflow | Athena | BigQuery | ClickHouse | DAG | Data Lake | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | OLAP | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Presto | Python | REST | S3 | Schema Design | Snowflake | Spark SQL | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
Related jobs
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS EKS | Amazon S3 | Apache Airflow | Athena | BigQueryFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeVillavicencio, Colombia R12h ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAI Development | AI development tools | AWS Bedrock | Amazon EKS | Amazon S3Flexible hours | Internal TechTalks | Learning budget | Mentorship | People focused supportSenior-level Full TimeManizales, Colombia R12h ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Amazon Athena | Amazon S3 | Apache Airflow | BigQueryFlexible hours | Learning budget | Mentorship | Remote work | TechtalksSenior-level Full TimeMedellín, Colombia R12h ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Amazon Athena | Amazon EKS | Amazon S3 | Apache AirflowFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeCartagena, Colombia R12h ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Airflow | Athena | BigQuery | Claude CodeFlexible hours | Internal technical talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeBarranquilla, Colombia R12h ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Airflow | Amazon Athena | Amazon S3 | Apache SparkAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimePereira, Colombia R12h ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS Athena | Airflow | Amazon S3 | Apache Spark | BigQueryAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeBucaramanga, Colombia R12h ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAmazon EKS | Amazon S3 | Apache Airflow | Apache Parquet | AthenaAnnual learning budget | Flexible hours | Internal technical talks | Mentorship | People focused supportSenior-level Full TimeBogota, Colombia R12h ago
-
Lead Data Scientist, AdTech COP 72000K-73200KAWS | Ad Tech Modeling | Ad-Tech | Collaborative Filtering | Content-Based FilteringSenior-level Full TimeBarranquilla, Colombia (remote); Bogota, Colombia (remote); … R22h ago
-
Lead Applied Scientist, Marketing COP 72000K-73200KAWS | Adtech | Collaborative Filtering | Content-Based Filtering | Content-basedSenior-level Full TimeBarranquilla, Colombia (remote); Bogota, Colombia (remote); … R22h ago
-
Data Engineer COP 39600K-39600KAWS Glue | AWS Step Functions | Amazon Athena | Amazon S3 | Batch IngestionAt home medical assistance | Christmas kit | Day off for academic graduation | Family day | Forgivable education loansMid-level Full TimeBogotá, Bogota, Colombia R1d ago
-
Senior AI Engineer (LLMs & Agentic AI) COP 89364K-94620KAgentic AI | Anthropic API | CI/CD | Context Management | GPU AccelerationConfidentiality per EEO guidelines | Remote work with overlapping business hoursSenior-level Full TimeBogotá, Bogota, Colombia R1d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Data CatalogAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workMid-level Full TimeBarranquilla, Colombia R1d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportMid-level Full TimeManizales, Colombia R1d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Data CatalogAnnual learning budget | Flexible hours | Mentorship | Remote work | Supportive cultureMid-level Full TimeVillavicencio, Colombia R1d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipMid-level Full TimeMedellín, Colombia R1d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsMid-level Full TimeBogota, Colombia R1d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Challenging projects | Flexible hours | Mentorship | Remote workMid-level Full TimeCali, Colombia R1d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access control RBAC | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportMid-level Full TimeCartagena, Colombia R1d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Flexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportMid-level Full TimePereira, Colombia R1d ago
-
Data Engineer USD 66K-81KAWS | Airflow | Amazon Redshift | Azure | BigQueryFlexible U S overlapping hours | Fully remote | Long-term contractSenior-level Contract Full TimeColombia - Remote R2d ago
-
Senior Data Engineer (Snowflake/SQL) - Software Industry COP 58800K-58800KAWS Aurora | AWS DMS | AWS Data | AWS Data Migration | AWS Data Migration ServicePaid time off | Remote work | Work autonomySenior-level Full TimeBogota R2d ago
-
API Integration | Agent Memory Management | Agent Orchestration | Agent memory | Application developmentFlexible communication in US business hours | Remote workSenior-level Full TimeColombia - Remote R4d ago
-
Data Scientist / Machine Learning Engineer USD 110K-133KAWS SageMaker | Agile | Apache Airflow | Azure Machine Learning | DBTEnglish communication | Remote workMid-level Full TimeBrazil / Colombia / Costa Rica … R4d ago
-
Machine Learning Engineer - IT COP 18396K-18396KBigQuery | CI/CD | Clean architecture | Computer Vision | Context engineeringHybrid workMid-level Full TimeBogotá,Colombia R6d ago