Lead Data Engineer ID71008
Medellín, Colombia
COP 89364K-100000K (estimate) Senior-level Full Time
Tasks
- Coordinate AWS infrastructure requirements with DevOps
- Define partitioning and file format strategy
- Design analytical architecture for OLAP workloads
- Design data pipelines for ETL
- Design schema and data type strategy
- Guide developers and ensure engineering practices
- Implement near real time processing
- Integrate data lake with Athena and query engines
- Orchestrate batch workflows with DAGs
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Flexible hours
- Mentorship
- People focused support
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
AI Assisted Development | Amazon S3 | Apache Airflow | Athena | BigQuery | ClickHouse | Code review | DAG | Data Lake | Data pipeline | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | Near-real-time | OLAP | ORC | Object storage | Parquet | PostgreSQL | Presto | Python | REST | Real Time | Schema Design | Serverless | Snowflake | Spark SQL | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | GCPAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | Learning budgetSenior-level Full TimeCali, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | GCPFlexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeVillavicencio, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data Quality | Data cloud | ELTFlexible hours | Internal tech talks | Learning budget | Mentorship | Remote workSenior-level Full TimePereira, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM data | DBT | Data cloud | ELTAnnual learning budget | Flexible hours | Mentorship | Remote work | Support programsSenior-level Full TimeBucaramanga, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | ELTAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Performance and compensation reviewsSenior-level Full TimeManizales, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data Modeling | Data Quality | Data cloudFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeMedellín, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAWS | Airflow | Amazon Bedrock | Amazon EKS | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeBogota, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | AWS S3 | Amazon Athena | Apache AirflowAnnual learning budget | Flexible hours | Local support | Mentorship | Performance and compensation reviewsSenior-level Full TimeBucaramanga, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | AWS | Airflow | Amazon S3Annual learning budget | Annual performance reviews | Flexible hours | Mentorship | No micromanagementSenior-level Full TimeBarranquilla, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | Airflow | Amazon S3 | Apache Spark | AthenaAnnual learning budget | Flexible hours | Mentorship | People focused support | Performance reviewsSenior-level Full TimeManizales, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon Athena | Amazon S3Annual learning budget | Flexible hours | Internal TechTalks | Mentorship | Remote workSenior-level Full TimeCali, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon Athena | Amazon EKSAnnual learning budget | Annual performance and compensation reviews | Flexible hours | Internal TechTalks | Learning budgetSenior-level Full TimeVillavicencio, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon S3 | AthenaAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimePereira, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeCartagena, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | DBT | Data Modeling | Data Quality | Data cloudFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeBarranquilla, Colombia6h ago
-
Senior Data Engineer ID71671 COP 88000K-106000KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDAnnual TechTalks | Challenging projects | Collaborative culture | Flexible hours | Learning budgetSenior-level Full TimeCartagena, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | DBT | Data cloud | GCP | PythonFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeBogota, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data cloud | ELT | ETLAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeCartagena, Colombia6h ago
-
LATAM_Artificial Intelligence Engineer COP 51919K-55752KAWS | CI/CD | Embeddings | Faiss | Generative AIMid-level Full TimeBogotá, Colombia1d ago
-
Lead / Principal Data Engineer - DBT & Databricks USD 180K-250KAzure | Azure Databricks | CI/CD | Cause analysis | DBTRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
Senior Data Engineer EUR 46K-51KDBT | Data Architecture | Data Governance | Data Migration | Data ModelingRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
Senior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
Senior AI Automation Engineer USD 133K-200KAI Governance | API Integration | Alerting | Automation Anywhere | Azure OpenAISenior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
Senior Data Engineer EUR 46K-51KAPI Integrations | AWS | Agile | Aurora PostgreSQL | CD pipelinesRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
APIs | AWS | Data Infrastructure | Distributed Systems | GCPRemote workSenior-level Full TimeBrazil R4d ago