Lead Data Engineer ID71008
Manizales, Colombia
COP 89364K-100000K (estimate) Senior-level Full Time
Tasks
- Architect partitioning and file formats
- Build Airflow DAG workflow orchestration
- Challenge technical decisions and ensure maintainability
- Define batch workflow dependencies and triggers
- Define schema and data type strategy
- Design analytical data architecture
- Design near real time processing for OLAP workloads
- Drive AWS data stack integration
- Guide developers and align engineering practices
- Implement ETL pipelines for extraction transformation validation
- Own data pipeline design
- Partner with DevOps on functional and non functional requirements
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Flexible hours
- Mentorship
- People focused support
- Performance reviews
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
AI Assisted Development | Airflow | Amazon S3 | Apache Spark | Athena | BigQuery | ClickHouse | Code review | DAG | DevOps Collaboration | Docker | EKS | ETL | FastAPI | File Formats | Flask | GraphQL | Kubernetes | OLAP | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Presto | Python | REST API | Schema Design | Serverless computing | Snowflake | Spark SQL | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
Related jobs
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | GCPAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | Learning budgetSenior-level Full TimeCali, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | GCPFlexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeVillavicencio, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data Quality | Data cloud | ELTFlexible hours | Internal tech talks | Learning budget | Mentorship | Remote workSenior-level Full TimePereira, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM data | DBT | Data cloud | ELTAnnual learning budget | Flexible hours | Mentorship | Remote work | Support programsSenior-level Full TimeBucaramanga, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | ELTAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Performance and compensation reviewsSenior-level Full TimeManizales, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data Modeling | Data Quality | Data cloudFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeMedellín, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAWS | Airflow | Amazon Bedrock | Amazon EKS | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeBogota, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | AWS S3 | Amazon Athena | Apache AirflowAnnual learning budget | Flexible hours | Local support | Mentorship | Performance and compensation reviewsSenior-level Full TimeBucaramanga, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | AWS | Airflow | Amazon S3Annual learning budget | Annual performance reviews | Flexible hours | Mentorship | No micromanagementSenior-level Full TimeBarranquilla, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | Amazon S3 | Apache Airflow | Athena | BigQueryAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeMedellín, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon Athena | Amazon S3Annual learning budget | Flexible hours | Internal TechTalks | Mentorship | Remote workSenior-level Full TimeCali, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon Athena | Amazon EKSAnnual learning budget | Annual performance and compensation reviews | Flexible hours | Internal TechTalks | Learning budgetSenior-level Full TimeVillavicencio, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon S3 | AthenaAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimePereira, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeCartagena, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | DBT | Data Modeling | Data Quality | Data cloudFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeBarranquilla, Colombia5h ago
-
Senior Data Engineer ID71671 COP 88000K-106000KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDAnnual TechTalks | Challenging projects | Collaborative culture | Flexible hours | Learning budgetSenior-level Full TimeCartagena, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | DBT | Data cloud | GCP | PythonFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeBogota, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data cloud | ELT | ETLAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeCartagena, Colombia6h ago
-
LATAM_Artificial Intelligence Engineer COP 51919K-55752KAWS | CI/CD | Embeddings | Faiss | Generative AIMid-level Full TimeBogotá, Colombia1d ago
-
Lead / Principal Data Engineer - DBT & Databricks USD 180K-250KAzure | Azure Databricks | CI/CD | Cause analysis | DBTRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
Senior Data Engineer EUR 46K-51KDBT | Data Architecture | Data Governance | Data Migration | Data ModelingRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
Senior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
Senior AI Automation Engineer USD 133K-200KAI Governance | API Integration | Alerting | Automation Anywhere | Azure OpenAISenior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
Senior Data Engineer EUR 46K-51KAPI Integrations | AWS | Agile | Aurora PostgreSQL | CD pipelinesRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
APIs | AWS | Data Infrastructure | Distributed Systems | GCPRemote workSenior-level Full TimeBrazil R4d ago