Lead Data Engineer ID71008
Bogota, Colombia
COP 89364K-100000K (estimate) Senior-level Full Time
Tasks
- Define DAG dependencies and triggering strategy
- Define partitioning and file formats for data lake
- Design Airflow DAG batch workflows
- Design ETL pipelines
- Design schema and data type strategy
- Drive AWS data stack architecture decisions
- Extract transform validate data at scale
- Guide senior developers and align engineering practices
- Implement near real time processing for OLAP workloads
- Partner with DevOps on functional and non functional requirements
- Review pull requests and enforce code quality standards
Perks/Benefits
- Annual learning budget
- Collaborative culture
- Flexible hours
- Learning budget
- Mentorship
- People focused support
- Remote work
- Techtalks
- Well-being programs
- Zero micromanagement
Skills/Tech-stack
AWS | Airflow | Amazon Bedrock | Amazon EKS | Amazon S3 | Apache Spark | Athena | BigQuery | Caching | ClickHouse | DAG | Data Lake | Data Validation | Docker | ETL | FastAPI | Flask | GraphQL | Kubernetes | Langchain | Monorepo | OLAP | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Presto | Pydantic | Python | REST | Redis | SQL | SageMaker | Schema Design | Serverless | Snowflake | Spark SQL | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | GCPAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | Learning budgetSenior-level Full TimeCali, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | GCPFlexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeVillavicencio, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data Quality | Data cloud | ELTFlexible hours | Internal tech talks | Learning budget | Mentorship | Remote workSenior-level Full TimePereira, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM data | DBT | Data cloud | ELTAnnual learning budget | Flexible hours | Mentorship | Remote work | Support programsSenior-level Full TimeBucaramanga, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | ELTAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Performance and compensation reviewsSenior-level Full TimeManizales, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data Modeling | Data Quality | Data cloudFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeMedellín, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | AWS S3 | Amazon Athena | Apache AirflowAnnual learning budget | Flexible hours | Local support | Mentorship | Performance and compensation reviewsSenior-level Full TimeBucaramanga, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | AWS | Airflow | Amazon S3Annual learning budget | Annual performance reviews | Flexible hours | Mentorship | No micromanagementSenior-level Full TimeBarranquilla, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | Airflow | Amazon S3 | Apache Spark | AthenaAnnual learning budget | Flexible hours | Mentorship | People focused support | Performance reviewsSenior-level Full TimeManizales, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | Amazon S3 | Apache Airflow | Athena | BigQueryAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeMedellín, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon Athena | Amazon S3Annual learning budget | Flexible hours | Internal TechTalks | Mentorship | Remote workSenior-level Full TimeCali, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon Athena | Amazon EKSAnnual learning budget | Annual performance and compensation reviews | Flexible hours | Internal TechTalks | Learning budgetSenior-level Full TimeVillavicencio, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon S3 | AthenaAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimePereira, Colombia5h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeCartagena, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | DBT | Data Modeling | Data Quality | Data cloudFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeBarranquilla, Colombia5h ago
-
Senior Data Engineer ID71671 COP 88000K-106000KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDAnnual TechTalks | Challenging projects | Collaborative culture | Flexible hours | Learning budgetSenior-level Full TimeCartagena, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | DBT | Data cloud | GCP | PythonFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeBogota, Colombia5h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data cloud | ELT | ETLAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeCartagena, Colombia6h ago
-
LATAM_Artificial Intelligence Engineer COP 51919K-55752KAWS | CI/CD | Embeddings | Faiss | Generative AIMid-level Full TimeBogotá, Colombia1d ago
-
Technical Delivery Lead COP 80000K-106000KAI Pipelines | AI SDK | AWS Services | AWS Step Functions | Agentic OrchestrationFloating holiday | Good working environment | Remote work | Vacation daysSenior-level Full TimeColombia - Remote R1d ago
-
Lead / Principal Data Engineer - DBT & Databricks USD 180K-250KAzure | Azure Databricks | CI/CD | Cause analysis | DBTRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
Senior Data Engineer EUR 46K-51KDBT | Data Architecture | Data Governance | Data Migration | Data ModelingRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
Senior .NET Azure AI Developer USD 119K-258K.NET | AI Foundry | Application Insights | Authentication | Azure AISenior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
Senior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
Senior AI Automation Engineer USD 133K-200KAI Governance | API Integration | Alerting | Automation Anywhere | Azure OpenAISenior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago