Lead Data Engineer ID71008
Pereira, Colombia
COP 89364K-100000K (estimate) Senior-level Full Time
Tasks
- Define schema and data type strategy
- Design ETL pipelines
- Design partitioning and file formats
- Drive AWS data stack architecture
- Extract transform and validate data from databases and APIs
- Implement near realtime processing
- Lead and mentor developers
- Orchestrate batch workflows with Airflow DAGs
- Own data pipeline architecture
- Partner with DevOps on functional and non functional requirements
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Flexible hours
- Internal TechTalks
- Mentorship
- People focused support
- Performance reviews
- Remote work
- Well-being programs
Skills/Tech-stack
AI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon S3 | Athena | BigQuery | ClickHouse | Code Quality | DAG | Data Lake | Development tools | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | Near-real-time | Near-real-time Processing | OLAP | ORC | Object Storage Data Lake | Object storage | Parquet | Partitioning | PostgreSQL | Presto | Pull request | Pull request reviews | Python | REST | Real-time Processing | Schema Design | Serverless Query | Snowflake | Spark SQL | Time processing | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
Related jobs
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | GCPAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | Learning budgetSenior-level Full TimeCali, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | GCPFlexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeVillavicencio, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data Quality | Data cloud | ELTFlexible hours | Internal tech talks | Learning budget | Mentorship | Remote workSenior-level Full TimePereira, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM data | DBT | Data cloud | ELTAnnual learning budget | Flexible hours | Mentorship | Remote work | Support programsSenior-level Full TimeBucaramanga, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | CRM | DBT | Data cloud | ELTAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Performance and compensation reviewsSenior-level Full TimeManizales, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data Modeling | Data Quality | Data cloudFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeMedellín, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAWS | Airflow | Amazon Bedrock | Amazon EKS | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeBogota, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | AWS S3 | Amazon Athena | Apache AirflowAnnual learning budget | Flexible hours | Local support | Mentorship | Performance and compensation reviewsSenior-level Full TimeBucaramanga, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | AWS | Airflow | Amazon S3Annual learning budget | Annual performance reviews | Flexible hours | Mentorship | No micromanagementSenior-level Full TimeBarranquilla, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | Airflow | Amazon S3 | Apache Spark | AthenaAnnual learning budget | Flexible hours | Mentorship | People focused support | Performance reviewsSenior-level Full TimeManizales, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | Amazon S3 | Apache Airflow | Athena | BigQueryAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeMedellín, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon Athena | Amazon S3Annual learning budget | Flexible hours | Internal TechTalks | Mentorship | Remote workSenior-level Full TimeCali, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon Athena | Amazon EKSAnnual learning budget | Annual performance and compensation reviews | Flexible hours | Internal TechTalks | Learning budgetSenior-level Full TimeVillavicencio, Colombia6h ago
-
Lead Data Engineer ID71008 COP 89364K-100000KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeCartagena, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | DBT | Data Modeling | Data Quality | Data cloudFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeBarranquilla, Colombia6h ago
-
Senior Data Engineer ID71671 COP 88000K-106000KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDAnnual TechTalks | Challenging projects | Collaborative culture | Flexible hours | Learning budgetSenior-level Full TimeCartagena, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KAirflow | DBT | Data cloud | GCP | PythonFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeBogota, Colombia6h ago
-
Senior Data Engineer ID81652 COP 89364K-100000KApache Airflow | DBT | Data cloud | ELT | ETLAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeCartagena, Colombia6h ago
-
LATAM_Artificial Intelligence Engineer COP 51919K-55752KAWS | CI/CD | Embeddings | Faiss | Generative AIMid-level Full TimeBogotá, Colombia1d ago
-
Lead / Principal Data Engineer - DBT & Databricks USD 180K-250KAzure | Azure Databricks | CI/CD | Cause analysis | DBTRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
Senior Data Engineer EUR 46K-51KDBT | Data Architecture | Data Governance | Data Migration | Data ModelingRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
Senior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
Senior AI Automation Engineer USD 133K-200KAI Governance | API Integration | Alerting | Automation Anywhere | Azure OpenAISenior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
Senior Data Engineer EUR 46K-51KAPI Integrations | AWS | Agile | Aurora PostgreSQL | CD pipelinesRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
APIs | AWS | Data Infrastructure | Distributed Systems | GCPRemote workSenior-level Full TimeBrazil R4d ago