Lead Data Engineer ID71008
Tasks
- Build serverless query architecture
- Define schema and data type strategy
- Design ETL pipelines
- Design data lake partitioning strategy
- Drive AWS data stack architecture
- Guide developers and align engineering practices
- Implement near real time processing
- Orchestrate batch workflows with DAGs
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Flexible hours
- Internal tech talks
- Mentorship
- People focused support
- Performance reviews
- Remote work
- Well-being programs
Skills/Tech-stack
Airflow | Amazon S3 | Apache Spark | Athena | BigQuery | ClickHouse | DAG Workflow | DAG Workflow Orchestration | Docker | EKS | ETL | File format | File format optimization | Format optimization | GraphQL | Kubernetes | ORC | Object storage | Parquet | Partitioning Strategy | PostgreSQL | Presto | Python | Query engines | REST API | Serverless Query | Serverless Query Engines | Snowflake | Spark SQL | Trino | Workflow Orchestration
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Lead Data Engineer ID71008 COP 89364K-94620KAirflow | Apache Spark | Apache Spark SQL | Athena | BigQueryAnnual learning budget | Annual performance reviews | Flexible hours | Internal tech talks | MentorshipSenior-level Full TimeManizales, Colombia8h ago
-
Lead Data Engineer ID71008 COP 89364K-94620KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeCali, Colombia8h ago
-
Lead Data Engineer ID71008 COP 89364K-94620KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseFlexible hours | Learning budget | Mentorship | Remote work | TechtalksSenior-level Full TimeCartagena, Colombia8h ago
-
Lead Data Engineer ID71008 COP 89364K-94620KAirflow | Athena | BigQuery | ClickHouse | DockerAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimePereira, Colombia8h ago
-
Lead Data Engineer ID71008 COP 89364K-94620KAWS EKS | Amazon S3 | Apache Airflow | Athena | BigQueryAnnual performance reviews | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeBucaramanga, Colombia8h ago
-
Lead Data Engineer ID71008 COP 89364K-94620KAWS | Amazon S3 | Apache Airflow | Athena | BigQueryAnnual learning budget | Flexible hours | Mentorship | No micromanagement | People focused supportSenior-level Full TimeVillavicencio, Colombia8h ago
-
Lead Data Engineer ID71008 COP 89364K-94620KAirflow | Amazon EKS | Amazon S3 | Apache Parquet | AthenaFlexible hours | Learning budget | Mentorship | People focused support | Performance reviewsSenior-level Full TimeMedellín, Colombia8h ago
-
Lead Data Engineer ID71008 COP 89364K-94620KAirflow | Athena | BigQuery | ClickHouse | Data LakeAnnual learning budget | Annual performance reviews | Flexible hours | Mentorship | Remote workSenior-level Full TimeBarranquilla, Colombia8h ago
-
Arquitecto de Datos COP 70000K-83999KAzure Databricks | Azure DevOps | Azure SQL | Delta Lake | ETLSenior-level Full TimeMedellin, Colombia8h ago
-
AI Analytics Engineer COP 89364K-94620KAI orchestration | Airflow | Anomaly Detection | BigQuery | DBTEquity | Health benefitsSenior-level Full TimeColombia R23h ago
-
Senior-level Full TimeBarranquilla, //ATLANTICO, Colombia1d ago
-
Data Engineer (CRM) USD 85K-97KApache Airflow | Cloud platform | DBT | Data Governance | Data ModelingAgile team collaboration | English communication environment | Remote workMid-level Full TimeBrazil / Colombia / Argentina / … R1d ago
-
Data QA Engineer – Enterprise Data | Colombia COP 60000K-72000KApache JMeter | Database Indexing | ELT | ETL | Execution PlansPaid time off | Remote work | Work with autonomy | Work with top companiesMid-level Full TimeBogota R2d ago
-
Data Engineer Manager COP 58800K-58800KAI | AWS | AWS Glue | AWS Lambda | Agent-basedCompany-provided equipment | Conference attendance | English lessons | Flexible working options | Learning opportunitiesSenior-level Full TimeBogotá, Bogota, Colombia2d ago
-
Senior Data Engineer COP 88000K-94620KAWS Glue | AWS Lambda | AWS S3 | Data Classification | Data GovernanceCareer development plans | Company-provided equipment | English lessons | Flexible working options | Learning opportunitiesSenior-level Full TimeBogotá, Bogota, Colombia2d ago
-
DevOps Engineer COP 89364K-98400KAWS | Ansible | Automation | Bash | CI/CDAgile work environment | Remote workSenior-level Full TimeColombia R2d ago
-
Mid-level Full TimeBogota, CO2d ago
-
Data Visualization Engineer SAP AC/BO Sr COP 70000K-90000KAnalytics | Analytics Cloud | Analytics designer | Augmented analytics | Business IntelligenceHybrid work | Remote workMid-level Full TimeColombia R3d ago
-
Senior Data Engineer + AI USD 119K-167KAI Engineering | API Development | AWS | Apache Spark | CI/CDRemoteSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru3d ago
-
Data Engineering Associate COP 54000K-74400KAvro | CSV | Cloud Migration | Data Ingestion | Data ModelingCompetitive benefits | Inclusive work environmentMid-level Full TimeBogota, DC, CO3d ago
-
Data Engineer (Ingeniero de Datos) COP 27600K-184800KAPI Integration | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeBirthday day off | Connectivity allowance | Employee fund | Flexible schedule | Hybrid workSenior-level Full TimeBogotá, Bogota, Colombia3d ago
-
Senior Analytics Engineer COP 113244K-125000KCause analysis | DBT | Data Modeling | Data Monitoring | Data QualityMentorship | Opportunity for growth and impact | Remote work during US business hours | Travel for team/offsitesSenior-level Full TimeBogotá, Colombia R3d ago
-
Cloud Infrastructure & Data Platform Engineer COP 78000K-90000KAI Agents | AWS | Apache Kafka | Apache Spark | Autonomous DatabaseFlexible medical insurance | Life insurance | Retirement options | Volunteer programsMid-level Full TimeBOGOTA, DISTRITO CAPITAL, Colombia4d ago
-
Machine Learning Engineer COP 18000K-18000KBigQuery | Data Pipelines | HuggingFace Transformers | LLM-Ops | Machine LearningHybrid workMid-level Full TimeBogotá,Colombia R4d ago
-
Senior AI Engineer COP 95420K-101090KAWS | Amazon Textract | Confidence scoring | Data Validation | Document AISenior-level Full TimeColombia R4d ago