Lead Data Engineer ID71008
Tasks
- Collaborate with DevOps on requirements
- Define data lake architecture
- Design ETL pipelines
- Design partitioning and file formats
- Enable near real time processing
- Enforce code quality standards
- Implement schema and data type strategy
- Lead engineering team
- Manage Kubernetes workloads with EKS
- Operate AWS data lake with Athena
- Orchestrate batch workflows with Airflow
- Review pull requests
Perks/Benefits
- Annual learning budget
- Flexible hours
- Mentorship
- Performance reviews
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
AWS EKS | Airflow | Amazon S3 | Apache Airflow | Athena | BigQuery | ClickHouse | Dagster | Data Governance | Data Lake | Docker | ETL | FastAPI | Flask | GraphQL | Kubernetes | Luigi | Near-real-time | Near-real-time Processing | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Prefect | Presto | Python | REST APIs | Real-time Processing | Schema Design | Snowflake | Spark SQL | Time processing | Trino | Trino SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Lead Data Engineer ID71008 USD 158K-198KAI code assistant | AWS Bedrock | AWS Data | AWS Data Ecosystem | Advertising metricsAnnual learning budget | Flexible hours | Learning budget | Mentorship | Performance and compensation reviewsSenior-level Full TimeQUETZALTENANGO, Guatemala R14h ago
-
Staff Data Scientist, Marketing USD 175K-200KAd Ranking | Amazon Web Services | Collaborative Filtering | Content-Based Filtering | Content-basedSenior-level Full TimeAntigua, Guatemala (remote) R23h ago
-
Lead Data Scientist, AdTech USD 175K-200KAWS | Collaborative Filtering | Funnel Optimization | Hybrid recommendation | Lifetime ValueInclusive, diverse culture | Remote-first teamSenior-level Full TimeAntigua, Guatemala (remote) R1d ago
-
Lead Applied Scientist, Marketing USD 175K-200KAWS | Ad Ranking | Ad Ranking Algorithms | Collaborative Filtering | Content-Based FilteringDiversity and inclusion initiatives | Remote-first cultureSenior-level Full TimeAntigua, Guatemala (remote) R1d ago
-
Data Engineer ID80135 USD 138K-195KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workMid-level Full TimeZONA 1, Guatemala R1d ago
-
Data Engineer ID80135 USD 138K-195KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipMid-level Full TimeQUETZALTENANGO, Guatemala R1d ago
-
Automation | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeEscuintla, Guatemala R8d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany sponsored certification training | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeAntigua Guatemala, Guatemala R8d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeGuatemala City, Guatemala R8d ago
-
AWS | Amazon Redshift | Data Observability | Data Quality | Data ReconciliationInternational team collaboration | Remote work across LATAMSenior-level Contract Full TimeGuatemala, Guatemala (Remote) R13d ago
-
AI Agent | AI agent engineering | AWS | AWS Glue | AWS Lake Formation100% remote | Contractor role | International projects | Weekday scheduleSenior-level Full TimeColombia R27d ago
-
Lead Data Scientist, AdTech USD 120K-160KAWS | Ad Ranking | Cloud Computing | Collaborative Filtering | Content-Based RecommendationsEqual employment opportunity | Remote-first cultureSenior-level Full TimeAntigua, Guatemala (remote) R29d ago
-
Lead Applied Scientist, Marketing USD 120K-160KA/B | A/B Testing | AWS | Ad Ranking | Ad Ranking AlgorithmsDiversity and inclusion culture | Remote-first teamSenior-level Full TimeAntigua, Guatemala (remote) R29d ago
-
AI Observability | AWS | Anthropic | Azure | Cloud platformEnglish and Spanish communication support | Remote workSenior-level Full TimeGuatemala, Guatemala (Remote) R1mo ago
-
Mid-level Full TimeGuatemala, Guatemala (Remote) R1mo ago
-
Azure Data Engineer - Remote, Latin America USD 120K-150KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Data ModelingFlexible collaboration | Professional development | Remote workMid-level Full TimeAntigua Guatemala, Guatemala R1mo ago
-
Data Engineer (Azure) - Remote, Latin America USD 120K-150KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsCareer growth | Collaborative team | Professional development | Remote workMid-level Full TimeAntigua Guatemala, Guatemala R1mo ago
-
Azure Data Engineer - Remote, Latin America USD 120K-150KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CSVContinuous learning | Professional development | Remote workMid-level Full TimeEscuintla, Guatemala R1mo ago
-
Data Engineer (Azure) - Remote, Latin America USD 120K-150KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure Key VaultProfessional development | Remote workMid-level Full TimeEscuintla, Guatemala R1mo ago
-
Data Engineer (Azure) - Remote, Latin America USD 120K-150KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Data CatalogCollaborative team | Continuous learning | Professional development | Remote workMid-level Full TimeGuatemala City, Guatemala R1mo ago
-
Azure Data Engineer - Remote, Latin America USD 120K-150KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsCollaborative work environment | Professional development | Remote workMid-level Full TimeGuatemala City, Guatemala R1mo ago