Lead Data Engineer ID71008
Tasks
- Collaborate with DevOps on requirements
- Define data lake architecture
- Design ETL pipelines
- Design partitioning and file formats
- Enable near real time processing
- Enforce code quality standards
- Implement schema and data type strategy
- Lead engineering team
- Manage Kubernetes workloads with EKS
- Operate AWS data lake with Athena
- Orchestrate batch workflows with Airflow
- Review pull requests
Perks/Benefits
- Annual learning budget
- Flexible hours
- Mentorship
- Performance reviews
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
AWS EKS | Airflow | Amazon S3 | Apache Airflow | Athena | BigQuery | ClickHouse | Dagster | Data Governance | Data Lake | Docker | ETL | FastAPI | Flask | GraphQL | Kubernetes | Luigi | Near-real-time | Near-real-time Processing | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Prefect | Presto | Python | REST APIs | Real-time Processing | Schema Design | Snowflake | Spark SQL | Time processing | Trino | Trino SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Full Stack Engineer ID78855 USD 140K-170KCI/CD | Cloud | Databases | Docker | KubernetesAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeQUETZALTENANGO, Guatemala R19h ago
-
Senior Full Stack Engineer ID78855 USD 140K-170KCI/CD | Cloud Computing | Databases | Docker | KubernetesFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeZONA 1, Guatemala R19h ago
-
Lead Data Engineer ID71008 USD 158K-198KAI code assistant | AWS Bedrock | AWS Data | AWS Data Ecosystem | Advertising metricsAnnual learning budget | Flexible hours | Learning budget | Mentorship | Performance and compensation reviewsSenior-level Full TimeQUETZALTENANGO, Guatemala R2d ago
-
Staff Data Scientist, Marketing USD 175K-200KAd Ranking | Amazon Web Services | Collaborative Filtering | Content-Based Filtering | Content-basedSenior-level Full TimeAntigua, Guatemala (remote) R3d ago
-
Lead Data Scientist, AdTech USD 175K-200KAWS | Collaborative Filtering | Funnel Optimization | Hybrid recommendation | Lifetime ValueInclusive, diverse culture | Remote-first teamSenior-level Full TimeAntigua, Guatemala (remote) R3d ago
-
Lead Applied Scientist, Marketing USD 175K-200KAWS | Ad Ranking | Ad Ranking Algorithms | Collaborative Filtering | Content-Based FilteringDiversity and inclusion initiatives | Remote-first cultureSenior-level Full TimeAntigua, Guatemala (remote) R3d ago
-
Data Engineer ID80135 USD 138K-195KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workMid-level Full TimeZONA 1, Guatemala R3d ago
-
Data Engineer ID80135 USD 138K-195KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipMid-level Full TimeQUETZALTENANGO, Guatemala R3d ago
-
Automation | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeEscuintla, Guatemala R10d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany sponsored certification training | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeAntigua Guatemala, Guatemala R10d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeGuatemala City, Guatemala R10d ago
-
AI Agent | AI agent engineering | AWS | AWS Glue | AWS Lake Formation100% remote | Contractor role | International projects | Weekday scheduleSenior-level Full TimeColombia R29d ago