Lead Data Engineer ID71008
Tasks
- Build Airflow DAG batch workflows and orchestration
- Collaborate with DevOps on requirements
- Define partitioning file formats and schema strategy
- Design data lake and OLAP analytical architecture
- Guide developers and align engineering practices
- Implement near real time processing
- Operate AWS data stack including S3 Athena and EKS
- Own ETL pipelines and data validation
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Collaborative culture
- Flexible hours
- Mentorship
- No micromanagement
- Performance reviews
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
Amazon S3 | Apache Airflow | Athena | ClickHouse | Data Lake | Docker | Docker Compose | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | Near-real-time | Near-real-time Processing | OLAP | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Presto | Python | REST | Real-time Processing | Schema Design | Spark SQL | Time processing | Trino | Trino SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS Athena | Airflow | Amazon EKS | Amazon S3 | Apache ParquetFlexible hours | Learning budget | Mentorship | People focused support | Performance reviewsSenior-level Full TimePlayas de Rosarito, Mexico R15h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS Athena | AWS Bedrock | Airflow | Amazon EKS | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeMonterrey, Mexico R15h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS | AWS Bedrock | Airflow | Amazon S3 | AthenaAnnual learning budget | Challenging projects | Flexible hours | Mentorship | Performance and compensation reviewsSenior-level Full TimeCiudad de México, Mexico R15h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Athena | ClickHouse | Data LakeAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeQuerétaro, Mexico R15h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAmazon Athena | Amazon S3 | Apache Airflow | BigQuery | ClickHouseFlexible hours | Learning budget | Mentorship | People focused support | Performance reviewsSenior-level Full TimePuebla (Heroica Puebla), Mexico R15h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Apache Spark | Apache Trino | AthenaAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeLeón de los Aldama, Mexico R15h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon Web Services | Athena | BigQuery | ClickHouseAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeGuadalajara, Mexico R15h ago
-
Staff Applied Scientist, AdTech MXN 934K-1200KAWS | Collaborative Filtering | Content-Based Recommendation | Content-based | Funnel OptimizationDiversity and inclusion culture | Remote-first teamSenior-level Full TimeCiudad de Mexico, Mexico (remote); Guadalajara, … R1d ago
-
Lead Data Scientist, AdTech MXN 900K-1080KAWS | Amazon Web Services | Collaborative Filtering | Content-Based Filtering | Content-basedCareer growth | Diverse inclusive team | Remote-first cultureSenior-level Full TimeCiudad de Mexico, Mexico (remote); Guadalajara, … R1d ago
-
Lead Applied Scientist, Marketing MXN 934K-1100KAWS | Adtech | Collaborative Filtering | Content-Based Recommendation | Content-basedSenior-level Full TimeCiudad de Mexico, Mexico (remote); Guadalajara, … R1d ago
-
Data Engineer ID80135 MXN 420K-432KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeLeón de los Aldama, Mexico R1d ago
-
Data Engineer ID80135 MXN 420K-432KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Data CatalogAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | Learning budgetMid-level Full TimePuebla (Heroica Puebla), Mexico R1d ago
-
Data Engineer ID80135 MXN 420K-432KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Flexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportMid-level Full TimeGuadalajara, Mexico R1d ago
-
Data Engineer ID80135 MXN 420K-432KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeQuerétaro, Mexico R1d ago
-
Data Engineer ID80135 MXN 420K-432KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Flexible hours | Learning budget | Mentorship | Remote work | Well-being programsMid-level Full TimePlayas de Rosarito, Mexico R1d ago
-
Data Engineer ID80135 MXN 420K-432KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Collaborative culture | Flexible hours | Internal tech talks | Learning budget | MentorshipMid-level Full TimeCiudad de México, Mexico R1d ago
-
Data Engineer ID80135 MXN 420K-432KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeMonterrey, Mexico R1d ago
-
Data Engineer ID80135 MXN 420K-432KAWS Glue | Access control RBAC | Amazon Athena | Amazon Redshift | Amazon S3Flexible hours | Internal TechTalks | Learning budget | Mentorship | Remote workMid-level Full TimeZapopan, Mexico R1d ago
-
AWS | Azure | Cloud Computing | Data Analysis | Data cleaningAutonomy | Collaborative team | Continuous learning | Flexible work hours | Fully remoteMid-level Full TimeMexico R1d ago
-
AI Engineer MXN 420K-480KChunking | Docker | Embeddings | FastAPI | GPUContinuous training | Hybrid work model | Official certifications support | Telework bonusEntry-level Full TimeMexico City, Mexico R2d ago
-
Agile | Azure Machine Learning | Blue Prism | Data Visualization | Entity recognitionComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Tuition reimbursementMid-level Full TimeMX2-Mexico City - Torre Virreyes R2d ago
-
Data Visualization Engineer MXN 324K-324KAmazon Redshift | Apache Airflow | Apache Spark | BigQuery | DBTCareer growth plan | Continuous training | Hybrid work | Indefinite contract | Telework bonusMid-level Full TimeMexico City, Mexico R2d ago
-
Mid-level Full TimeMexico R2d ago
-
Senior Data Engineer MXN 950K-1300KAWS | AWS Security | Apache Spark | Automation Scripting | CI/CDEquipment stipend | Flexible PTO | Laptop and tools | Paid Exams Certification | Professional development stipendSenior-level Full TimeMEXICO R2d ago
-
Compute & Storage Subject Matter Expert MXN 934K-1300KAzure Local | Backup and Recovery | CI/CD | Data Locality | Disaster RecoveryEmployee share plan | Flexible benefits | Flexible work hours | Friday early finish | Gender neutral parental leaveSenior-level Full TimeHuixquilucan, ESTADO DE MÉXICO, Mexico; Centro … R4d ago