Lead Data Engineer ID71008
Tasks
- Collaborate with DevOps on infrastructure requirements
- Define partitioning strategy
- Design ETL pipelines
- Design file formats and schema
- Drive AWS data lake architecture
- Implement near real time processing
- Integrate Athena and EKS based services
- Lead engineering team and mentor developers
- Orchestrate batch workflows with Airflow DAGs
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Flexible hours
- Learning budget
- Mentorship
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
Amazon S3 | Apache Airflow | Apache Spark | Athena | ClickHouse | Data Lake | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | ORC | Parquet | PostgreSQL | Presto | Python | REST | SQL | Serverless computing | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS Bedrock | AWS Step Functions | Airflow | Apache Spark | AthenaAnnual learning budget | Challenging projects | Collaborative culture | Flexible hours | Internal tech talksSenior-level Full TimePuebla (Heroica Puebla), Mexico7h ago
-
Lead Data Engineer ID71008 USD 155K-180KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeCiudad de México, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Athena | BigQuery | ClickHouse | DAGCompetitive compensation reviews | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeLeón de los Aldama, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Apache Spark | Athena | BedrockAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeMonterrey, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS EKS | Amazon S3 | Apache Airflow | Apache Spark | AthenaAnnual learning budget | Annual performance reviews | Flexible hours | Mentorship | People focused supportSenior-level Full TimePlayas de Rosarito, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Apache Spark | Apache Spark SQL | AthenaAnnual performance reviews | Collaborative environment | Flexible hours | Learning budget | MentorshipSenior-level Full TimeQuerétaro, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Athena | BigQuery | ClickHouse | Cost OptimizationAnnual compensation reviews | Annual learning budget | Flexible hours | Mentorship | Performance reviewsSenior-level Full TimeZapopan, Mexico7h ago
-
Sr. Data Engineer - Integrations MXN 900K-1080KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure FunctionsAgile team environment | MentorshipSenior-level Full TimeMexico - Mexico City21h ago
-
Sr. Data Engineer MXN 750K-1080KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure FunctionsSenior-level Full TimeMexico - Mexico City21h ago
-
Sr. Data Engineer MXN 750K-1080KARM Templates | Agile | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeMexico - Mexico City21h ago
-
A/B | A/B Testing | AWS | Anomaly Detection | AthenaMid-level Full TimeTORRE BBVA BANCOMER, Mexico21h ago
-
Agile | Automated builds | Automated testing | Azure DevOps | C#Cross-regional collaboration | Full-time flexibility | Travel to United StatesMid-level Full TimeGuadalajara, Jal., Mexico22h ago
-
AWS | Agile | Amazon Redshift | Azure | BigQueryOffice attendance 3 times per weekMid-level Full TimeCiudad de México, CDMX, México R23h ago
-
Information Delivery & Visualization Lead MXN 720K-1080KArtificial Intelligence | DBT | Data Modeling | Dimensional Modeling | Power BISenior-level Full TimeMexico1d ago
-
Senior-level Full TimeMexico1d ago
-
Senior Data Engineer (R13923) MXN 900K-1300KAWS | AWS Redshift | Agile | Amazon S3 | Apache AirflowSenior-level Full TimeRemote - MX R1d ago
-
Data Engineer (Snowflake & GCP) MXN 540K-600KAlerting | Apache Iceberg | Cloud Storage | Cloud platform | Google CloudCareer plan and growth | International team collaboration | Long-term career growth | Remote-first | Technical leadershipSenior-level Contract Full TimeCiudad de México R1d ago
-
AWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCompetitive contract compensation | Flexible schedule | Fully remote | Ownership | Technical autonomySenior-level Contract Full TimeMexico R1d ago
-
Data Analytics & Visualization MXN 420K-456KAWS | Alteryx | Azure | Databricks | DomoCompetitive compensation and benefits | Inclusive work environment | Professional developmentMid-level Full TimeCiudad De Mexico, MX, 110001d ago
-
Business Intelligence Engineer MXN 789K-986KData Engineering | Data Governance | Data Modeling | Dimensional Model | Dimensional ModelingRemote workSenior-level Full TimeMexico1d ago
-
Python Application Engineer MXN 934K-1300KAWS Lambda | AWS Step Functions | AWS X-Ray | CloudWatch | DatadogFully remoteSenior-level Full TimeCiudad de México, CDMX, MX R1d ago
-
Data Management Engineer OnPrem ETL Sr MXN 270K-390KAzure SQL | Data Modeling | Data integration | Database Performance Analysis | Database performanceMid-level Full TimeMonterrey1d ago
-
Data QA Engineer – Enterprise Data | Mexico MXN 300K-300KApache JMeter | Data Normalization | Data Warehousing | Database Testing | ELTPaid time off | Remote work | Work autonomyEntry-level Full TimeMexico City R2d ago
-
Agent systems | Agentic Frameworks | Artificial Intelligence | CI/CD | Cloud BuildMid-level Full TimeNaucalpan de Juarez, MEX, Mexico2d ago
-
Senior-level Full TimeMexico2d ago