Lead Data Engineer ID71008
Tasks
- Configure Athena queries
- Coordinate with DevOps on requirements
- Define OLAP analytical architecture
- Define batch workflow structure and dependencies
- Design ETL pipelines
- Drive AWS data lake architecture
- Extract transform validate data
- Implement near real time processing
- Mentor developers and align engineering practices
- Orchestrate DAG workflows with Airflow
- Plan partitioning strategy
- Review pull requests and enforce code quality
- Select file formats and schema design
Perks/Benefits
- Annual compensation reviews
- Annual learning budget
- Flexible hours
- Mentorship
- Performance reviews
- Remote work
- Support programs
- Techtalks
- Well-being programs
Skills/Tech-stack
Airflow | Athena | BigQuery | ClickHouse | Cost Optimization | DAG | Data Lake | DevOps Collaboration | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | Near-real-time | Near-real-time Processing | OLAP | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Presto | Python | REST | Real-time Processing | S3 | Schema Design | Serverless Query | Snowflake | Spark SQL | Time processing | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Ingeniero de Datos Junior MXN 180K-204KAWS | Agile | Azure | Cause analysis | Cloud platformHybrid work | Technical documentationEntry-level Full TimeCiudad de México, CDMX, México R4h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS Bedrock | AWS Step Functions | Airflow | Apache Spark | AthenaAnnual learning budget | Challenging projects | Collaborative culture | Flexible hours | Internal tech talksSenior-level Full TimePuebla (Heroica Puebla), Mexico8h ago
-
Lead Data Engineer ID71008 USD 155K-180KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeCiudad de México, Mexico8h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Athena | BigQuery | ClickHouse | DAGCompetitive compensation reviews | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeLeón de los Aldama, Mexico8h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Apache Spark | Athena | BedrockAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeMonterrey, Mexico8h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS EKS | Amazon S3 | Apache Airflow | Apache Spark | AthenaAnnual learning budget | Annual performance reviews | Flexible hours | Mentorship | People focused supportSenior-level Full TimePlayas de Rosarito, Mexico8h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAmazon S3 | Apache Airflow | Apache Spark | Athena | ClickHouseAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeGuadalajara, Mexico8h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Apache Spark | Apache Spark SQL | AthenaAnnual performance reviews | Collaborative environment | Flexible hours | Learning budget | MentorshipSenior-level Full TimeQuerétaro, Mexico8h ago
-
Sr. Data Engineer MXN 750K-1080KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure FunctionsSenior-level Full TimeMexico - Mexico City22h ago
-
Sr. Data Engineer MXN 750K-1080KARM Templates | Agile | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeMexico - Mexico City22h ago
-
A/B | A/B Testing | AWS | Anomaly Detection | AthenaMid-level Full TimeTORRE BBVA BANCOMER, Mexico22h ago
-
Agile | Automated builds | Automated testing | Azure DevOps | C#Cross-regional collaboration | Full-time flexibility | Travel to United StatesMid-level Full TimeGuadalajara, Jal., Mexico23h ago
-
AWS | Agile | Amazon Redshift | Azure | BigQueryOffice attendance 3 times per weekMid-level Full TimeCiudad de México, CDMX, México R23h ago
-
Senior-level Full TimeMexico1d ago
-
Senior Data Engineer (R13923) MXN 900K-1300KAWS | AWS Redshift | Agile | Amazon S3 | Apache AirflowSenior-level Full TimeRemote - MX R1d ago
-
Data Engineer (Snowflake & GCP) MXN 540K-600KAlerting | Apache Iceberg | Cloud Storage | Cloud platform | Google CloudCareer plan and growth | International team collaboration | Long-term career growth | Remote-first | Technical leadershipSenior-level Contract Full TimeCiudad de México R1d ago
-
AWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCompetitive contract compensation | Flexible schedule | Fully remote | Ownership | Technical autonomySenior-level Contract Full TimeMexico R1d ago
-
Data Analytics & Visualization MXN 420K-456KAWS | Alteryx | Azure | Databricks | DomoCompetitive compensation and benefits | Inclusive work environment | Professional developmentMid-level Full TimeCiudad De Mexico, MX, 110001d ago
-
Python Application Engineer MXN 934K-1300KAWS Lambda | AWS Step Functions | AWS X-Ray | CloudWatch | DatadogFully remoteSenior-level Full TimeCiudad de México, CDMX, MX R1d ago
-
Data Management Engineer OnPrem ETL Sr MXN 270K-390KAzure SQL | Data Modeling | Data integration | Database Performance Analysis | Database performanceMid-level Full TimeMonterrey1d ago
-
Data QA Engineer – Enterprise Data | Mexico MXN 300K-300KApache JMeter | Data Normalization | Data Warehousing | Database Testing | ELTPaid time off | Remote work | Work autonomyEntry-level Full TimeMexico City R2d ago
-
Agent systems | Agentic Frameworks | Artificial Intelligence | CI/CD | Cloud BuildMid-level Full TimeNaucalpan de Juarez, MEX, Mexico2d ago
-
Senior-level Full TimeMexico2d ago
-
Big Data Lead MXN 950K-1300KAWS CloudTrail | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaSenior-level Full TimeMexico2d ago
-
Big Data Lead MXN 934K-1100KAWS Glue | AWS Glue Data Catalog | AWS Kinesis | Amazon Athena | Amazon RedshiftSenior-level Full TimeMexico2d ago