Lead Data Engineer ID71008
Tasks
- Define OLAP data schema and partitioning
- Design ETL pipelines
- Design near real time processing
- Drive AWS data lake architecture
- Enforce code quality standards
- Guide developers and align engineering practices
- Integrate with external APIs
- Orchestrate batch workflows with Airflow DAGs
- Own data pipeline architecture
- Review pull requests
- Validate and transform data at scale
Perks/Benefits
- Annual learning budget
- Flexible hours
- Internal TechTalks
- Mentorship
- People focused support
- Performance reviews
- Remote work
- Well-being programs
Skills/Tech-stack
Airflow | Amazon S3 | Apache Spark | Athena | Bedrock | BigQuery | Caching | ClickHouse | Cost Performance | Cost-performance optimization | DAG | Dagster | Data Lake | Data pipeline | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | Langchain | Luigi | Monorepo | Near-real-time | Near-real-time Processing | Nx | ORC | Parquet | Partitioning | Performance optimization | Poetry | PostgreSQL | Prefect | Presto | Pydantic | PydanticAI | Python | REST | React | Real-time Processing | Redis | Schema Design | Serverless computing | Snowflake | Spark SQL | Step Functions | Time processing | Trino | TypeScript | YARN
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS Bedrock | AWS Step Functions | Airflow | Apache Spark | AthenaAnnual learning budget | Challenging projects | Collaborative culture | Flexible hours | Internal tech talksSenior-level Full TimePuebla (Heroica Puebla), Mexico7h ago
-
Lead Data Engineer ID71008 USD 155K-180KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeCiudad de México, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Athena | BigQuery | ClickHouse | DAGCompetitive compensation reviews | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeLeón de los Aldama, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS EKS | Amazon S3 | Apache Airflow | Apache Spark | AthenaAnnual learning budget | Annual performance reviews | Flexible hours | Mentorship | People focused supportSenior-level Full TimePlayas de Rosarito, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAmazon S3 | Apache Airflow | Apache Spark | Athena | ClickHouseAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeGuadalajara, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Apache Spark | Apache Spark SQL | AthenaAnnual performance reviews | Collaborative environment | Flexible hours | Learning budget | MentorshipSenior-level Full TimeQuerétaro, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Athena | BigQuery | ClickHouse | Cost OptimizationAnnual compensation reviews | Annual learning budget | Flexible hours | Mentorship | Performance reviewsSenior-level Full TimeZapopan, Mexico7h ago
-
Sr. Data Engineer - Integrations MXN 900K-1080KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure FunctionsAgile team environment | MentorshipSenior-level Full TimeMexico - Mexico City21h ago
-
Sr. Data Engineer MXN 750K-1080KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure FunctionsSenior-level Full TimeMexico - Mexico City21h ago
-
Sr. Data Engineer MXN 750K-1080KARM Templates | Agile | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeMexico - Mexico City21h ago
-
A/B | A/B Testing | AWS | Anomaly Detection | AthenaMid-level Full TimeTORRE BBVA BANCOMER, Mexico21h ago
-
Agile | Automated builds | Automated testing | Azure DevOps | C#Cross-regional collaboration | Full-time flexibility | Travel to United StatesMid-level Full TimeGuadalajara, Jal., Mexico22h ago
-
AWS | Agile | Amazon Redshift | Azure | BigQueryOffice attendance 3 times per weekMid-level Full TimeCiudad de México, CDMX, México R23h ago
-
Senior-level Full TimeMexico1d ago
-
Senior Data Engineer (R13923) MXN 900K-1300KAWS | AWS Redshift | Agile | Amazon S3 | Apache AirflowSenior-level Full TimeRemote - MX R1d ago
-
Data Engineer (Snowflake & GCP) MXN 540K-600KAlerting | Apache Iceberg | Cloud Storage | Cloud platform | Google CloudCareer plan and growth | International team collaboration | Long-term career growth | Remote-first | Technical leadershipSenior-level Contract Full TimeCiudad de México R1d ago
-
AWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCompetitive contract compensation | Flexible schedule | Fully remote | Ownership | Technical autonomySenior-level Contract Full TimeMexico R1d ago
-
Data Analytics & Visualization MXN 420K-456KAWS | Alteryx | Azure | Databricks | DomoCompetitive compensation and benefits | Inclusive work environment | Professional developmentMid-level Full TimeCiudad De Mexico, MX, 110001d ago
-
Python Application Engineer MXN 934K-1300KAWS Lambda | AWS Step Functions | AWS X-Ray | CloudWatch | DatadogFully remoteSenior-level Full TimeCiudad de México, CDMX, MX R1d ago
-
Data Management Engineer OnPrem ETL Sr MXN 270K-390KAzure SQL | Data Modeling | Data integration | Database Performance Analysis | Database performanceMid-level Full TimeMonterrey1d ago
-
Data QA Engineer – Enterprise Data | Mexico MXN 300K-300KApache JMeter | Data Normalization | Data Warehousing | Database Testing | ELTPaid time off | Remote work | Work autonomyEntry-level Full TimeMexico City R2d ago
-
Agent systems | Agentic Frameworks | Artificial Intelligence | CI/CD | Cloud BuildMid-level Full TimeNaucalpan de Juarez, MEX, Mexico2d ago
-
Senior-level Full TimeMexico2d ago
-
Big Data Lead MXN 950K-1300KAWS CloudTrail | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaSenior-level Full TimeMexico2d ago
-
Big Data Lead MXN 934K-1100KAWS Glue | AWS Glue Data Catalog | AWS Kinesis | Amazon Athena | Amazon RedshiftSenior-level Full TimeMexico2d ago