Lead Data Engineer ID71008
USD 155K-180K (estimate) Senior-level Full Time
Tasks
- Build scheduled workflows and dependencies
- Collaborate with DevOps on requirements
- Create partitioning and file format strategy
- Define analytical data architecture
- Define triggering strategy for pipelines
- Design and own ETL pipelines
- Design schema and data type strategy
- Drive AWS data lake architecture
- Implement near real time OLAP processing
- Integrate Athena and serverless query engine
- Lead developers and align engineering practices
- Orchestrate batch workflows with DAGs
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Flexible hours
- Learning budget
- Mentorship
- People focused support
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
Airflow | Amazon S3 | Athena | BigQuery | ClickHouse | Code review | DAG | Data Lake | Data pipeline | DevOps Collaboration | Docker | Dockerfile | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | Near-real-time | Near-real-time Processing | OLAP | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Presto | Python | REST | Real-time Processing | Schema Design | Serverless Query | Snowflake | Spark SQL | Time processing | Trino | Trino/Presto
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
States
Related jobs
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS Bedrock | AWS Step Functions | Airflow | Apache Spark | AthenaAnnual learning budget | Challenging projects | Collaborative culture | Flexible hours | Internal tech talksSenior-level Full TimePuebla (Heroica Puebla), Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Athena | BigQuery | ClickHouse | DAGCompetitive compensation reviews | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeLeón de los Aldama, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Apache Spark | Athena | BedrockAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeMonterrey, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS EKS | Amazon S3 | Apache Airflow | Apache Spark | AthenaAnnual learning budget | Annual performance reviews | Flexible hours | Mentorship | People focused supportSenior-level Full TimePlayas de Rosarito, Mexico7h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAmazon S3 | Apache Airflow | Apache Spark | Athena | ClickHouseAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeGuadalajara, Mexico7h ago
-
Agile | Automated builds | Automated testing | Azure DevOps | C#Cross-regional collaboration | Full-time flexibility | Travel to United StatesMid-level Full TimeGuadalajara, Jal., Mexico22h ago
-
Senior-level Full TimeMexico1d ago
-
Senior Data Engineer (R13923) MXN 900K-1300KAWS | AWS Redshift | Agile | Amazon S3 | Apache AirflowSenior-level Full TimeRemote - MX R1d ago
-
Data Engineer (Snowflake & GCP) MXN 540K-600KAlerting | Apache Iceberg | Cloud Storage | Cloud platform | Google CloudCareer plan and growth | International team collaboration | Long-term career growth | Remote-first | Technical leadershipSenior-level Contract Full TimeCiudad de México R1d ago
-
AWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCompetitive contract compensation | Flexible schedule | Fully remote | Ownership | Technical autonomySenior-level Contract Full TimeMexico R1d ago
-
Data Analytics & Visualization MXN 420K-456KAWS | Alteryx | Azure | Databricks | DomoCompetitive compensation and benefits | Inclusive work environment | Professional developmentMid-level Full TimeCiudad De Mexico, MX, 110001d ago
-
Python Application Engineer MXN 934K-1300KAWS Lambda | AWS Step Functions | AWS X-Ray | CloudWatch | DatadogFully remoteSenior-level Full TimeCiudad de México, CDMX, MX R1d ago
-
Data Management Engineer OnPrem ETL Sr MXN 270K-390KAzure SQL | Data Modeling | Data integration | Database Performance Analysis | Database performanceMid-level Full TimeMonterrey1d ago
-
Data QA Engineer – Enterprise Data | Mexico MXN 300K-300KApache JMeter | Data Normalization | Data Warehousing | Database Testing | ELTPaid time off | Remote work | Work autonomyEntry-level Full TimeMexico City R1d ago
-
Agent systems | Agentic Frameworks | Artificial Intelligence | CI/CD | Cloud BuildMid-level Full TimeNaucalpan de Juarez, MEX, Mexico2d ago
-
Senior-level Full TimeMexico2d ago
-
Big Data Lead MXN 950K-1300KAWS CloudTrail | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaSenior-level Full TimeMexico2d ago
-
Big Data Lead MXN 934K-1100KAWS Glue | AWS Glue Data Catalog | AWS Kinesis | Amazon Athena | Amazon RedshiftSenior-level Full TimeMexico2d ago
-
Entry-level Full TimeMexico2d ago
-
Big Data Engineer MXN 780K-1080KAPI Integration | AWS Athena | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeMexico2d ago
-
Big Data Lead MXN 789K-1080KAWS Glue | Amazon Athena | Amazon QuickSight | Amazon Redshift | Amazon S3Senior-level Full TimeMexico2d ago
-
Senior Data Engineer MXN 934K-1300KData Modeling | Data Pipelines | Data Quality | Data Reliability | Data performanceCompany-provided equipment | English lessons | Flexible working options | Learning opportunities | Mentorship programsSenior-level Full TimeGuadalajara, Jal., Mexico2d ago
-
Senior Data Engineer MXN 720K-1080KAWS | Azure | DBT | Data Governance | Data ProductsHybrid work model | Remote/office flexibilitySenior-level Full TimeGuadalajara - Jalisco - Mexico Zapopan …2d ago
-
Data Managment//Data analytics MXN 221K-221KAgile | Amazon Web Services | BI tools | BigQuery | Cause analysisPaid leave | Well-being culture | Work-life balanceEntry-level Full TimeAzcapotzalco, Ciudad de México, MX, 022302d ago
-
Site Reliability Engineer, Data Protection MXN 950K-1100KAnsible | Bash | Bitbucket | Capacity Planning | Cause analysisSenior-level Full TimeMexico City, Mexico2d ago