Lead Data Engineer ID71008
Tasks
- Collaborate with DevOps on requirements and constraints
- Define partitioning and file formats
- Design ETL pipelines
- Design schema and data types
- Drive AWS data stack architecture
- Implement near real time processing
- Lead engineering team and mentor developers
- Orchestrate scheduled batch workflows with Airflow
- Own data pipeline architecture
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Collaborative culture
- Flexible hours
- Mentorship
- No micromanagement
- People focused support
- Performance reviews
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
AI Assisted Development | AI-Assisted Development Tools | Amazon EKS | Amazon S3 | Apache Airflow | Athena | BigQuery | ClickHouse | Code Quality | DAG | Data Lake | Data pipeline | Development tools | Docker | ETL | FastAPI | Flask | GraphQL | Kubernetes | Linux Terminal | MacOS | Near-real-time | Near-real-time Processing | OLAP | ORC | Object storage | Parquet | Partitioning Strategy | PostgreSQL | Presto | Pull request | Pull request review | Python | REST | Real-time Processing | Schema Design | Serverless Querying | Snowflake | Spark SQL | Time processing | Trino | Trino/Presto
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Lead Data Engineer ID71008 MXN 990K-1300KAI Assisted Development | AI-Assisted Development Tools | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Collaborative culture | Competitive compensation reviews | Flexible hours | Learning budgetSenior-level Full TimeZapopan, Mexico4h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAmazon S3 | Apache Airflow | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimePlayas de Rosarito, Mexico4h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Collaborative culture | Flexible hours | Health programs | MentorshipSenior-level Full TimeGuadalajara, Mexico4h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAI Assisted Development | AWS EKS | Amazon S3 | Apache Airflow | AthenaAnnual performance reviews | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeMonterrey, Mexico4h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAmazon Athena | Amazon S3 | Apache Airflow | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Mentorship | Remote work | Support tailored to locationSenior-level Full TimeLeón de los Aldama, Mexico4h ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAmazon S3 | Apache Airflow | Athena | BigQuery | ClickHouseAnnual performance reviews | Collaborative culture | Flexible hours | Internal tech talks | Learning budgetSenior-level Full TimePuebla (Heroica Puebla), Mexico4h ago
-
Lead Data Engineer ID71008 USD 147K-180KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeCiudad de México, Mexico4h ago
-
Agent systems | Cloud Computing | Cloud platform | Cost Per | Cost Per RequestMid-level Full TimeMexico City, CDMX, Mexico; Buenos Aires, …8h ago
-
AI Solutions Architect (LLMs & AI Agents) MXN 950K-1300KAWS | Agent Orchestration | Agent guardrails | Autogen | AzureFlexible work arrangements | Hybrid work | In-person collaboration | Inclusive workplaceSenior-level Full TimeMX446 - DXC Mexico City Lago … R19h ago
-
AI Solution Leader MXN 950K-1250KAgent Orchestration | Agentic Systems | Artificial Intelligence | Automation | CRMFlexibility for wellbeing | In-person collaboration | Work style flexibilitySenior-level Full TimeMX446 - DXC Mexico City Lago …19h ago
-
AI Engineer MXN 990K-1300K.Net Core | Analytical Data | Analytical data design | C# | Claude CodeIn-person collaboration | Inclusive environment | Work flexibilitySenior-level Full TimeMX446 - DXC Mexico City Lago …19h ago
-
Cientifico De Datos MXN 336K-336KData Analysis | Data Studio | Data Visualization | Exploratory Data Analysis | Google Data StudioBirthday day off | Bonus | Family protection club | Paid time off | Professional development supportMid-level Full TimeCuliacán, Sinaloa, Mexico20h ago
-
Cloud & AI DevOps Engineer MXN 360K-385KAWS | Agile | Azure | Bash | CI/CDAdditional paid time offMid-level Full TimeAzcapotzalco, Ciudad de México, Mexico22h ago
-
Data Scientist NLP (AI) Engineer MXN 950K-1250KAPIs | Access Management | Adversarial Testing | Agent systems | Agentic AISenior-level Full TimeMexico23h ago
-
Big Data Lead MXN 950K-1300KAWS Lambda | AWS Step Functions | Apache Airflow | Apache Kafka | Azure DataContinuous learning | Fully remoteSenior-level Full TimeCiudad de México, CDMX, MX R1d ago
-
DevOps Engineer (Data & AI Platform) MXN 1124K-1405KAWS | Bash | CI/CD | Docker | GitCatered lunch | Employee resource groups | Flexible time off | Monthly meal grocery voucher | Paid HolidaysSenior-level Full TimeMexico City R1d ago
-
Benchmarking | Deep learning | Embeddings | Explainable AI | Language ModelsFully remote | Healthcare coverage | Long-term B2B contractSenior-level Full TimeMexico R1d ago
-
API Integration | Agile | Automation | Cloud Platforms | Data GovernanceSenior-level Full TimeMEX – General Office Telework, Mexico1d ago
-
Devops Support MXN 310K-310KCause analysis | Databricks | Incident Management | Jira | Monitoring and troubleshootingContinuous learning | Digital learning platform | Internal academies | MentorshipEntry-level Full TimeAguascalientes, MX1d ago
-
AI Lead Architect / Engineer MXN 950K-1300KAI architecture | API Design | Agent Orchestration | Agentic AI | Agentic AI architectureDigital learning platform access | Internal academies | MentorshipSenior-level Full TimeAguascalientes, MX1d ago
-
Cloud & AI DevOps Engineer MXN 360K-385KAWS | Agile | Automation | Azure | BashAdditional paid days offMid-level Full TimeAzcapotzalco, Ciudad de México, MX, 022301d ago
-
Senior-level Full TimeRemote - CDMX, CDMX, Mexico R1d ago
-
Analyst - Data Engineering USD 95KAPI Integration | Data Ingestion | Data Modeling | Data Quality | Data pipelineHybrid work flexibility | Inclusive workplace culture | Professional development opportunities | Supportive leadersMid-level Full TimeMexico City - Paseo R1d ago
-
Senior AI Engineer MXN 911K-1250KAWS | AWS Bedrock | AWS Bedrock Agents | Agentic Systems | AzureCompany-provided equipment | English lessons | Flexible working options | Learning opportunities | Mentorship programsSenior-level Full TimeGuadalajara, Jal., Mexico3d ago
-
Mid-level Full TimeGuadalajara, Jalisco, Mexico3d ago