Big Data Lead
Tasks
- Apply data governance and master data management
- Build Data Integration solutions
- Design resilient data pipelines
- Develop ETL pipelines
- Develop data models and metadata management
- Ensure failure recovery
- Implement logging monitoring retry logic idempotency
- Process large data volumes
- Use orchestration and workflow tools
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Lambda | AWS Step Functions | Apache Airflow | Automated testing | Azure Data | Azure Data Factory | CI/CD | Cloud Storage | Containerization | Data Factory | Data Governance | Data Lake | Data Management | Data Modeling | Data Warehousing | Distributed Computing | Failure recovery | Idempotency | Infrastructure as Code | Java | Kafka | Logging | Master Data | Master Data Management | Metadata Management | Monitoring | NoSQL | Observability | Python | Relational databases | SQL | Scala | Spark SQL | Step Functions | “as-code”
Education
Roles
Big Data Engineer | Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Related jobs
-
Business Intelligence Engineer MXN 789K-986KData Governance | Dimensional Modeling | KPI | Metrics | OntologyRemote workSenior-level Full TimeMexico R9h ago
-
Data Engineer Lead MXN 900K-1100KCTE | Common table expressions | Data Modeling | Data Pipelines | Data QualityCompany equipment | English lessons | Flexible working options | Learning opportunities | Mentorship programsSenior-level Full TimeGuadalajara, Jal., Mexico17h ago
-
DevOps Engineer (Data & AI Platform) MXN 1124K-1405KAWS | Apache Airflow | Apache Kafka | Apache Spark | BashEmployee resource groups | Flexible time off | Paid Holidays | Paid meal or grocery vouchers | Relocation bonusSenior-level Full TimeMexico City R19h ago
-
Embedded Software Engineer Jr MXN 120K-156KAndroid Debug Bridge | Android Shell | Automated testing | Bare Metal | C#Relocation supportEntry-level Full TimeGuadalajara, Jal., Mexico20h ago
-
Sr. AI Engineer MXN 720K-1080KAWS Bedrock | Azure Cognitive | Azure Cognitive Search | Azure Machine Learning | Azure OpenAISenior-level Full TimeMonterrey Business Center I, Mexico1d ago
-
Sr. AI Engineer MXN 720K-1080KAWS Bedrock | Azure Cognitive | Azure Cognitive Search | Azure Machine Learning | Azure OpenAISenior-level Full TimeMonterrey Business Center I, Mexico1d ago
-
Sr. AI Engineer MXN 720K-1080KAzure Cognitive | Azure Cognitive Search | Azure Machine Learning | Azure OpenAI | Cognitive SearchSenior-level Full TimeMonterrey Business Center I, Mexico1d ago
-
Apache Airflow | Apache NiFi | Data Governance | Data Modeling | Data QualityCareer growth opportunities | Direct hiring | Stability of employmentMid-level Full TimeQuintana Roo, Mexico2d ago
-
Agile | Azure Synapse | Azure Synapse Analytics | Business Intelligence | Data AnalysisHybrid workMid-level Full Timeciudad de méxico R3d ago
-
Data Engineer (SQL-focused) MXN 540K-600KCTE | Common table expressions | Data Flow | Data Modeling | Data TransformationCompany-provided equipment | English lessons | Flexible working options | Learning opportunities | Mentorship programEntry-level Full TimeGuadalajara, Jal., Mexico3d ago
-
Ingeniero de Datos Junior MXN 180K-204KAWS | Agile | Azure | Cause analysis | Cloud platformHybrid work | Technical documentationEntry-level Full TimeCiudad de México, CDMX, México R3d ago
-
Cloud Data Analytics Engineer MXN 548K-685KAWS | BI | CI/CD | CloudWatch | ContainerizationCareer growth opportunities | Collaborative global team | Remote-friendly environmentMid-level Full TimeMexico City, Ciudad de México, Mexico3d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | BigQueryFlexible hours US time zones | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R3d ago
-
AWS | Autogen | Azure | Chroma | CrewAICareer growth opportunities | Competitive pay | Employer vetted recruitment | Remote workMid-level Full TimeColumbia - Bogotá R3d ago
-
ASCET | ASPICE | Agile | Automotive ECU | C#Relocation financial support | Work-life balanceMid-level Full TimeGuadalajara, Jal., Mexico4d ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS Bedrock | AWS Step Functions | Airflow | Apache Spark | AthenaAnnual learning budget | Challenging projects | Collaborative culture | Flexible hours | Internal tech talksSenior-level Full TimePuebla (Heroica Puebla), Mexico4d ago
-
Lead Data Engineer ID71008 USD 155K-180KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeCiudad de México, Mexico4d ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Athena | BigQuery | ClickHouse | DAGCompetitive compensation reviews | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeLeón de los Aldama, Mexico4d ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Apache Spark | Athena | BedrockAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeMonterrey, Mexico4d ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAWS EKS | Amazon S3 | Apache Airflow | Apache Spark | AthenaAnnual learning budget | Annual performance reviews | Flexible hours | Mentorship | People focused supportSenior-level Full TimePlayas de Rosarito, Mexico4d ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAmazon S3 | Apache Airflow | Apache Spark | Athena | ClickHouseAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeGuadalajara, Mexico4d ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Amazon S3 | Apache Spark | Apache Spark SQL | AthenaAnnual performance reviews | Collaborative environment | Flexible hours | Learning budget | MentorshipSenior-level Full TimeQuerétaro, Mexico4d ago
-
Lead Data Engineer ID71008 MXN 990K-1300KAirflow | Athena | BigQuery | ClickHouse | Cost OptimizationAnnual compensation reviews | Annual learning budget | Flexible hours | Mentorship | Performance reviewsSenior-level Full TimeZapopan, Mexico4d ago
-
AWS | BigQuery | ClickHouse | Cloud Computing | Data EngineeringFlexible work location | Inclusive workplace culture | Professional growth opportunities | Remote-friendly work environmentMid-level Full TimeMexico R4d ago
-
Sr. Data Engineer - Integrations MXN 900K-1080KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure FunctionsAgile team environment | MentorshipSenior-level Full TimeMexico - Mexico City4d ago