Big Data Lead
Tasks
- Architect scalable batch and near real time data pipelines
- Collaborate with architects and stakeholders to align solutions
- Define data storage and transformation patterns
- Design event driven integration solutions
- Establish data quality observability monitoring logging
- Implement CI CD deployment automation and documentation
- Optimize data processing storage and query performance
- Review solution designs and production readiness
- Support cloud migration and data modernization
- Troubleshoot production issues and perform root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudTrail | AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch | Amazon DynamoDB | Amazon EMR | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | CI/CD | ETL | GitLab | Object-Oriented | Object-oriented programming | PySpark | Python | SQL | Step Functions | Terraform
Education
N/A
Roles
AWS Data Engineer | Big Data Engineer | Data Engineer | Engineer
Related jobs
-
Data Analytics & Visualization MXN 420K-456KAWS | Alteryx | Azure | Databricks | DomoCompetitive compensation and benefits | Inclusive work environment | Professional developmentMid-level Full TimeCiudad De Mexico, MX, 110008h ago
-
Business Intelligence Engineer MXN 789K-986KData Engineering | Data Governance | Data Modeling | Dimensional Model | Dimensional ModelingRemote workSenior-level Full TimeMexico13h ago
-
Data Management Engineer OnPrem ETL Sr MXN 270K-390KAzure SQL | Data Modeling | Data integration | Database Performance Analysis | Database performanceMid-level Full TimeMonterrey15h ago
-
Data QA Engineer – Enterprise Data | Mexico MXN 300K-300KApache JMeter | Data Normalization | Data Warehousing | Database Testing | ELTPaid time off | Remote work | Work autonomyEntry-level Full TimeMexico City R20h ago
-
Agent systems | Agentic Frameworks | Artificial Intelligence | CI/CD | Cloud BuildMid-level Full TimeNaucalpan de Juarez, MEX, Mexico23h ago
-
Senior-level Full TimeMexico1d ago
-
Big Data Lead MXN 934K-1100KAWS Glue | AWS Glue Data Catalog | AWS Kinesis | Amazon Athena | Amazon RedshiftSenior-level Full TimeMexico1d ago
-
Entry-level Full TimeMexico1d ago
-
Big Data Engineer MXN 780K-1080KAPI Integration | AWS Athena | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeMexico1d ago
-
Senior Data Engineer MXN 720K-1080KAWS | Azure | DBT | Data Governance | Data ProductsHybrid work model | Remote/office flexibilitySenior-level Full TimeGuadalajara - Jalisco - Mexico Zapopan …1d ago
-
Data Managment//Data analytics MXN 221K-221KAgile | Amazon Web Services | BI tools | BigQuery | Cause analysisPaid leave | Well-being culture | Work-life balanceEntry-level Full TimeAzcapotzalco, Ciudad de México, MX, 022301d ago
-
ABL - Data Engineer MXN 171K-171KData Denormalization | Data Modeling | Data Normalization | Data Warehousing | Database DesignRemote workEntry-level Full TimeAguascalientes, MX1d ago
-
Entry-level Full TimeMexico1d ago
-
Data Managmenrt//Data analytics MXN 276K-300KAgile methodologies | Amazon Web Services | Cloud platform | Data Lakes | Data MartsNo relocation assistance required | Paid leave | Wellbeing support | Work-life balance daysEntry-level Full TimeAzcapotzalco, Ciudad de México, Mexico R2d ago
-
Analytics Data science and IOT Lead MXN 934K-1100KMachine Learning | Probability | PyTorch | Python | SQLSenior-level Full TimeMexico2d ago
-
Python Cloud Native Lead MXN 911K-1300KAPI Integration | AWS CloudWatch | AWS Lambda | AWS Step Functions | AWS X-RaySenior-level Full TimeMexico2d ago
-
Sr. Systems Engineer, Datacenter Cloud Services MXN 720K-1080KAnsible | Azure DevOps | Business Continuity | DNS | Disaster RecoveryOn-call support rotationSenior-level Full TimeMexico, Mexico2d ago
-
API Integration | Access Control | Audit Logging | Automated testing | CI/CDAnnual offsite | Coworking allowance | Dependent coverage support | Employee equity | Flexible, asynchronous workMid-level Full TimeMexico R2d ago
-
Mid-level Full TimeMexico City2d ago
-
Mid-level Full TimeMexico City2d ago
-
Finance Artificial Intelligence MXN 360K-360KAI Agents | Access Control | Analytics engineering | Data Engineering | Data GovernanceMid-level Full TimeMexico City - Antara Tower A …2d ago
-
Senior-level Full TimeGuadalajara, Mexico2d ago
-
Senior Data Engineer MXN 900K-1080KAI Services | Azure | Azure AI | Azure AI Services | Azure DataMentorship programs | Networking events | Training and certifications support | Volunteering opportunities | Well-being initiativesSenior-level Full TimeAguascalientes, MX2d ago
-
Machine Learning Engineer MXN 420K-423KAWS | Apache Spark | Big Data | Docker | Google CloudCollaborative work environment | Hybrid work | Professional growth opportunities | Remote workMid-level Full TimeRemote - CDMX, CDMX, Mexico R2d ago
-
API | Artificial Intelligence | Copilot Studio | Dataverse | Git401k | Coaching | Dental insurance | Employee assistance program | Employee resource groupsMid-level Full TimeMexico2d ago