Big Data Lead
Tasks
- Automate data export and import
- Develop Python ETL pipelines
- Generate code using Jinja templates
- Implement dbt tests for data validation
- Optimize SQL queries for performance
- Orchestrate pipelines for sequential and parallel execution
- Schedule ETL jobs with Apache Airflow
- Track pipeline runs and reprocess error records
- Troubleshoot data pipeline errors
- Use GitHub for version control and CI/CD
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS IAM | Amazon ECS | Amazon S3 | Apache Airflow | CI/CD | CSV | DBT | GitHub | JSON | Jinja | Python | SQL | XML
Education
N/A
Roles
Related jobs
-
Staff Gen AI Developer MXN 990K-1300KAWS Lambda | Automated testing | CI/CD | Cloud Computing | EmbeddingsDental insurance | Health insurance | Hybrid work | Learning days | PTOSenior-level Full TimeGuadalajara, Jalisco, Mexico14h ago
-
Senior Digital Analytics Engineer MXN 911K-1100KBigQuery | Event Tracking | Google Analytics | Google Analytics 4 | Google TagSenior-level Full TimeBrazil; Colombia; Costa Rica; Mexico; Peru18h ago
-
Agile | Analytics reporting | Automation Scripting | Cloud Computing | Data AnalysisMid-level Full TimeIrapuato, GUA, Mexico20h ago
-
Embedded Linux SW Engineer - Computer Enhanced MXN 239K-268KASPICE | Agile | Automotive Flash Over The Air | Bootloaders | C#Work-life balanceMid-level Full TimeGuadalajara, Jal., Mexico20h ago
-
Data Analytics Specialist MXN 420K-420KAWS | Azure Data | Azure Data Factory | Azure Data Lake | Azure StorageAnnual performance bonus | Attractive benefits | Learning and development opportunitiesMid-level Full TimeQRO-Mars México, Mexico1d ago
-
C# | C++ | Dataiku | GitHub | Object-OrientedEntry-level Full Time InternshipQueretaro, Mexico1d ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksAccess to courses and certifications | Birthday day off | English classes | Great Place to Work recognition | Hybrid work modelSenior-level Full TimeGuadalajara, Jalisco, Mexico - Remote R1d ago
-
AI API | AI API integration | API Integration | Agile | AnthropicInternational collaboration | Part-time contract | Remote workSenior-level Full TimeMexico R1d ago
-
Entry-level Full TimeMexico1d ago
-
Full Stack AI Engineer - Security MXN 650K-720KAWS | Adversarial ML | Anomaly Detection | Cybersecurity | Data PipelinesRemote workMid-level Full TimeQuerétaro, Mexico R1d ago
-
AI/ML Security Engineer MXN 480K-480KAWS | Adversarial Machine Learning | Anomaly Detection | Django | DockerCollaborative & Inclusive Culture | Remote work opportunityMid-level Full TimeCDMX, MEX, Mexico R1d ago
-
Ingeniero de Datos Cloud AWS, Snowflake Senior MXN 420K-420KAWS | Agile | Automation | Data Governance | Data LakeSenior-level Full TimeMexico R1d ago
-
Senior Data Engineer MXN 789K-1080KAgile | Apache Spark | Azure Data | Azure Data Services | Data ArchitectureCoursera license | Employee referral bonus | Grocery vouchers | Major medical expenses insurance | PTOSenior-level Full TimeGuadalajara, Jal., Mexico1d ago
-
Corporate Data Engineer II, Strategy MXN 934K-1300KAWS | AWS Lambda | AWS RDS | AWS Redshift | AgileSenior-level Full TimeGuadalajara, Mexico2d ago
-
Senior AI/ML Engineer - Technology MXN 841K-1100KCI/CD | Deep learning | Experiment tracking | Fine Tuning | Hugging FacePaid time off | Remote work | Work with top American companies | Workplace autonomySenior-level Full TimeMexico City R2d ago
-
Embedded Software Engineer Jr MXN 120K-156KADB | Android | Automated testing | Bare Metal | C#Relocation supportEntry-level Full TimeGuadalajara, Jal., Mexico2d ago
-
Full Stack AI Engineer - Security MXN 650K-720KAPI Design | AWS | Adversarial Machine Learning | Anomaly Detection | CybersecurityInclusive work culture | Remote workMid-level Full TimeCDMX, MEX, Mexico R2d ago
-
AWS | Airflow | Docker | Jupyter | NumPyAutonomy | Flexible schedule | Fully remote | International team collaboration | Professional growthSenior-level Full TimeMexico R2d ago
-
Staff Data Analytics Engineer USD 159K-220KApache Airflow | Apache Spark | BigQuery | DBT | Data ContractsFlexible working hours | Remote work flexibilitySenior-level Full TimeAmericas - Remote, US - Remote, … R2d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageEmployee assistance program | Mindfulness programs | On demand digital course library | OnTrack Program | Premium Calm membershipMid-level Full TimeMexico Mexico City R2d ago
-
ABL - Ingeniero de Inteligencia Artificial (AI Engineer) MXN 144K-164KAPIs | Azure | Data Pipelines | Data Quality | Data TransformationHybrid workEntry-level Full TimeAguascalientes, MX2d ago
-
Sr AI ML Engineer (Remote) MXN 721K-986KAWS SageMaker | Airflow | CI/CD | Data Engineering | DatabricksRemote workSenior-level Full TimeGuadalajara, JAL, MX R2d ago
-
AI Engineer MXN 698K-800KA2A | Asynchronous Architecture | Asyncio | Autogen | Automated retrainingSenior-level Full TimeMexico - Remote R2d ago
-
Lider tecnico (Conversational AI) MXN 432K-456KAnomaly Detection | Boosting | CI/CD | Clustering | DockerSenior-level Full TimeMexico - Remote R2d ago
-
AWS | AWS Services | CI/CD | Data Lake | GitHubMid-level Full TimePARQUES BBVA BANCOMER, Mexico2d ago