Senior Data Engineer - Web Scraping
Tasks
- Automate web scraping platform tools and applications
- Build maintain data pipelines to databases and data warehouses
- Clean transform manipulate large datasets
- Collaborate with analysts and cross-functional teams
- Create and manage alerting systems
- Design develop deploy maintain web scrapers
- Implement data quality control checks
- Investigate resolve data incidents
- Orchestrate scheduled workflows with Apache Airflow
- Support data product and infrastructure design
Perks/Benefits
- Autonomy
- Collaborative team environment
- Flexible work location
- Fully remote
- Innovation focused engineering environment
- Ownership
Skills/Tech-stack
APIs | AWS Lambda | AWS S3 | Amazon RDS | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Data Warehousing | Docker | GitHub Actions | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI tools | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCollaboration with multidisciplinary teams | Fully remote | Remote working flexibilitySenior-level Contract Full TimeMexico R23h ago
-
AI Governance | Access Control | Apache Airflow | Apache Iceberg | Apache RangerFully remote work | Health benefits | Home office setup allowance | Monthly stipend | Stock optionsSenior-level Full TimeMexico R1d ago
-
.NET | ARM Templates | ASP.Net Core | Active Directory | Application InsightsCareer development | Entrepreneurship opportunities | Internal research projects | International mobility | Intrapreneurship opportunitiesMid-level Full TimePALO IT Mexico R2d ago
-
FBS Senior Data Engineer (Airflow) MXN 900K-1300KAWS Glue | Amazon DynamoDB | Amazon RDS | Apache Airflow | CI/CDFlexible work arrangements | Paid time off | Private health insurance | Training and developmentSenior-level Full TimeMexico - Remote R2d ago
-
Business Intelligence Engineer MXN 789K-986KData Governance | Dimensional Modeling | KPI | Metrics | OntologyRemote workSenior-level Full TimeMexico R3d ago
-
Senior AWS Data Engineer MXN 950K-1300KAPIs | AWS Batch | AWS CloudTrail | AWS Glue | AWS LambdaContinuous learning | Radical Ownership | Remote workSenior-level Full TimeCiudad de México, CDMX, MX R3d ago
-
Data Infrastructure Architect MXN 950K-1300KAWS | AWS CloudTrail | AWS Glue | AWS Lambda | AWS Step FunctionsFlexible work arrangement | Remote workSenior-level Full TimeCiudad de México, CDMX, MX R3d ago
-
Lead Analytics Engineer MXN 934K-1300KAWS Glue | Amazon Athena | Amazon QuickSight | Amazon RDS | Amazon RedshiftFlexible work schedule | Remote work | Visa sponsorship supportSenior-level Full TimeCiudad de México, CDMX, MX R3d ago
-
Entry-level Full TimeCiudad de México, CDMX, MX R3d ago
-
DevOps Engineer (Data & AI Platform) MXN 1124K-1405KAWS | Apache Airflow | Apache Kafka | Apache Spark | BashEmployee resource groups | Flexible time off | Paid Holidays | Paid meal or grocery vouchers | Relocation bonusSenior-level Full TimeMexico City R3d ago
-
Big Data Engineer MXN 934K-1300KAPI Integration | AWS Athena | AWS Glue | AWS Lambda | AWS Step FunctionsContinuous learning | Flexible work environment | Hybrid work | Radical Ownership | Remote workSenior-level Full TimeCiudad de México, CDMX, MX R3d ago
-
Agile | Azure Synapse | Azure Synapse Analytics | Business Intelligence | Data AnalysisHybrid workMid-level Full Timeciudad de méxico R6d ago
-
Ingeniero de Datos Junior MXN 180K-204KAWS | Agile | Azure | Cause analysis | Cloud platformHybrid work | Technical documentationEntry-level Full TimeCiudad de México, CDMX, México R6d ago
-
AWS | Autogen | Azure | Chroma | CrewAICareer growth opportunities | Competitive pay | Employer vetted recruitment | Remote workMid-level Full TimeColumbia - Bogotá R6d ago
-
AWS | Agile | Amazon Redshift | Azure | BigQueryOffice attendance 3 times per weekMid-level Full TimeCiudad de México, CDMX, México R7d ago
-
Senior Data Engineer (R13923) MXN 900K-1300KAWS | AWS Redshift | Agile | Amazon S3 | Apache AirflowSenior-level Full TimeRemote - MX R7d ago
-
Data Engineer (Snowflake & GCP) MXN 540K-600KAlerting | Apache Iceberg | Cloud Storage | Cloud platform | Google CloudCareer plan and growth | International team collaboration | Long-term career growth | Remote-first | Technical leadershipSenior-level Contract Full TimeCiudad de México R7d ago
-
AWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCompetitive contract compensation | Flexible schedule | Fully remote | Ownership | Technical autonomySenior-level Contract Full TimeMexico R7d ago
-
Python Application Engineer MXN 934K-1300KAWS Lambda | AWS Step Functions | AWS X-Ray | CloudWatch | DatadogFully remoteSenior-level Full TimeCiudad de México, CDMX, MX R8d ago
-
Jr. MLOps Engineer MXN 108K-216KCI/CD | Data Preprocessing | Data Validation | DevOps | Feature EngineeringHybrid work | Life insurance | Medical insurance | Pension planEntry-level Full TimeMEX - Queretaro Business Services, Mexico R8d ago
-
Data QA Engineer – Enterprise Data | Mexico MXN 300K-300KApache JMeter | Data Normalization | Data Warehousing | Database Testing | ELTPaid time off | Remote work | Work autonomyEntry-level Full TimeMexico City R8d ago
-
Machine Learning Engineer MXN 420K-423KAWS | Apache Spark | Big Data | Docker | Google CloudCollaborative work environment | Hybrid work | Professional growth opportunities | Remote workMid-level Full TimeRemote - CDMX, CDMX, Mexico R10d ago
-
AWS | Amazon S3 | Apache Airflow | Data Pipelines | Data QualityCareer development and training | Flexible work arrangements | Paid time off | Pension plan | Private health insuranceMid-level Full TimeMexico - Remote R11d ago
-
Senior Full Stack Engineer ID78855 MXN 950K-1300KCI/CD | Cloud Computing | Databases | Docker | KubernetesAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeCiudad de México, Mexico R12d ago
-
Senior Full Stack Engineer ID78855 MXN 950K-1300KAI Assisted Development | CI/CD | Cloud | Databases | DockerAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipSenior-level Full TimeZapopan, Mexico R12d ago