Data Engineer - Web Scraping
Tasks
- Build data ingestion pipelines
- Clean transform validate large datasets
- Create scalable data processing workflows
- Design automated data collection systems
- Develop automation frameworks and internal tools
- Develop web scrapers
- Implement data quality control checks
- Investigate resolve data pipeline incidents
- Schedule monitor optimize scraping workflows
Perks/Benefits
- Collaborative team culture
- Continuous learning
- Flexible technology focused environment
- High ownership and autonomy
- Professional growth
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Data Quality | Data Validation | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Access Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Company-sponsored coursework | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeZapopan, Jalisco, Mexico R11h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeTijuana, Mexico R11h ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeSan Luis Potosi, Mexico R11h ago
-
Access Control | Automated scaling | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeSaltillo, Coahuila, Mexico R11h ago
-
Access Control | Agile | Azure Data | Azure Data Factory | Azure Data LakeCompany Sponsored Coursework Exams and Certifications | Continuing education | Flexible working hours | Paid time off | Remote workSenior-level Full TimePuebla City, Mexico R11h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeNaucalpan, Mexico R11h ago
-
Access Control | Agile | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Company-sponsored coursework | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeMérida, Yucatán, Mexico R11h ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeMonterrey, Nuevo León, Mexico R11h ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Continuing education | Flexible working hours | Paid time off | Remote workSenior-level Full TimeMexico City, Mexico R11h ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany Sponsored Coursework Exams and Certifications | Continuing education training conferences | Flexible working hours | Paid time off | Remote workSenior-level Full TimeMexicali, Baja California, Mexico R11h ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-paid certifications | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeLeón, Guanajuato, Mexico R11h ago
-
Access Control | Automation | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Conference opportunities | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeHermosillo, Sonora, Mexico R11h ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeGuadalajara, Jalisco, Mexico R11h ago
-
Access Control | Agile | Azure | Azure Data | Azure Data FactoryCompany-sponsored certifications | Company-sponsored coursework | Conference attendance | Continuing education | Flexible working hoursSenior-level Full TimeGuadalupe, Nuevo León, Mexico R11h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCompany sponsored certifications and exams | Conference support | Continuing education and training | Flexible working hours | Paid time offSenior-level Full TimeEcatepec de Morelos, Mexico R11h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCompany sponsored exams | Company-sponsored certifications | Conferences | Continuing education | Flexible working hoursSenior-level Full TimeCuliacán, Sinaloa, Mexico R11h ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeCiudad Juárez, Mexico R11h ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany sponsored certifications exams and coursework | Conference opportunities | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeChihuahua City, Mexico R11h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCompany sponsored certification support | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeAguascalientes, Mexico R11h ago
-
Analytics Associate Director, GOC MXN 380K-420KAdobe Analytics | Amazon Redshift | Amazon Web Services | Azure DevOps | Business IntelligenceDental insurance | Employee Learning and Development | Employee resource groups | Medical insurance | Mental Health Awareness DaysMid-level Full TimeBarranquilla, Colombia; Bogota, Colombia; Medellin, Colombia; … R12h ago
-
Senior Data Engineer MXN 900K-1080KAWS | Amazon Redshift | Amazon S3 | Apache Airflow | AzureEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeMexico City, MEX, Mexico13h ago
-
Mid-level Full TimePenang, Malaysia13h ago
-
Entry-level Full TimeMexico16h ago
-
Data Engineer Middle GCP MXN 444K-480KApache Airflow | BigQuery | Cloud platform | Data Lake | Data ModelingContinuous learning | International project opportunities | Life insurance | Medical insurance | Professional developmentSenior-level Full TimeMexico City, CDMX, Mexico20h ago
-
Sr. Solutions Engineer MXN 911K-1100KAWS | Apache Spark | Azure | Cloud Integration | Data WarehousingTravel up to 50 percentSenior-level Full TimeMexico City22h ago