Senior Data Collection Engineer (Python / Web Scraping)
Tasks
- Architect scraping infrastructure
- Automate infrastructure with DevOps practices
- Build asynchronous data collection pipelines
- Create monitoring alerting and logging
- Develop scraping components
- Implement anti bot blocking mitigation
- Integrate REST APIs
- Maintain data ingestion pipelines
- Set engineering standards and mentor teammates
Perks/Benefits
- Flexible working arrangements
- International engineering team
- Learning and coaching
- Optional office near Berlin
- Remote-first culture
Skills/Tech-stack
Alerting | Anti-Bot | Anti-bot evasion | Asynchronous programming | Bot Evasion | Browser Automation | Browser Fingerprinting | CAPTCHA | CI/CD | Captcha Solving | Docker | Git | HTML parsing | HTTP | Linux | Logging | Monitoring | NoSQL | Playwright | Proxy rotation | Python | REST APIs | Requests | SQL | Scrapy | Selenium | Web Scraping
Education
N/A
Regions
States
Related jobs
-
Data Architect / Engineer MXN 950K-1250KAirflow | Change Data Capture | Cloud Data | Cloud Data Services | Data CaptureSenior-level Full TimeSan José, Medellin, Bogota, Mexico City, …1d ago
-
Data Architect / Engineer BRL 305K-396KAirflow | Cloud Data | Cloud Data Services | Data Governance | Data LineageSenior-level Full TimeSão Paulo1d ago
-
AWS Glue | Amazon EMR | Amazon Web Services | Apache Airflow | Apache SparkEntry-level Contract Full TimeMexico1d ago
-
AWS | Azure | Cloud platform | Data Governance | Data ObservabilityMid-level Full TimeSão Paulo, Brazil1d ago
-
Executive-level Full TimeMexico City, Mexico City, Mexico; Mexico, …1d ago
-
[Job-31236] SR/ Mid Level AI Engineer , (Brazil) BRL 44K-44K.NET | Agentic SDLC | Angular | Artificial Intelligence | CsharpChildcare support | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveMid-level Full TimeBrazil1d ago
-
Senior Data Engineer COP 90840K-102180KApache Spark | CI/CD | CTE | DBT | Databricks SQLRemote workSenior-level Full TimeColombia1d ago
-
Manager/ Sr. Manager - Analytics Consulting MXN 789K-990KCloud Platforms | HDFS | Hadoop | Hive | Machine LearningCareer development opportunities | High individual responsibility | Small, fast-growing environmentSenior-level Full TimeMexico City, Mexico - Remote R1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google Cloud100 percent distributed team | Asynchronous culture | Friendly work environmentMid-level Full TimeSão Paulo, Brazil1d ago
-
Bash | Data Ingestion | Data Ingestion Pipeline | Data Processing | DockerAsynchronous culture | Competitive salary | Friendly and laid-back atmosphereMid-level Full TimeRecife, Brazil1d ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeMonterrey, Mexico1d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Processing | DockerAsynchronous culture | Diverse and inclusive workplace | Friendly laid-back atmosphereMid-level Full TimeMontevideo, Uruguay1d ago
-
Machine Learning Engineer Lead CAD 160K-190KAirflow | Amazon Web Services | Cloud platform | Deep learning | DockerAnnual trip | Birthday off | English lessons | Extra vacation week | Monthly childcare reimbursementSenior-level Full TimeArgentina R1d ago
-
Senior Data Engineer BRL 234K-295KAWS Data | AWS Glue | AWS data platform | Amazon Web Services | Apache FlinkSenior-level Full TimeSao Paulo, SP, Brazil R1d ago
-
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS Step FunctionsAutonomy | Continuous learning | Fully remote | MentorshipSenior-level Full TimeBrazil R1d ago
-
Apache Spark | Big Data | Data Mining | Data Modeling | Data PipelinesBonus Salaries | Childcare assistance | Dental insurance | Extended parental leave | Flexible working hoursSenior-level Full TimeBrasil R1d ago
-
Engenharia de Dados AWS (Pleno/Sênior) | Remota - 135547 BRL 119K-132KAWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step FunctionsCollaborative team | Flexible working independently | Remote workSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados AWS (Pleno/Sênior) | Remota - 135546 BRL 119K-132KAWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step FunctionsFlexible work time | Remote workSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Mid-level Full TimeRemote - Brazil R2d ago
-
Mid-level Full TimeRemote - Argentina R2d ago
-
Mid-level Full TimeRemote - Mexico R2d ago
-
Mid-level Full TimeColombia2d ago
-
Agentic AI DevOps Specialist GBP 40K-85KCI/CD | Container Registry | Docker | GitHub Actions | HelmAnnual team trip | Birthday off | Certification coverage | English lessons | Extra vacation weekMid-level Full TimeArgentina R2d ago
-
Senior-level Full TimeCiudad de México, CDMX, MX R3d ago
-
Analytics Engineer MXN 405K-485KAccounting | Accruals | BI Dashboard | BigQuery | Data QualityCatered lunches | Co-working travel perk | Disability insurance | Health insurance | Home office equipment allowanceMid-level Full TimeMexico City, CDMX3d ago