Senior Data Collection Engineer (Python / Web Scraping)
Tasks
- Architect scraping infrastructure
- Automate infrastructure with DevOps practices
- Build asynchronous data collection pipelines
- Create monitoring alerting and logging
- Develop scraping components
- Implement anti bot blocking mitigation
- Integrate REST APIs
- Maintain data ingestion pipelines
- Set engineering standards and mentor teammates
Perks/Benefits
- Flexible working arrangements
- International engineering team
- Learning and coaching
- Optional office near Berlin
- Remote-first culture
Skills/Tech-stack
Alerting | Anti-Bot | Anti-bot evasion | Asynchronous programming | Bot Evasion | Browser Automation | Browser Fingerprinting | CAPTCHA | CI/CD | Captcha Solving | Docker | Git | HTML parsing | HTTP | Linux | Logging | Monitoring | NoSQL | Playwright | Proxy rotation | Python | REST APIs | Requests | SQL | Scrapy | Selenium | Web Scraping
Education
N/A
Regions
States
Related jobs
-
Associate TSE II MXN 360K-360KAWS | Azure | Benchmarking | Cloud Manager | Cloud platformHybrid workMid-level Full TimeMexico City13h ago
-
Mid-level Full TimeMexico City13h ago
-
Senior Data Engineer MXN 934K-1300KAnalytics engineering | Data Modeling | Data Quality | Data performance | Data pipelineAI learning paths | Career development plans | Company-provided equipment | English lessons | Flexible working optionsSenior-level Full TimeGuadalajara, Jal., Mexico14h ago
-
Senior Analytics Engineer USD 66K-66KAirflow | Business Intelligence | Code review | DBT | DagsterEquity | Flexible time off | MacBook equipment | Paid Holidays | Remote-friendly workSenior-level Full TimeBrazil R15h ago
-
Senior Analytics Engineer COP 113244K-125000KCause analysis | DBT | Data Modeling | Data Monitoring | Data QualityMentorship | Opportunity for growth and impact | Remote work during US business hours | Travel for team/offsitesSenior-level Full TimeBogotá, Colombia R15h ago
-
Senior Data Scientist / Deployment Engineer BRL 183K-183KC# | Data Pipelines | ETL | Fraud Detection | JavaExtended parental leave | Flexible remote and hybrid working options | Generous PTO | Learning and development opportunities | Mental health benefitsSenior-level Full TimeBrazil - Sao Paulo17h ago
-
Senior-level Full TimeBrazil17h ago
-
DevOps Engineer BRL 180K-240KAKS | AWS | AWS certification | Active Directory | AnsibleRemote workSenior-level Full TimeBrazil18h ago
-
Senior AI Engineer COP 95420K-101090KAWS | Amazon Textract | Confidence scoring | Data Validation | Document AISenior-level Full TimeColombia R19h ago
-
AWS ECS | AWS ECS Fargate | Agentic tools | Anthropic Claude | Async pipelinesAsync communication | Continuous learning | High ownership | Remote workMid-level Full TimeBrazil (Remote) R20h ago
-
[Job-30874] Senior AI Engineer, Colombia COP 113244K-125000KAPI Integration | Audit trails | BPMN | Compliance | Control flowCI T University | Life insurance | Maternity leave | Meal voucher | Mobile services subsidySenior-level Full TimeColombia22h ago
-
[Job-30874] Senior AI Engineer, Brazil BRL 183K-183KAPI Integration | Agentic Systems | BPMN | Business Process | Business process modelingChildcare assistance | Continuous learning | Dental insurance | Gym membership discounts | Health insuranceSenior-level Full TimeBrazil22h ago
-
Software Engineer, Data & AI Applications BRL 305K-396KAPI | Access Control | Agent workflow | Airbyte | Automated testingFlexible work arrangements | Professional developmentSenior-level Full TimeBrazil R1d ago
-
APIs | Agent systems | Cloud Consulting | Cloud platform | Cost PerMid-level Full TimeSão Paulo, State of São Paulo, …1d ago
-
AI SDR | Agile | CRM automation | Calendly API | JavaFlexible time zone alignment | Remote workSenior-level Full TimeBrazil / Argentina / Peru / …1d ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeMexico City, Mexico1d ago
-
Software Engineer, Data Infrastructure & Acquisition - Bogotá, Colombia COP 36000K-36000KBash | Cloud infrastructure | Data Processing | Docker | GCPMid-level Full TimeBogotá, Colombia1d ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible work environment | Remote workMid-level Full TimeFlorianópolis, Brazil1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Remote distributed settingMid-level Full TimeMedellín, Colombia1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Professional growth opportunitiesMid-level Full TimeGuadalajara, Mexico1d ago
-
Mid-level Full TimeGuadalupe, Mexico1d ago
-
Mid-level Full TimeGuadalupe, Mexico1d ago
-
Jr Cloud Data Engineer MXN 240K-260KAgile | Cloud platform | Databricks | ETL | Google CloudAcademy program | Continuous learning | Inclusive work environment | Mentorship | Training opportunitiesEntry-level Full TimeAguascalientes, MX1d ago
-
Jr Cloud Data Engineer MXN 240K-240KAzure | ETL | Google Cloud | Python | SQLInclusion focus | On-site work | Structured development program | Team mentorshipEntry-level Full TimeAguascalientes, MX1d ago
-
Jr Cloud Data Engineer MXN 204K-216KAgile | Azure | Cloud platform | Data Modeling | Data PipelinesContinuous learning | Global collaboration | Mentorship | Training opportunities | Volunteering opportunitiesEntry-level Full TimeAguascalientes, MX1d ago