Senior Data Collection Engineer (Python / Web Scraping)
Tasks
- Architect scraping infrastructure
- Automate infrastructure with DevOps practices
- Build asynchronous data collection pipelines
- Create monitoring alerting and logging
- Develop scraping components
- Implement anti bot blocking mitigation
- Integrate REST APIs
- Maintain data ingestion pipelines
- Set engineering standards and mentor teammates
Perks/Benefits
- Flexible working arrangements
- International engineering team
- Learning and coaching
- Optional office near Berlin
- Remote-first culture
Skills/Tech-stack
Alerting | Anti-Bot | Anti-bot evasion | Asynchronous programming | Bot Evasion | Browser Automation | Browser Fingerprinting | CAPTCHA | CI/CD | Captcha Solving | Docker | Git | HTML parsing | HTTP | Linux | Logging | Monitoring | NoSQL | Playwright | Proxy rotation | Python | REST APIs | Requests | SQL | Scrapy | Selenium | Web Scraping
Education
N/A
Regions
States
Related jobs
-
Ablation Studies | Active Learning | Adversarial Testing | Attention Mechanisms | BPEFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growthMid-level Full TimeBrazil R8h ago
-
API Management | AWS | Apigee | Bash | CI/CDFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growth opportunitiesSenior-level Full TimeBrazil R8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Career growth opportunities | Entrepreneurial team environment | Flexible remote workMid-level Full TimeBuenos Aires, Argentina9h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career growth opportunity | Competitive salary | Friendly work environment | Impact on learning accessibilityMid-level Full TimeRio de Janeiro, Brazil9h ago
-
Bash | Data pipeline | Docker | GCP | LinuxAsynchronous culture | Inclusive workplace | Remote work opportunityMid-level Full TimePorto Alegre, Brazil9h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote/distributed workMid-level Full TimeSalvador, Brazil9h ago
-
Bash | CI/CD | Cloud platform | Data Ingestion | Data ProcessingAsynchronous work culture | Friendly laid-back atmosphere | Opportunity to build life changing productMid-level Full TimeCórdoba, Argentina9h ago
-
Senior Machine Learning Engineer USD 139K-258KAPI Security | Authentication | Azure | CI/CD | DBTRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru17h ago
-
AI Systems Engineer CAD 135K-158KAutoscaling | Benchmarking | CI/CD | Distributed Systems | DockerCareer growth opportunities | Cutting-edge AI tools | Inclusive work environment | Robust training programSenior-level Full TimeBuenos Aires, Argentina17h ago
-
Anthropic API | Autogen | CI/CD | CrewAI | EmbeddingFlexible time zone alignment | Remote work | Technical assessmentSenior-level Full TimeUkraine - Kyiv17h ago
-
API Integration | Automation | Blaze Advisor | CI/CD | Data AnalysisChildcare support | Dental insurance | Extended parental leave | Gym membership | Health insuranceSenior-level Full TimeBrazil19h ago
-
[Job-30060] Engenheiro de Dados Sênior , Brazil BRL 18K-18KAzure | Azure DevOps | Azure Machine Learning | CI/CD | Data GovernanceChildcare support | Dental insurance | Discount club | Extended parental leave | GympassSenior-level Full TimeBrazil20h ago
-
Anomaly Detection | Azure Databricks | CI/CD | Classification | ClusteringChildcare assistance | Dental insurance | Extended parental leave | Food allowance | Gym membership discountMid-level Full TimeBrazil20h ago
-
[Job - 30376] AI Developer PL/SR (.NET + AWS) BRL 132K-144K.NET | AWS Lambda | Agent planning | Amazon DynamoDB | Amazon EC2Senior-level Full TimeBrazil23h ago
-
Analista de Ciência de Dados em IA Pleno BRL 78K-160KAdversarial Testing | Bias detection | Chunking | Embeddings | FairnessCLT employment | Flexible schedule | Remote workSenior-level Full TimeSão Paulo1d ago
-
Analista de Desenvolvimento de Software Sênior BRL 118K-119KAWS | Automated testing | CI/CD | DDD | Design PatternsSenior-level Full TimeSão Paulo, Brazil1d ago
-
AWS | AWS CDK | AWS CodePipeline | AWS Lambda | AWS Step FunctionsChildcare assistance | Continuous learning platform | Dental insurance | Employee discounts | Extended parental leaveSenior-level Full TimeBrazil1d ago
-
AWS | Agile | Apache Airflow | CI/CD | Cloud platformBirthday day off | Childcare assistance | Dental insurance | Education Discounts | Extended parental leaveMid-level Full TimeBrazil1d ago
-
Sr. Data Engineer USD 45K-50KC# | Cloud pipelines | Data Governance | Data Modeling | Data PipelinesAdditional days off | Birthday gift | Childcare assistance | Educational discounts | Gym discountsSenior-level Full TimeBuenos Aires, Argentina1d ago
-
AI Observability | API Integration | AWS Bedrock | AWS Lambda | AWS Step FunctionsAccessibility Support Program | Childcare assistance | Continuous learning opportunities | Dental insurance | Discount club benefitsMid-level Full TimeBrazil1d ago
-
CUDA | Computer Vision | Deep learning | GPU Optimization | Image ProcessingCollaborative environment | Flexible work location | Fully remote | Professional growth opportunitiesSenior-level Full TimeBrazil R1d ago
-
CUDA | Computer Vision | Deep learning | GPU Programming | Machine LearningCollaborative team | Flexible work hours | Fully remoteSenior-level Full TimeBrazil R1d ago
-
AWS Glue | Apache Airflow | Apache Kafka | Apache Spark | BigQueryCollaborative environment | Continuous learning | Fully remote work | Professional growth opportunitiesMid-level Full TimeBrazil R1d ago
-
AWS | Apache Spark | Azure | Data Governance | Data QualityChildcare assistance | Corporate university | Dental insurance | Educational partnerships | Fitness programEntry-level Full TimeOSASCO, Brazil; OSASCO, SP, Brazil; OSASCO1d ago
-
Mid-level Full TimeAguascalientes, MX R1d ago