Data Engineer - Web Scraping
Tasks
- Automate data collection workflows
- Build data ingestion pipelines
- Build internal automation tools
- Clean transform validate datasets
- Debug data pipeline incidents
- Design web scraping systems
- Develop web scrapers
- Implement data quality control checks
- Monitor optimize scraping workflows
- Orchestrate scraping workflows
Perks/Benefits
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Data Warehousing | Docker | Fiddler | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Postman | Python | SQL | Scrapy | Selenium | XPath
Education
Roles
Related jobs
-
AI Automation Team Lead (Remote, Contract) RON 272K-359KAI Agents | Automation workflows | Data Fluency | Integration development | Low CodeBirthday off | Paid time off | Reduced Friday hours | Remote work | Sick leaveSenior-level ContractRomania R22h ago
-
Senior Data Engineer (Snowflake) CAD 120K-145KAirbyte | Azure Data | Azure Data Factory | Coalesce.io | Data FactoryHybrid/Remote flexibility | Medical healthcare | Ongoing learning reimbursement | Referral bonuses | Sports compensationSenior-level Full TimeBulgaria, Georgia, Lithuania, Poland,Romania, Uzbekistan23h ago
-
AI | Backend Development | Cluster management | Container Orchestration | Data EngineeringSenior-level Full TimeBucharest, Romania1d ago
-
API Design | Backend architecture | Command Line | Command-line Interface | Database systemsCompany equipment | Continuous learning allowance | Flexible working hours | Fully remote | Health insurance allowanceSenior-level Full TimeRomania R1d ago
-
Devops Engineer RON 264K-288KAirflow | Alerting | ArgoCD | Bash | CI/CDAccess to 7 Card services | Access to tech learning platforms | Flexible benefit platform | Meal tickets | Medical insuranceSenior-level Full TimeBucharest, Bucharest, Romania1d ago
-
Senior AI / Full-Stack Software Engineer (Healthcare) RON 272K-359KAI Agents | Angular | Argo CD | Automation | Azure OpenAISenior-level Full TimeBucharest, Bucharest, Romania1d ago
-
Angular | BigQuery | CI/CD | Docker | GCPContinuous learning | Flexible working hours | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeBucharest, Romania1d ago
-
API Management | Admission controllers | Ansible | Apigee | BitbucketContinuous learning | Flexible working hours | Hybrid work model | Life insurance | Private healthcareSenior-level Full TimeBucharest, Romania1d ago
-
Ansible | Apache Airflow | BigQuery | Bitbucket | ChefContinuous learning | Diverse global culture | Flexible working hours | Hybrid work model | Life insuranceSenior-level Full TimeBucharest, Romania1d ago
-
Automated testing | BigQuery | CI/CD | Cloud Composer | Cloud platformContinuous learning | Flexible working hours | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeBucharest, Romania1d ago
-
Cloud Engineer (Data Platform Infrastructure Engineer) RON 164K-195KAWS | Alerting | Amazon EKS | Apache Flink | AutoscalingMid-level Full TimeBucurești, București, RO1d ago
-
Cloud Engineer (Data Platform Infrastructure Engineer) RON 164K-195KAWS | Alerting | Amazon EKS | Apache Flink | CI/CDAI assisted engineering tools | Documentation support | Knowledge sharing culture | On-call rotationMid-level Full TimeBucurești, București, RO1d ago
-
Lead Data Engineer RON 272K-430KAWS | Apache Airflow | Apache Iceberg | CloudFormation | DBTKnowledge sharing | Mentorship | Technical collaborationSenior-level Full TimeOradea, Romania2d ago
-
AWS | Autoscaling | Bash | CI/CD | Data PipelinesFully remote work | Healthcare coverage | Paid parental leave | Relocation assistance | Technical ownershipMid-level Full TimeRomania R2d ago
-
APIs | AWS | Azure | CI/CD | GCPFlexible workingMid-level Full TimeBucharest - Dacia One, Romania2d ago
-
Algorithms | Concurrency | Data Structures | Database systems | Distributed SystemsFlexible schedule | Health insurance | Parental leave | Remote work | Service Donation MatchingSenior-level Full TimeRomania R2d ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R2d ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami2d ago
-
Senior Python Engineer, DataFeed Team RON 295K-430KAPI Integration | APIs | Alerting | Apache Kafka | Asynchronous processingOn-call rotationSenior-level Contract Full TimeBucharest2d ago
-
AI Engineer RON 264K-396KAPI Architecture | AWS | Agent systems | Apache Spark | Azure25 vacation days | Focus Fridays | Generous leave package | Hybrid work | LinkedIn LearningSenior-level Full TimeBucharest, Bucharest, Romania R3d ago
-
Alerting | Amazon Redshift | Anomaly Detection | Batch Processing | CI/CDContinuous improvement opportunities | Cross-functional collaboration | Exposure to modern data validation frameworks | Fully remote work | Ownership over data reliability strategySenior-level Full TimeRomania R3d ago
-
Senior Data Platform Engineer RON 295K-430KAWS | AWS CDK | AWS Glue | AWS Lambda | AWS Step FunctionsHybrid workSenior-level Full TimeBucharest3d ago
-
Senior Data Engineer EUR 70K-90KCI/CD | ClickHouse | Docker | Elasticsearch | KafkaFlexible working hours | Learning time | Location Based Social Benefits | Remote-first | Team eventsSenior-level Full TimeGermany /Spain / Romania (Remote) R3d ago
-
Principal Data Engineer RON 264K-288KAmazon Web Services | Apache Spark | Azure | Azure Data | Azure Data FactoryAdditional annual leave based on tenure | Annual performance bonus | Employee referral bonus | Eyeglasses vouchers | Flexible working scheduleSenior-level Full TimeCluj, Romania3d ago
-
Senior Python Engineer (Gen AI) - L344Y638 USD 84K-95KAWS | CI/CD | Docker | EC2 | EKSCareer growth | Charity initiatives | Diversity and inclusion | Fully remote | Team-building activitiesSenior-level Full TimeBucharest, Romania R6d ago