Data Engineer - Web Scraping
Tasks
- Build web scraping systems
- Clean transform validate datasets
- Develop automated data collection workflows
- Develop internal automation tools
- Implement data quality control checks
- Ingest data into databases and data warehouses
- Monitor and troubleshoot data pipelines
- Orchestrate scraping workflows
Perks/Benefits
- Collaborative team culture
- Continuous learning
- Flexible work environment
- High ownership and autonomy
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Data Quality | Data pipeline | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Postman | Python | SQL | Scrapy | Selenium | XPath
Education
Roles
Data Engineer | Engineer | Scraping Engineer | Web Scraping Engineer
Related jobs
-
Data engineer gyakornok HUF 3600K-3600KData Pipelines | Data Visualization | Docker | Git | GitHubFlexible work hours | Health insurance | Home office | Meal benefitsEntry-level Full Time InternshipBudapest, Hungary20h ago
-
Senior Data Engineer PLN 177K-312KAWS CloudFormation | AWS Glue | AWS Step Functions | Amazon Athena | Amazon DynamoDBIn office hybrid or remote flexibility | International projects | Medical healthcare | Ongoing learning and reimbursement | Recognition programSenior-level Full TimeBulgaria, Hungary, Poland23h ago
-
Automated testing | C plus plus | CI/CD | Data Analysis | DevSecOpsEntry-level Part TimeHungary1d ago
-
Lead AI Engineer HUF 17157K-26400KAWS | Agile | Apache Spark | CI/CD | ConfluenceContinuous learning culture | Mentorship | Open source contribution culture | Team collaborationSenior-level Full TimeBudapest, Hungary1d ago
-
Data Engineer gyakornok HUF 4068K-4068KDatabricks | Docker | Git | Grafana | KubernetesEmployee discounts | Flexible working hours | Health insurance coverage | Home office support | Relocation supportEntry-level Full Time InternshipBudapest, Hungary2d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Event | Azure Event HubsFlexible work arrangements | Home office possibility | On call support schedule | Secure long term job opportunityMid-level Full TimePécs, Baranya, HU, 76222d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Event | Azure Event HubsFlexible work arrangements | Home office possibility | Long-term job opportunityMid-level Full TimeBudapest, Pest, HU, 11122d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Event | Azure Event HubsFlexible work arrangements | Home office possibility | On-call support rotation | Secure long term job opportunityMid-level Full TimeDebrecen, Hajdú-Bihar, HU, 40242d ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R2d ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami2d ago
-
Data Engineer HUF 12648K-18000KAPI Gateway | AWS API | AWS API Gateway | AWS DMS | AWS GlueCareer development | Company mobile phone | Fitness-wellness allowance | Hybrid work model | Meal benefitsMid-level Full TimeBudapest R2d ago
-
Senior Python Engineer, DataFeed Team HUF 18000K-26400KAlerting | Apache Kafka | Asyncio | Data Pipelines | DebuggingOn-call rotationSenior-level Contract Full TimeBudapest2d ago
-
Senior AI Software Engineer HUF 18000K-26400KAI Search | AI Services | Anthropic | Autogen | Azure401k | Dental coverage | Employee assistance program | Employee resource groups | Flexible time offSenior-level Full TimeDEBRECEN, HAJDÚ BIHAR, Hungary3d ago
-
AI Engineer (HU/RO/SRB) HUF 12540K-18480KAWS | AWS Bedrock | Anthropic SDK | Azure | Azure OpenAIFlexible schedule | Healthcare | Home office kit | International projectsMid-level Full TimeSzeged, Hungary4d ago
-
AI Engineer (Europe) HUF 12540K-18000KAWS | Agentic Workflows | Apache Spark | Azure | CI/CDFlexible work-life balance | International projects | Learning & development opportunities | Mentoring systemMid-level Contract Full TimeBudapest, Hungary6d ago
-
Embedded Software Engineer 1 EUR 37K-62KAUTOSAR | C plus plus | C# | CAN | CI/CDCompany gatherings | Dog-friendly office | Family support | Flexible working hours | Holidays bonusEntry-level Full TimeKerestinec, HR6d ago
-
Senior/Lead Machine Learning Engineer PLN 275K-404KAWS CDK | AWS CloudFormation | AWS EMR | AWS Glue | AWS LambdaHybrid options | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBulgaria, Hungary, Poland6d ago
-
Senior Machine Learning Engineer PLN 295K-480KAWS Bedrock | AWS CDK | AWS CloudFormation | AWS Lambda | AWS SageMakerHybrid flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Remote flexibilitySenior-level Full TimeBulgaria, Hungary, Poland6d ago
-
Senior Data Engineer HUF 14400K-20640KAWS | Azure | Consulting | Data Modeling | Data WarehousePersonal mentoring | Professional development | Strong team culture | Team gatherings | Work-life balanceSenior-level Full TimeBudapest, Hungary7d ago
-
Artificial Intelligence | Cursor | Embeddings | GitHub Copilot | LLM APIsCareer development | Flexible working models | International virtual rotations | Paid training | Rotational programEntry-level Full TimeBudapest, HU, 10318d ago
-
GBS Data Analytics, Sr. Analyst HUF 14400K-20400KAgile | Artificial Intelligence | CI/CD | Cloud Data | Cloud Data PlatformsAnnual bonus | Cafeteria benefits | Global career growth opportunities | Hybrid work | Learning and development programsSenior-level Full TimeBudapest, Hungary8d ago
-
Senior GenAI Engineer | Hungary HUF 14400K-20900KAI Foundry | AI Search | AWS Bedrock | Agentic Systems | Azure AICareer growth and promotions | Hybrid work | International environment | Professional development supportSenior-level Full TimeHungary, Budapest9d ago
-
Embedded Software Engineer HUF 14400K-24000KC++ | Continuous integration | Control loops | Embedded Software | FirmwareCatered lunch | Development opportunities | Free 3D prints | Free beverages and snacks | Hybrid workSenior-level Full TimeBudapest, Hungary9d ago
-
Data Pipelines | Distributed data | Distributed data pipelines | Experiment design | LinuxDedicated learning budget | Mental wellbeing resources | Paid Team Social Events | Paid health insurance | Pension matchSenior-level Full TimeBudapest, Hungary;9d ago
-
Access Control | Air-gapped | Ansible | ArgoCD | GPUEU based customer support | Remote work in HungarySenior-level Full TimeBudapest, Szeged, Pécs, Debrecen, Hungary13d ago