Data Engineer - Web Scraping
Tasks
- Build data ingestion pipelines
- Build scalable data processing workflows
- Clean transform validate datasets
- Design web scraping systems
- Develop automated data collection systems
- Develop automation frameworks
- Implement data quality control checks
- Investigate data pipeline issues
- Schedule monitor and optimize scraping workflows
Perks/Benefits
- Autonomy
- Collaborative culture
- Continuous learning
- Flexible work environment
- High ownership
- Professional growth
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Roles
Related jobs
-
Senior Quantum Error Correction Engineer DKK 715K-1201KAI | C plus plus | Circuit Level Noise | Circuit Level Noise Modeling | Error correctionSenior-level Full TimeDenmark, Copenhagen, Kongens Lyngby1d ago
-
Senior Compute Platform Engineer DKK 715K-1201KAmazon Athena | Amazon EC2 | Amazon S3 | Apache Airflow | Apache HadoopCode review culture | Hybrid work environment | MentorshipSenior-level Full TimeCopenhagen, Denmark2d ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R2d ago
-
Research Engineer, Algorithms USD 300K-400KAnalog computation | Attention Mechanism | Efficient Attention | Inference Optimization | KV cacheMid-level Full TimeNew York City4d ago
-
Media Decision Science Manager DKK 491K-720KApache Spark | Automation | Data Governance | Data Modeling | Data PipelinesColleague discount | Family care leave | Headspace app | Hybrid work model | Life and disability insuranceMid-level Full TimeCopenhagen Hub - Løvstræde, Denmark8d ago
-
Quantum Operations Engineer, Control Systems DKK 570K-838KC++ | FPGA | FPGA design | GPU | NVIDIA CUDAAfter-hours On-Call Rotation | Disability insurance | Life insurance | Paid time off | Pension planMid-level Full TimeCopenhagen8d ago
-
Senior AI Engineer DKK 541K-580KAzure | Azure OpenAI | CI/CD | Docker | FastAPIMentoring programs | Professional development | Travel opportunitiesSenior-level Full TimeHedehusene-RW-HQ, Denmark10d ago
-
Data Engineer at Novo Nordisk Engineering DKK 570K-838KAzure Synapse | Azure Synapse Analytics | Data Modeling | Data Warehousing | Lakehouse ArchitectureEntry-level Full TimeVirum, Denmark; Virum10d ago
-
AI Solutions Engineer DKK 541K-704KAI Agents | Automation | Git | JavaScript | LLMHybrid work model | Learning days | Udemy access | Volunteer days | Well-being benefitsMid-level Full TimeAarhus, Denmark13d ago
-
Student assistant at SDU Robotics DKK 433K-433K3D Design | C++ | English communication | Manufacturing | PythonAgile team experience | Healthcare Robotics ExposureEntry-level Full TimeOdense M, Danmark14d ago
-
Join PwC’s Deals Analytics and AI team and help build AI-powered solutions that shape the future of deal delivery in M&A DKK 499K-720KAI Agents | APIs | Data analytics | Deployment | Language ModelsCareer development opportunities | Coaching | On-the-job learning | TrainingMid-level Full TimeHellerup - Strandvejen 44, Denmark14d ago
-
Data Scientist, AI Fashion Planning DKK 480K-720KData Analysis | Databricks | Machine Learning | Predictive Modeling | PythonCareer growth | Opportunity to explore new ideas | Supportive work environment | Working with modern AI toolsMid-level Full TimeAarhus C, DK, 800014d ago
-
Experienced Data Engineer DKK 600K-650KAPI | Amazon Web Services | Azure DevOps | Cloud platform | DBTLearning time | Paid vacation | Social events | Unlimited unpaid time off | Work-life balanceSenior-level Full TimeKøbenhavn, Denmark14d ago
-
Data Engineer DKK 600K-650KAPIs | AWS | Azure | CI/CD | Cloud platformLearning opportunities | Mentorship | Paid vacation | Social events | Unlimited unpaid time offSenior-level Full TimeKøbenhavn, Denmark14d ago
-
Part-time Data Engineer Consultant DKK 306K-340KAPI | AWS | Azure | Azure DevOps | CI/CDFlexible time off | Learning and certification support | Self paid time off | Social eventsEntry-level Part TimeKøbenhavn, Denmark14d ago
-
AI Software Developer DKK 651K-936K3D data | 3D data processing | C# | Data Management | Data ProcessingFlexible remote work options | Healthy work-life balanceSenior-level Full TimeKøbenhavn, Denmark15d ago
-
Foundational Data Engineer USD 275K-340KData Engineering | Data Lineage | Data Pipelines | Data Quality | Data VersioningMid-level Full TimeNew York City15d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible remote distributed workMid-level Full TimeAarhus, Denmark19d ago
-
Student Assistant - AI Engineer DKK 320K-350KAzure | CSS | Cloud platform | Cloud technologies | Google CloudCanteen | Health insurance | Mentorship | On-site fitness center | Portfolio ExperienceEntry-level Part TimeHedehusene-RW-HQ, Denmark21d ago
-
Mid-Senior AI Engineer DKK 516K-580KAgent communication | Agent to Agent | Agent-to-Agent Communication | Agentic search | CI/CDSenior-level Full TimeHedehusene, 84, DK, 264022d ago
-
Senior-level Full TimeHedehusene, 84, DK, 264022d ago
-
Senior AI Engineer DKK 516K-580KEvaluation | Golden Dataset | LLM | MLOps | Model versioningHealth insurance | Hybrid work model | Lunch scheme | Pension scheme | Professional development supportSenior-level Full TimeAarhus N, Denmark22d ago
-
AI Observability | AWS | Agent systems | Anthropic Claude | CI/CDHybrid work flexibilityExecutive-level Full TimeCopenhagen23d ago
-
AI Engineer – Consulting Tools DKK 499K-720KAWS | Azure | CI/CD | Docker | EvaluationDedicated time for research and learning | Mentorship programme | Peer learning environment | Structured professional development | Work-life balanceMid-level Full TimeCopenhagen, Denmark23d ago
-
C# | Go | Java | Node.js | PHPCareer pathing | Continuous professional development | Hybrid work environment | Inclusive company culture | Mentor/Buddy programSenior-level Full TimeAmsterdam, The Netherlands; Copenhagen, Denmark; London, …24d ago