Data Engineer - Web Scraping
Tasks
- Build data ingestion pipelines
- Clean transform validate large datasets
- Design automated web scraping systems
- Develop internal automation tools
- Implement quality control checks
- Investigate data pipeline incidents
- Process and transform large scale data
- Schedule monitor optimize scraping workflows
Perks/Benefits
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Postman | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Software Engineer, AI/ML, Google Meet SEK 1000K-1030KColor correction | Data Processing | Deblurring | Debugging | Deep learningBenefits | Bonus | EquitySenior-level Full TimeStockholm, Sweden1d ago
-
Data Engineer på det medarbetarägda konsultbolaget! SEK 420K-600KAmazon Web Services | Artificial Intelligence | Azure | Business Intelligence | Data ArchitectureEntry-level Full TimeGöteborg, Sweden2d ago
-
Apache Avro | Apache Beam | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeStockholm, Sweden2d ago
-
Alerting | Amazon Redshift | Aurora PostgreSQL | CI/CD | Cause analysisCollaboration with cross-functional teams | Exposure to modern data validation frameworks and observability technologies | Fully remote work | Opportunities for continuous improvement | Ownership over data reliability strategySenior-level Full TimeSweden R3d ago
-
Embedded Software Engineer, Lund SEK 720K-937KC# | C++ | Code review | Debugging | Embedded LinuxCompany bonus | Health insurance | Wellbeing benefits | Wellness allowance | Work-life balanceSenior-level Full TimeSweden - Lund3d ago
-
Embedded Software Engineer SEK 336K-420KAgile | Automotive Communication Protocols | Automotive communication | Bash | Build systemsEntry-level Full TimeMalmö, Skåne County, Sweden3d ago
-
Senior Machine Learning Engineer SEK 831K-1045KData Preparation | Debugging | GPU Computing | Inference | JAXSenior-level Full TimeSweden3d ago
-
Member of Technical Staff, Machine Learning SEK 831K-1045KData Pipelines | Fine Tuning | GPU Computing | Inference | JAXSenior-level Full TimeSweden3d ago
-
Full Stack Engineer, AI systems SEK 836K-1030KAPI Design | Anthropic | Docker | JavaScript | KubernetesSenior-level Full TimeSweden3d ago
-
Backend Engineer, AI (Agent Systems) SEK 775K-1030KAnthropic | Batching | Caching | Distributed Systems | DockerMid-level Full TimeSweden3d ago
-
Senior-level Full TimeSweden3d ago
-
Staff/Lead Python Engineer (FastAPI, Orchestration) EUR 82K-112KAsynchronous programming | Cloud platform | Concurrent programming | FastAPI | GenAIAnnual learning and development budget | Co-working budget | Company laptop | Enhanced parental leave | Flexible scheduleSenior-level Full TimeRemote Anywhere R4d ago
-
Member of Technical Staff - Platform Engineering USD 220K-300KAWS | Amazon Web Services | Auto Scaling | CI/CD | Capacity PlanningIn-person work optionsSenior-level Full TimeNew York4d ago
-
Senior Data Engineer SEK 775K-930KAirbyte | Airflow | BigQuery | CI/CD | Cloud platformExperimentation with new technologies | Learning and development opportunitiesSenior-level Full TimeStockholm, Sweden4d ago
-
Senior Data Engineer SEK 775K-930KAWS | Airbyte | Airflow | Azure | BigQueryCollaborative work culture | Experimentation time | Professional developmentSenior-level Full TimeStockholm, Sweden4d ago
-
Senior-level Full TimeStockholm, Sweden4d ago
-
Analytics Engineer SEK 775K-930KAccess Management | BigQuery | Cloud platform | DBT | Data GovernanceSenior-level Full TimeStockholm, Sweden4d ago
-
Senior C++ Engineer to Net Insight's Zyntai solution SEK 775K-930KAES | Automatic control | C++ | Continuous integration | CryptographyFamily-friendly policies | Flexible working hours | Low employee turnover | Pair programming opportunities | Team-focused cultureSenior-level Full TimeStockholm, Sweden6d ago
-
Senior-level Full TimeStockholm6d ago
-
Engineering - Internal AI Transformation USD 74K-110KAPIs | Agentic Workflows | Auditability | Authentication | DockerAnnual company offsite | Co-working stipend | Learning and development stipend | Social travel stipendEntry-level Full TimeUnited States R6d ago
-
Data Engineer till B3 Skilled i Malmö! SEK 510K-670KApache Airflow | Build tool | Cloud | Cloud platform | Data BuildEmployee initiative program | Supportive team | Training opportunities | Wellness programEntry-level Full TimeMalmö, Sweden7d ago
-
Staff AI Engineer - 2nd Horizon | Sweden | Remote SEK 878K-1100KAPI Integration | AWS | Agent Frameworks | Cloud Native | Cloud platformAnnual leave | Remote work | Shutdown daysSenior-level Full TimeSweden (Remote) R7d ago
-
Data Platform Engineer, Solna SEK 720K-937KAzure | Azure Data | Azure Data Lake | Azure Databricks | Azure NetworkingSenior-level Full TimeSolna8d ago
-
Cloud Computing | Containers | Data Architecture | Design Patterns | GoAgile working environment | Continuous learning | Cross-functional collaboration | Room to InfluenceMid-level Full TimeStockholm8d ago
-
Applied AI Engineer (Sweden) SEK 682K-820KAccuracy | Automation | CRM | Compliance | Cost OptimizationFast interview process | Remote workMid-level Full TimeSweden8d ago