Senior Data Engineer - Web Scraping
Tasks
- Automate web scraping platform improvements
- Build data pipelines
- Build data products and tools
- Clean and transform datasets with Python
- Collaborate with stakeholders on data requirements
- Create data quality checks
- Design web scrapers
- Ingest data into databases and data warehouses
- Orchestrate workflows with Apache Airflow
- Set up alerting and incident response
Perks/Benefits
- Fully remote
- Innovation focus
- Operational excellence focus
- Ownership and trust
- Professional growth opportunities
- Team-oriented environment
- Workplace autonomy
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Docker | GitHub Actions | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AWS | Amazon RDS | Amazon Redshift | Apache Airflow | Cause analysisAnnual company retreats | Flexible working hours | Paid annual leave | Performance incentives | Premium equipmentSenior-level Full TimeNetherlands R21h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Exposure to modern Azure data ecosystem | Fully remote | Opportunity to contribute to digital transformation | Remote work flexibilitySenior-level Contract Full TimeNetherlands R23h ago
-
Quantum R&D Engineer – Processors EUR 45K-50KC QED | COMSOL | Cryogenic measurement | HFSS | KlayoutFlexible working hours | Hybrid work setup | L D support | Offsites | Open vacation policyMid-level Full TimeDelft R1d ago
-
CQED | Crosstalk mitigation | Cryogenic measurement | Data Analysis | Data acquisitionFlexible working hours | Hybrid work | L and D budget | Offsites | Open vacation policyMid-level Full TimeDelft R1d ago
-
AI Engineer - FDE (Forward Deployed Engineer) EUR 54K-72KAWS | Agent systems | Apache Spark | Azure | Data AnalysisRemote work | Travel once every 4 to 8 weeksSenior-level Full TimeAmsterdam, Netherlands R2d ago
-
API Security | AWS | Apache Kafka | Authentication | Authorization100 percent remote work | Flexible location within eligible region | High-growth environment | High-quality IT equipment | Team events and offsite weeksSenior-level Full TimeNetherlands R2d ago
-
Forward Deployed Engineer EUR 52K-72KAWS | Airflow | Apache Spark | Azure | Cloud ComputingHybrid work environment | Internal promotions | Learning and development | Lunch provided | Onefit membership discountMid-level Full TimeStationsplein 32, 3511 ED Utrecht R3d ago
-
Airflow | Anomaly Detection | BigQuery | DBT | Data ModelingCommuter transport card | Dog-friendly office | EAP support | Equipment provided | Gym membership discountSenior-level Full TimeAmsterdam, Netherlands R3d ago
-
Area Lead Analytics Engineer EUR 86K-117KAirflow | Amazon Redshift | Apache Iceberg | Cloud Cost Optimization | Cost OptimizationCommute transit card | Digital mental health support | Discounted gym membership | Dog-friendly office | Employee assistance programSenior-level Full TimeAmsterdam, Netherlands R3d ago
-
Senior-level Full TimeRemote - Netherlands R4d ago
-
AI DevOps Engineer EUR 60K-86KAI Services | ARM | AudioCodes Session Border Controller | Audiocodes | Automated DeploymentDevelopment budget | Employee benefit budget | Holiday allowance | Hybrid working | Pension planMid-level Full TimeUtrecht Croeselaan 18, Netherlands R4d ago
-
Dagster | Data Exploration | Data Processing | Deep learning | FionaFlexible working across eligible locations | Fully remote work | Impactful climate technology projects | Inclusive culture | International team collaborationSenior-level Full TimeNetherlands R6d ago
-
AWS | AWS CloudFormation | Access Control | Access Management | AzureSenior-level Full TimeAmsterdam, Netherlands R7d ago
-
Senior Data Engineer II, Trust & Safety EUR 85K-115KAgile | Amazon Kinesis | Apache Flink | Apache Spark | Apache StormDog-friendly office | Employee assistance program | Gym membership subsidy | Home office support | Lunch allowanceSenior-level Full TimeAmsterdam, Netherlands R7d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lake | AWS Lake FormationContract opportunity | Fully remote flexibility | Technical autonomySenior-level Contract Full TimeNetherlands R7d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Contract opportunity | Direct influence on data strategy | Fully remote | High ownership | International collaborationSenior-level Contract Full TimeNetherlands R8d ago
-
Agentic AI Engineer - Power Platform EUR 60K-86KAPI connectors | Azure DevOps | CI/CD | Copilot Studio | DataverseEmployee benefit budget | Holiday allowance | Hybrid work | Pension plan | Personal development budgetSenior-level Full TimeUtrecht Croeselaan 18, Netherlands R8d ago
-
Senior ML Engineer (AI Research/ Portability) GBP 190K-230KAPI Design | Agent systems | Authentication | CI/CD | Code reviewCareer growth | Collaborative culture | Flexibility | International environment | Learning opportunitiesSenior-level Full TimeAmsterdam, Netherlands; Remote - Europe; United … R8d ago
-
Senior ML Engineer (AI Research, Physical AI) GBP 92K-173KComputer Vision | Control | Deep learning | Distributed Computing | Distributed TrainingCareer growth and learning opportunities | Collaborative culture | Flexibility | International environment | OwnershipSenior-level Full TimeAmsterdam, Netherlands; Remote - Europe; United … R8d ago
-
AWS | Artificial Intelligence | Benchmarking | CI/CD | ContainerizationCareer growth | Fully remoteSenior-level Full TimeNetherlands R8d ago
-
AI Engineer EUR 60K-90KAWS | Agentic AI | Azure | CI/CD | Cloud ComputingCommunity events | Conference access | Development budget | Free Lunches | Hybrid workSenior-level Full TimeAmsterdam, Noord-Holland, Netherlands R9d ago
-
Analytics Engineer EUR 55K-75KCloud Platforms | DBT | Data Modeling | Data Transformation | Data pipelineBook budget | Community events | Conference attendance | Development budget | Dog-friendly officeSenior-level Full TimeAmsterdam, Noord-Holland, Netherlands R9d ago
-
AI Engineer EUR 61K-89KAgentic AI | CI/CD | Cloud Platforms | Data Engineering | Generative AIBook budget | Community events | Conference attendance | Development budget | Hybrid workSenior-level Full TimeEindhoven, Noord-Brabant, Netherlands R9d ago
-
Fullstack Machine Learning Developer (Junie) GBP 100K-131KAgent workflows | Command Line | Command-line Interface | Cost Optimization | Language ModelsExtra time off | Gym or Sports Stipend | Language classes | Learning and development | Lunch allowanceMid-level Full TimeAmsterdam, Netherlands; Belgrade, Serbia; Berlin, Germany; … R10d ago
-
Data Engineer EUR 75K-115KAPI Development | AWS | Agile | Artificial Intelligence | AzureCertification reimbursement | Learning and development program | Paid vacation days | Pension plan | Profit shareMid-level Full TimeEindhoven, NB, Netherlands R14d ago