Data Engineer - Web Scraping
Tasks
- Build data ingestion pipelines
- Clean transform validate datasets
- Design web scraping systems
- Develop automation tools and frameworks
- Implement data quality control checks
- Schedule monitor and optimize scraping workflows
- Troubleshoot data pipeline issues
Perks/Benefits
- Collaborative culture
- Continuous learning
- Flexible work environment
- High ownership and autonomy
- Professional growth
- Technology-focused projects
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Data Warehouse | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Roles
Related jobs
-
Senior AI Engineer (m/f/d) USD 100K-140K.NET | AI Search | AIOps | API Integration | AWS100 percent salary during sick leave | 4 weeks remote work per year | Childcare support | Coursera access | Experience daysSenior-level Full TimeMadrid, MD, Spain R19h ago
-
Data Engineer (Graduate Program Barcelona) EUR 19K-19KData Normalization | Data Quality | NoSQL | Python | SQLEntry-level Full TimeBarcelona, Spain23h ago
-
Senior AI Engineer (m/f/d) EUR 36K-45K.NET | AI Search | AIOps | API Integration | AngularChildcare support | Coursera access | Experience days | Flexible hours | Free specialist access for health wellbeingSenior-level Full TimeGranada, AN, Spain R1d ago
-
Senior Data Engineer - Platform EUR 62K-79KBigQuery | Cloud Functions | Cloud Run | Cloud platform | Data LakesOpen Source friendly | Training and certificationSenior-level Full TimeMadrid1d ago
-
Tech Lead (Data Platform) EUR 36K-45KAlloyDB | BigQuery | Cloud platform | DBT | Data ContractsAccident insurance | Flexible compensation | Health insurance | Life insurance | Paid time offSenior-level Full TimeValencia, VALENCIA, Spain1d ago
-
API Design | Backend architecture | Command Line | Command-line Interface | Database systemsCompany-provided equipment | Continuous learning allowance | Flexible working hours | Fully remote work | Health insurance allowanceSenior-level Full TimeSpain R1d ago
-
APIs | Apache Spark | Azure Data | Azure Data Factory | Data FactoryMid-level Full TimeValencia, Spain1d ago
-
Machine Learning Engineer EUR 19K-19KAWS SageMaker | Amazon Athena | Amazon EC2 | Amazon EMR | Amazon S3Gym allowance | LinkedIn Learning | Meal vouchers | Monthly team events | Private health insuranceEntry-level Full TimeBarcelona, Barcelona1d ago
-
Senior Data Engineer Databricks (m/f/d) EUR 36K-45KAmazon Web Services | Apache Spark | Azure | CI/CD | Cloud platform100 percent salary during sick leave | Childcare support | Coursera access | Flexible compensation | Flexible scheduleSenior-level Full TimeReus, CT, Spain R1d ago
-
AI Engineer EUR 44K-70KA I | A I Agent | A I Agent Orchestration | A/B | A/B TestingAdditional paid leave | Fitness and wellness memberships | Language apps | Personal development budget | Premium bank account subscriptionMid-level Full TimeBarcelona1d ago
-
Computer Vision | Deep learning | Device Machine Learning | Fine Tuning | JAXSenior-level Full TimeBarcelona1d ago
-
Desarrollador BIG DATA - AWS EUR 43K-49KAWS | AWS Identity | AWS Identity and Access Management | AWS Lake | AWS Lake FormationSenior-level Full TimeSpain2d ago
-
Lead, Finance Analytics & Enablement AI/ML EUR 56K-77KAmplitude | Automation | Business Intelligence | Cloud platform | Data EngineeringAccident insurance | Co-working access | Gym allowance | Life insurance | Parental leaveSenior-level Full TimeSpain - Remote R2d ago
-
Automated testing | CI/CD | Computer Vision | Conda | DockerBirthday off | Home-office allowance | Hybrid work | Local holidays | Paid vacationSenior-level Full TimeMadrid, Remote EURO, Remote US R2d ago
-
Senior Data Engineer EUR 55K-74KAmazon Web Services | Apache Airflow | Apache Iceberg | Apache Spark | Argo WorkflowsEducational budget | Flexible remuneration | Flexible working hours | Hybrid work | Language classesSenior-level Full TimeDonostia, Spain2d ago
-
Site Reliability Engineer - Data Platform EUR 69K-88KAWS | AmazonRDS | AmazonS3 | ArgoCD | CI/CDAdditional annual leave | Career development budget | Discounts | Fitness & wellness memberships | Language appsMid-level Full TimeBarcelona2d ago
-
Senior Knowledge & AI Architect EUR 60K-86KAgent Orchestration | Autogen | Cypher | DCAT | ETL PipelinesDental benefits | Hybrid work organization | Learning and development | Life and accident insurance | Meals and transportation vouchersSenior-level Full TimeBarcelona, CT, Spain2d ago
-
A/B | A/B Testing | AWS | Autoscaling | B testingEquity package | Fully remote work Europe | Healthcare coverage | Paid parental leave | Professional growthMid-level Full TimeSpain R2d ago
-
AWS | Big Data | C++ | Computer Vision | CryptographyDiversity | International collaborationEntry-level Full Time InternshipMARTOS - MAS1, Spain2d ago
-
Expert Data Science EUR 35K-65KAgentic artificial intelligence | Artificial Intelligence | Data Governance | Data Literacy | Data QualityDiversity and inclusion | Hybrid work | Relocation Support N/ASenior-level Full TimeBarcelona Gran Vía, Spain2d ago
-
AI Senior Expert EUR 42K-79KAgent systems | Artificial Intelligence | Artificial intelligence operations | Data Governance | Data VisualizationHybrid work environment | Relocation support not providedSenior-level Full TimeBarcelona Gran Vía, Spain2d ago
-
Robotics Validation Engineer EUR 39K-39KCause analysis | Linux | Localization | Navigation | PerceptionBenefits platform | Career development | Company mobile phone | Employee parking | Flexible work practicesMid-level Full TimeSant Quirze del Valles, Barcelona, Spain2d ago
-
Mid-level Full TimeMadrid Osiris, Spain2d ago
-
AWS | Agile | Apache Spark | Azure | CI/CDSenior-level Full TimeLocation Salamanca, Spain2d ago
-
Data Pipelines | Data Visualization | Databricks | Forecasting | LLMFlexible schedule | Hybrid work | Professional development | Remote work flexibilitySenior-level Full TimeMadrid - Castellana, Spain R2d ago