Senior Data Engineer - Web Scraping
Tasks
- Automate web scraping platform improvements
- Build database and data warehouse ingestion
- Collaborate with analysts and stakeholders
- Design web scrapers
- Develop data pipelines
- Orchestrate workflows with Apache Airflow
- Set up alerting and incident response
- Transform scraped data with Pandas
- Validate data with quality checks
Perks/Benefits
Skills/Tech-stack
APIs | AWS Lambda | AWS S3 | Amazon RDS | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Docker | GitHub Actions | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Postman | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Amazon RDS | Amazon Redshift | Apache Airflow | Cause analysis | Data ModelingAnnual company retreats | Flexible working hours | Paid annual leave | Premium equipment | Remote-firstSenior-level Full TimeSpain R21h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Digital transformation project exposure | Fully remote | Opportunity to use AI powered engineering tools | Remote flexibility | Work with modern Microsoft Azure data ecosystemSenior-level Contract Full TimeSpain R23h ago
-
AWS | Async/Await | Asynchronous programming | Azure | CI/CDAsynchronous Working Environment | Career development | Hardware provided | Hybrid arrangements | Opportunity to work abroadSenior-level Full TimeSpain R1d ago
-
Expert Data Science EUR 35K-65KAgentic artificial intelligence | Artificial Intelligence | Data Governance | Data Quality | Data VisualizationGlobal recognition programs | Hybrid working | Insurance plans | Paid parental leave | Relocation support not offeredSenior-level Full TimeBarcelona Gran Vía, Spain R1d ago
-
Expert Data Science EUR 35K-65KAgentic artificial intelligence | Artificial Intelligence | Data Governance | Data Quality | Data ScienceHybrid working | Insurance plans | Paid parental leave | Relocation support none | Retirement plansSenior-level Full TimeBarcelona Gran Vía, Spain R1d ago
-
Data Engineer EUR 48K-60KAmazon DynamoDB | Amazon SageMaker | Amazon Web Services | Apache Spark | C#Flexible working model | Health resources | Holiday and leave allowance | Hybrid work model | Meal voucherMid-level Full TimeBarcelona R1d ago
-
Senior Data Engineer EUR 70K-90KApache Kafka | CI/CD | ClickHouse | Docker | ElasticsearchCoaching and training | Flexible working hours | Learning and development | Remote-first | Six dedicated learning days per yearSenior-level Full TimeGermany /Spain / Romania (Remote) R2d ago
-
Data Engineer / Architect EUR 54K-79KAWS | Apache Spark | Azure | Big Data | CI/CDBirthday day off | English lessons | Flexible schedule | Flexible work from home | Free Microsoft certificationsSenior-level Full TimeSpain - Remote R2d ago
-
Data Engineer EUR 20K-23KApache Spark | Big Data | Data Analysis | Data Architecture | Data ModelingContinuous training | Flexible schedule | Hybrid work model | Life and accident insuranceEntry-level Full TimeSpain R2d ago
-
AWS | Apache Kafka | CI/CD | Docker | ELK100 percent remote work | Collaborative culture | Company offsite weeks | Complex digital health projects | Flexible work locationSenior-level Full TimeSpain R2d ago
-
AI Engineering Workflow Developer (mf/d) EUR 40K-60KCI/CD | Docker | FastAPI | Git | GitHub API26 plus working days vacation | Childcare support | English and German language classes | Flexible working hours | Free access to specialist servicesEntry-level Full TimeGranada, AN, Spain R2d ago
-
Alerting | Data Pipelines | Distributed Systems | JAX | LoggingMid-level Full TimeSpain R3d ago
-
LLM Application Engineer EUR 49K-67KAPI Integration | Agent Frameworks | Backend Services | Context engineering | Database IntegrationMid-level Full TimeSpain R3d ago
-
AI Engineer EUR 54K-75K.NET | API Design | AWS | Backend Development | CI/CDContinuous learning and development | Flexible hours | Home office setup support | Hybrid working setup | Language classesMid-level Full TimeBarcelona - Passeig de Gràcia 110, … R3d ago
-
Staff Engineer - Data Platform Experience EUR 86K-126KApache Kafka | Cloud Platforms | Cloud cost allocation | Cost Allocation | Developer ProductivityBest in class onboarding | Continuous career development | Cross departmental buddy program | Employee stock purchase plan | Hybrid workplaceSenior-level Full TimeDublin, Ireland; Madrid, Spain; Paris, France R3d ago
-
API Gateway | AWS | AWS Lambda | AWS Secrets | AWS Secrets ManagerCareer growth plan | Childcare check | Flexible working hours | Inclusive multicultural environment | Medical insuranceSenior-level Full TimeMadrid, Spain R3d ago
-
Senior Data Engineer - Analytics Platform EUR 55K-74KAccess Control | BigQuery | CI/CD | Cost Optimization | DBTCertification support | Hybrid work | Open Source friendly | Performance bonus | Training opportunitiesSenior-level Full TimeMadrid R3d ago
-
Senior Analytics Engineer EUR 42K-84KAmazon S3 | Apache Airflow | CI/CD | Common table expressions | Data PipelinesAnnual leave | Gaming room | Gym facilities | Hairdressers | Hybrid workSenior-level Full TimeBarcelona, Spain R3d ago
-
AI Engineer Senior EUR 39K-48KAPI Integration | Agents | Automated testing | CI/CD | CachingAccess to certifications | Childcare tickets | Events meetups techdays | Extra days off | Flexible compensation planSenior-level Full TimeMadrid, Spain R4d ago
-
AI Engineer EUR 64K-78K.NET | AIOps | Ansible | BMC | C#Be Well programs | Certification support | Coaching | Hands-on learning opportunities | Hybrid workSenior-level Full TimeMadrid HQ (KES51610), Spain R4d ago
-
Senior AI Engineer 🇪🇺 EUR 50K-79KA/B | A/B Testing | AWS | Agentic Systems | Anti Prompt InjectionCompany equipment provided | Company shares | Coworking allowance | Fitness membership access | Home office setup budgetSenior-level Full TimeAll France (remote) R6d ago
-
Dagster | Data Exploration | Data Processing | Deep learning | FionaFlexible work locations | Fully remote | Inclusive culture | International team collaboration | Mission-driven environmentSenior-level Full TimeSpain R6d ago
-
Software/Data Engineer EUR 40K-55KAWS Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache KafkaGym discounts | Hybrid work | Learning resources | Mental health support | MentorshipMid-level Full TimeMadrid R7d ago
-
C++ | Compute Optimization | Data Analysis | Deep learning | Embedded LinuxBenefits platform | Career development | Company mobile phone | Employee parking | Flexible work practicesSenior-level Full TimeSant Quirze del Valles, Barcelona, Spain R7d ago
-
Robotics Visual SLAM Software Engineer EUR 39K-39KC++ | Computer Vision | Data Analysis | Debugging | Integration TestingCareer development | Company mobile phone | Employee Share Acquisition Plan | Employee discounts | Flexible work practicesMid-level Full TimeSant Quirze del Valles, Barcelona, Spain R7d ago