Senior Data Engineer - Web Scraping
Tasks
- Build and maintain data pipelines for databases and data warehouses
- Clean explore transform and prepare large datasets with Python and Pandas
- Collaborate with analysts and stakeholders to translate requirements into technical solutions
- Design and implement tools applications and automation for data products
- Design develop deploy and maintain web scrapers
- Develop automation tools for web scraping platform improvements
- Implement quality control checks for data accuracy and integrity
- Schedule and manage workflows with Apache Airflow
- Set up alerting systems and investigate time sensitive data incidents
Perks/Benefits
- Autonomy
- Collaborative team environment
- Flexible work location
- Fully remote
- Ownership
- Professional growth opportunities
Skills/Tech-stack
AWS Lambda | AWS S3 | Amazon RDS | Amazon SNS | Amazon SQS | Amazon Web Services | Apache Airflow | CI/CD | Docker | GitHub Actions | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Postman | Python | REST APIs | SQL | Scrapy | Selenium | Web Scraping | Web Services | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AWS | Agile | Amazon RDS | Amazon Redshift | Apache AirflowAnnual company retreats | Flexible working hours | Paid annual leave | Premium equipment | Remote-first environmentSenior-level Full TimeSwitzerland R21h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Flexible work location | Fully remote | Remote autonomy and flexibilitySenior-level Contract Full TimeSwitzerland R23h ago
-
AWS | Asynchronous programming | Azure | CI/CD | Data PipelinesAsynchronous Working Environment | Autonomy and flexibility | Career development and growth | Hardware provided | Hybrid Arrangements Based on RoleSenior-level Full TimeSwitzerland R1d ago
-
Accountability | Dashboarding | Data Analysis | Data Ethics | Data PreprocessingCross-functional collaboration | Exposure to large scale datasets | Fully remote working arrangement | Responsible AI focused environment | Technical leadership opportunitiesSenior-level Contract Full TimeSwitzerland R1d ago
-
CVMFS | Docker | Git | GitOps | HelmContract extension possible | Formal training | Health insurance | Hybrid work | Language classesEntry-level Full TimeGeneva, GENEVA, Switzerland R1d ago
-
ANSYS-FLUENT | Azure | CFD | Data analytics | Industrial IoTFlexible working hours | Half-fare card | Modern office facilities | Public transport pass subsidy | Work from homeEntry-level Full TimeZürich, ZH, Switzerland R2d ago
-
EV Powertrain: Applied AI Engineer CHF 140K-232KAmesim | CAD | CAE | Foundation Models | JMAGCollaborative multicultural environment | Flexible hours | Global impact | Hybrid work model | Professional developmentMid-level Full TimeLausanne R2d ago
-
AWS | Apache Kafka | Automated testing | CI/CD | CachingIT equipment provided | Learning and growth opportunities | Offsite weeks | Ownership and meaningful impact | Remote work flexibilitySenior-level Full TimeSwitzerland R2d ago
-
Cloud infrastructure | Distributed Systems | GPU Performance | JAX | LLMMid-level Full TimeZurich, Switzerland R3d ago
-
LLM Application Engineer CHF 120K-195KAPI Integration | Agentic Workflows | Context engineering | Distributed Systems | EvaluationMid-level Full TimeSwitzerland R3d ago
-
AI Solution Engineer CHF 128K-192KData Science | Enterprise Software | Enterprise Software Development | Generative AI | Infrastructure as CodeFavorable investment program terms | Flexible hours | Home-office allowance | Language training | Training opportunitiesEntry-level Full TimePfaeffikon (Summelenweg), Switzerland R3d ago
-
Algorithms | C++ | Data Modeling | Data Visualization | GitHealth insurance | Hybrid work | Language classes | Paid leave | Relocation assistanceEntry-level Full TimeGeneva, GENEVA, Switzerland R6d ago
-
Dagster | Data Processing | Deep learning | Fiona | GDALFully remote work | Inclusive culture | International collaboration | Professional growthSenior-level Full TimeSwitzerland R6d ago
-
Software Engineer (SY-BI-SW-2026-175-LD) CHF 129K-189KAgent systems | Anomaly Detection | Artificial Intelligence | Automated diagnostics | C++Contract extension options | Health insurance | Hybrid work | Paid leave | Pension fundSenior-level Contract Full TimeGeneva, GENEVA, Switzerland R7d ago
-
AWS | AWS CloudFormation | AWS Database | AWS Database Migration Service | AWS GlueContract compensation based on experience | Flexible work schedule | Fully remote work environment | Technical autonomySenior-level Contract Full TimeSwitzerland R7d ago
-
Research Engineer, Production Model Post-Training CHF 126K-189KDeep learning | Distributed Training | Fine Tuning | High Performance | High-Performance ComputingFlexible working hours | Generous vacation | Hybrid work option | Optional equity donation matching | Parental leaveSenior-level Full TimeZürich, CH R10d ago
-
Airflow | Apache Spark | Dagster | Data Quality | Data ValidationDistributed team | Ownership culture | Remote work flexibilitySenior-level Contract FreelanceZürich, Switzerland R11d ago
-
AI Workflows Engineer CHF 129K-232KCI/CD | Code review | Documentation | Git | Machine LearningFlexible hours | Hybrid work model | Multicultural collaborative environment | Professional development | Training supportMid-level Full TimeLausanne R15d ago
-
Associate Director, Applied Data Science & Modelling CHF 122K-227KArtificial Intelligence | Bioinformatics | Cheminformatics | Data Engineering | Data ScienceInclusive workplace | Mentoring opportunities | Relocation assistance | Remote work optionMid-level Full TimeCH - Visp, Switzerland R16d ago
-
Mid-level Full TimeBasel, Basel City, Switzerland - Remote R17d ago
-
Senior AI Engineer CHF 129K-192KBehavior analytics | Detection and Response | Fine Tuning | Langchain | Language ModelsAnnual training budget | Company events and workshops | Enhanced maternity leave | Enhanced paternity leave | Hybrid optionsSenior-level Full Timeremote or office, Zürich, Switzerland R20d ago
-
Senior AI Engineer CHF 129K-192KBehavior analytics | Cybersecurity | Detection and Response | Fine Tuning | LangchainAnnual training budget | Collaborative workshops | Enhanced maternity leave | Enhanced paternity leave | Health work-life balanceSenior-level Full Timeremote or office, Zürich, Switzerland R20d ago
-
AWS | Apache Spark | Data Analysis | Hadoop | JavaRemote workSenior-level Full TimeZürich, Switzerland R27d ago
-
Software Engineer CHF 128K-192KAPI Integration | Backend Development | Cloud Computing | DevOps | Frontend DevelopmentSenior-level Full TimeBasel, Switzerland R1mo ago
-
Junior Data Engineer (m/f/d) CHF 63K-84KAWS | CI/CD | Data Modeling | Databricks | Delta LakeCollaborative team environment | Hybrid setup | Remote-first | Work on mission driven productEntry-level Full TimeNeuchâtel, Neuchâtel, Switzerland R1mo ago