Data Engineer - Web Scraping
Tasks
- Build data ingestion pipelines
- Clean transform validate datasets
- Design automated data collection systems
- Develop and maintain web scrapers
- Develop internal tools and automation frameworks
- Implement data quality control checks
- Investigate data pipeline incidents
- Process scalable maintainable data workflows
- Schedule monitor optimize scraping workflows
Perks/Benefits
- Continuous learning professional growth
- Flexible technology focused environment
- High ownership autonomy
Skills/Tech-stack
API | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Roles
Related jobs
-
Embedded Software Engineer (Camera & Driver Platform) CHF 102K-138KBash | C++ | Cross-compilation | Cross-debugging | DNSCar parking | Enhanced maternity and paternity leave | Flexible working hours | Generous holiday allowance | Hybrid workplaceMid-level Full TimeZurich, Switzerland22h ago
-
Senior Data Scientist CHF 128K-192KAWS | Apache Spark | Azure | Databricks | GitCross-functional teamwork | Customer contact | Professional development | Travel requiredSenior-level Full TimePully, Switzerland23h ago
-
API Design | Backend architecture | Command Line | Command-line interfaces | Database systemsCompany-provided equipment | Continuous learning allowance | Flexible working hours | Fully remote | Health insurance allowanceSenior-level Full TimeSwitzerland R1d ago
-
Data Platform Engineer CHF 80K-100KAWS | Atlan | Cost Optimization | Data Pipelines | Data integrationAgile working methods | Flexible working hours | Home office option | Pleasant working environment | Professional development opportunitiesMid-level Full TimeZür-Pfi51, Switzerland1d ago
-
Senior-level Full TimeCHE-ZURICH, Switzerland1d ago
-
Entry-level Full TimeZurich, Switzerland2d ago
-
Software Engineer, Infrastructure GBP 180K-225KAI | Agent Orchestration | Bias Mitigation | C# | C++Senior-level Full TimeZurich, Switzerland | Tel Aviv, Israel …2d ago
-
Big Data | CI/CD | Data Pipelines | DevOps | Distributed SystemsHybrid work | Professional development | Work-life balanceEntry-level Full TimeZH, CH, Adresse2d ago
-
Apache Spark | Big Data | CI/CD | Data Engineering | ForecastingEqual opportunity | Hybrid work | Professional development | Work-life balanceEntry-level Full TimeZH, CH, Adresse2d ago
-
A/B | A/B Testing | AWS | Azure | B testingFully remote work | Healthcare coverage | Paid parental leave | Relocation assistanceMid-level Full TimeSwitzerland R2d ago
-
Software Engineer - Embedded Software (d/f/m) CHF 95K-146KAI Inference | C# | C++ | Git | JavaAccident insurance | Defined contribution pension plan | Global employee benefits | Sick pay insurance | Wellbeing initiativesMid-level Full TimeCH-ZH-ZURICH-TECHNOPARK STRASSE 1, Switzerland2d ago
-
Robotics Software Engineer - Sim-to-Real CHF 115K-158KC++ | Operating System | Physics simulation | PyTorch | PythonComprehensive benefits packageMid-level Full TimeSwitzerland, Zurich2d ago
-
Senior Engineer, Data Analytics, GEC CHF 159K-240KAI coding | AI coding tools | AWS | Access Management | AngularCareer advancement | Professional development | Wellbeing | Work-life balanceSenior-level Full TimeAero - 600 West Camp Road, …2d ago
-
CI/CD | Git | Linux | Pytest | PythonFlexible work environment | Mentorship | Modern innovative work environment | Open communication cultureEntry-level Part TimeWinterthur, CH, 84082d ago
-
Scientific Computing Systems Engineer CHF 100K-130KAnsible | Bash | Batch scheduling | CI/CD | ContainersModern employment conditions | On-site infrastructure | On-the-job training | Professional development | Work-life balance supportMid-level Full TimeVilligen PSI, AG, Switzerland3d ago
-
Alerting | Amazon Redshift | Batch Processing | CI/CD | Data GovernanceContinuous improvement opportunities | Cross-functional collaboration | Fully remote work | Ownership over data reliability strategySenior-level Full TimeSwitzerland R3d ago
-
AWS Glue | AWS Glue Data Catalog | Access Management | Alation | Amazon BedrockCareer growth resources | Inclusive team culture | Mentorship | Work-life balanceSenior-level Full TimeZurich, Zurich, CHE3d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Remote-friendly cultureMid-level Full TimeBasel, Switzerland4d ago
-
Research Scientist/ Engineer - Special Projects CHF 134K-192K3D Reconstruction | Computer Graphics | Computer Vision | Deep learning | Image SynthesisSenior-level Full TimeZurich5d ago
-
Lead Data Engineer – Finance CHF 128K-192KAuditability | CDC | CI/CD | Data Governance | Data LineageSenior-level Full TimeZurich, Switzerland5d ago
-
Data & Analytics Specialist (Life Sciences) CHF 63K-70KAPI Integration | AWS | Automation | Data Governance | Data PipelinesCoaching and Mentorship | Learning and development programsEntry-level Full TimeBern, BE, Switzerland5d ago
-
Database Reliability Engineer CHF 128K-192KAutomation | Containerization | CouchDB | Database Administration | Database performanceSenior-level Full TimeGenève, Genève, Suisse5d ago
-
AWS | Apache Airflow | Cloud platform | Deep learning | DockerAccess to modern development tools | Equity opportunities | Medical/Dental/Vision insurance | Unlimited paid time off | Work from homeMid-level Full TimeSwitzerland R6d ago
-
AWS | Apache Spark | Data Analysis | Hadoop | JavaRemote workSenior-level Full TimeZürich, Switzerland R6d ago
-
CUDA | Imitation Learning | JAX | Omniverse | Physics simulationMid-level Full TimeSwitzerland, Zurich6d ago