Senior Software Engineer – Crawling (m/f/d)

München - HQ

⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️

Certivity GmbH

Certivity offers software to model digital regulatory twins of their products. This will ensure that current regulatory requirements are integrated in the right place in the engineering process. Product compliance will be smarter, safer, more...

View all jobs at Certivity GmbH

Apply now Apply later

About the Job

We’re growing fast and looking for a hands-on Senior Software Engineer (m/f/d) to help us unlock and scale access to the world’s data. You’ll design and build high-performance web crawlers, scraping systems, and data pipelines that power our next-generation products. 

This is a chance to work on complex engineering challenges with massive real-world impact. You’ll work alongside a sharp, collaborative team and ship production systems end-to-end. If you’re passionate about building tools that ingest, process, and deliver data at scale—we want to talk. 

What you will do

  • Build and scale web crawling and scraping systems that can handle dynamic, large-scale data extraction.
  • Design robust pipelines for data ingestion, cleaning, and enrichment.
  • Work closely with product and ML teams to deliver data-driven features.
  • Deploy and operate containerized apps in cloud environments (AWS, Azure, GCP).
  • Improve and automate deployments with CI/CD, Ansible, or serverless stacks.
  • Stay ahead of anti-bot measures, optimizing systems for reliability and performance.
  • Contribute to technical architecture and help shape the engineering culture.

Your profile

  • 5+ years of professional software development experience.
  • Strong skills in Python (bonus: Go, Java/Spring Boot).
  • Hands-on experience with web scraping, data pipelines, and the challenges of large-scale data collection.
  • Solid experience with Docker and cloud platforms (AWS, Azure, or GCP).
  • Proficiency with Git, CLI tools, and containerized deployments.
  • Familiarity with tools like Apache Airflow, Ansible, or serverless architectures.
  • Clear communicator who thrives in a collaborative, fast-paced environment.
  • Comfortable working onsite/hybrid with a tight-knit team.
Nice to Have:
  • Full-stack skills (React, Angular, or Vue) - or willingness to learn frontend quickly.
  • Experience with ML pipelines, data labeling workflows, or Large Language Models (LLMs).
  • Knowledge of anti-scraping measures.
  • Familiarity with Terraform, Kubernetes, and modern DevOps tooling.

Why us?

  • Hybrid work in Munich.
  • Flexible working time.
  • 30 days of vacation per year.
  • 30 days of workcation per year, in the EU and some selected countries.
  • High autonomy and flat hierarchies.
  • Direct access to the users and quick iteration cycles.

Closing

We welcome candidates from all backgrounds and encourage diversity in our team. We encourage diverse people to apply and join our mission-driven culture that values open communication, work-life balance, and a welcoming environment. Convince us with your personality and your skills - and together we will make great things happen!

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  1  0  0
Category: Engineering Jobs

Tags: Airflow Angular Ansible Architecture AWS Azure CI/CD Data pipelines DevOps Docker Engineering GCP Git Java Kubernetes LLMs Machine Learning Pipelines Python React Terraform Vue

Perks/benefits: Flex hours Flex vacation Salary bonus

Region: Europe
Country: Germany

More jobs like this