Senior Software Engineer – Crawling (m/f/d)
München - HQ
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
Certivity GmbH
Certivity offers software to model digital regulatory twins of their products. This will ensure that current regulatory requirements are integrated in the right place in the engineering process. Product compliance will be smarter, safer, more...About the Job
We’re growing fast and looking for a hands-on Senior Software Engineer (m/f/d) to help us unlock and scale access to the world’s data. You’ll design and build high-performance web crawlers, scraping systems, and data pipelines that power our next-generation products.
This is a chance to work on complex engineering challenges with massive real-world impact. You’ll work alongside a sharp, collaborative team and ship production systems end-to-end. If you’re passionate about building tools that ingest, process, and deliver data at scale—we want to talk.
What you will do
- Build and scale web crawling and scraping systems that can handle dynamic, large-scale data extraction.
- Design robust pipelines for data ingestion, cleaning, and enrichment.
- Work closely with product and ML teams to deliver data-driven features.
- Deploy and operate containerized apps in cloud environments (AWS, Azure, GCP).
- Improve and automate deployments with CI/CD, Ansible, or serverless stacks.
- Stay ahead of anti-bot measures, optimizing systems for reliability and performance.
- Contribute to technical architecture and help shape the engineering culture.
Your profile
- 5+ years of professional software development experience.
- Strong skills in Python (bonus: Go, Java/Spring Boot).
- Hands-on experience with web scraping, data pipelines, and the challenges of large-scale data collection.
- Solid experience with Docker and cloud platforms (AWS, Azure, or GCP).
- Proficiency with Git, CLI tools, and containerized deployments.
- Familiarity with tools like Apache Airflow, Ansible, or serverless architectures.
- Clear communicator who thrives in a collaborative, fast-paced environment.
- Comfortable working onsite/hybrid with a tight-knit team.
- Full-stack skills (React, Angular, or Vue) - or willingness to learn frontend quickly.
- Experience with ML pipelines, data labeling workflows, or Large Language Models (LLMs).
- Knowledge of anti-scraping measures.
- Familiarity with Terraform, Kubernetes, and modern DevOps tooling.
Why us?
- Hybrid work in Munich.
- Flexible working time.
- 30 days of vacation per year.
- 30 days of workcation per year, in the EU and some selected countries.
- High autonomy and flat hierarchies.
- Direct access to the users and quick iteration cycles.
Closing
We welcome candidates from all backgrounds and encourage diversity in our team. We encourage diverse people to apply and join our mission-driven culture that values open communication, work-life balance, and a welcoming environment. Convince us with your personality and your skills - and together we will make great things happen!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Angular Ansible Architecture AWS Azure CI/CD Data pipelines DevOps Docker Engineering GCP Git Java Kubernetes LLMs Machine Learning Pipelines Python React Terraform Vue
Perks/benefits: Flex hours Flex vacation Salary bonus
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.