Senior Software Engineer, Data Collection Team

Help Shape Tomorrow's Retail Landscape

Daltix is the leading commercial intelligence provider for Europe’s retail FMCG sector. We solve hard data problems for the industry’s biggest names, empowering them to make smarter decisions faster.

About the role:

We are looking for a senior software engineer to join our Data Collection team. As a core member of the team, you will help build and improve the data collection and transformation systems that lie at the heart of Daltix’s data pipeline. We crawl tens of millions of URLs per day and process terabytes of raw data per month, all the while maintaining extremely high data quality and coverage guarantees.

You’ll be working in a dynamic environment with one of the industry’s most experienced web scraping teams; enjoying direct exposure to challenging and interesting engineering problems as Datlix continues to scale its commercial offering across Europe.

The ideal candidate will be an experienced self-starter with a background in modern Backend development or SRE style work and an active interest in web scraping.

How you’ll make an impact:

• Lead and maintain development of production grade APIs, tools and integrations to improve the team’s observability, scalability, quality of life and complex workflow management

• Contribute to the team’s web scraper development by learning the intricacies of web scraping from an enthusiastic set of colleagues who bring deep sector specific knowledge and years of scraping experience in the retail data domain

• Collaborate with cross-functional teams to triage and resolve data quality and reliability issues

• Collaborate closely with team lead to rapidly iterate and deliver new core capabilities

• Educate and evangelise best practices on code quality, development workflows and robust engineering practices

• Contribute to code reviews, architectural decisions and proof-of-concepts, upholding high engineering standards and our culture of innovation, collaboration and continuous improvement

Why Join Us:

• Impact: Influence the European retail sector directly, enabling some of the biggest names in food, consumables and goods to leverage crucial data for decision-making.

• Culture of Innovation: Be part of a dynamic environment where innovation, speed, and adaptability are at the core of everything we do.

• Career Growth: Take advantage of our commitment to your professional development in a company that’s expanding its influence across Europe.

• Competitive Benefits: Enjoy a comprehensive package including a competitive salary, flexible working conditions, annual company events, and health+travel benefits.

• Great Technology: Work with a modern technology stack and tooling that includes AWS, Kubernetes, Terraform, Docker, Snowflake, Airflow, Node (>18.x), Python (>3.8), Grafana, Prometheus, Loki, Hex, LLMs and more.

• Remote First: Our team is spread across Europe; with once per month in-person Town Halls at our Lisbon, Portugal office (we fly everyone in).

Requirements

What would make you a good fit:

• 5+ years building & deploying production-grade backend systems; proficiency in Python, Javascript/Typescript and AWS

• Hands-on web scraping experience or the ability and desire to gain this experience quickly

• Systems thinking: capable of delivering end-to-end solutions with performance, testing, security and observability in mind

• Experience (and love of) working in agile, startup environments with shifting priorities and some ambiguity

• Fantastic communicator, especially in a remote team

• Comfortable being in an on-call rotation one weekend in four

Bonus points:

• Past experience working in large data environments

• Hands-on infra & ops experience (terraform, kubernetes, docker, github actions, large scale job orchestration etc.)