Systems Engineer (Python)
Dublin
Creditsafe
Assess the financial stabililty of the companies you do business with by accessing Creditsafe's business credit report database. Get a free report today.About Creditsafe:
With the largest owned database supported by a partner network, Creditsafe provides data on 320 million companies in over 100 countries to support its customers. Creditsafe is scaling its business and currently experiencing significant growth in Ireland. As a data company, Creditsafe collects and processes large amounts of complex data from multiple channels to serve our clients with opportunities to gain actionable insights. Our holistic data aggregation helps our clients fill knowledge gaps, influence decision-making, and uncover hidden patterns.
About the Opportunity:
This opportunity is to join a team of highly skilled engineers who are enhancing Creditsafe's data offerings with high throughput and scalability as primary goals. Our team is building an ELTL-based Data Warehouse and serving solution coded in Python and leveraging AWS solutions such as Lambdas and ECS for processing, Step Functions and SQS for scheduling and sequencing, S3 for the raw storage layer, Redshift for the data lake and warehouse layers, Aurora and API Gateway for serving, and CloudWatch and X-Ray for monitoring. The platform collects, matches, and enhances over a billion objects from hundreds of providers with daily updates of more than 10 million objects while handling the addition, deletion, and correction of our data and indexes in an auditable manner. The team is also building highly available and low latency APIs to enable our clients with faster data delivery, feeding both frontend and direct-access single and batch queries.
What You Will Be Doing:
- Actively contribute to the codebase and participate in peer reviews.
- Design and build a metadata-driven, event-based distributed data processing platform using technologies such as Python, Airflow, Redshift, DynamoDB, AWS Glue, and S3.
- Design, develop, and deploy business-critical systems used by thousands of customers, with constant opportunities for learning and growth.
- Build and scale Creditsafe APIs to securely support over 1000 transactions per second using serverless technologies.
- Execute practices such as continuous integration to enable the rapid delivery of working code.
- Collaborate alongside QA with a shift-left-testing approach, focusing on maintainability and quality from the very beginning.
- Understand company and domain data to make recommendations to improve existing products.
What We Are Looking For:
- Demonstrable ability to write clean and efficient code leveraging cloud environments for best performance.
- Proven of development experience within a commercial environment creating production-grade APIs and data pipelines in Python.
- A strong focus on constant learning and growth, seeking to elevate others alongside you.
- A desire to grow your skills through daily technical challenges and enjoy problem-solving, whiteboarding, and collaboration with the team.
- Excellent communication skills, with the ability to explain your views clearly to the team and openness to understanding theirs.
- A proven track record of drawing from deep and broad technical expertise, completing hands-on technical work, and tackling complex technology issues head-on.
- The ability to share your ideas collaboratively via wikis, discussion boards, blog posts, presentations, etc., and share any decisions made and lessons learned for the benefit of others.
- Leveraging AI – using AI coding integrations/IDEs like Copilot/Cursor, chat-agent models like Claude or ChatGPT 4/4o, platforms like Perplexity or others – to enhance your productivity and quality (don't worry, no vibe-coding here; we trust our devs over models).
- Competitive Salary.
- Company Laptop supplied.
- Bonus Scheme.
- 25 Days Annual Leave (plus bank holidays).
- Hybrid working model.
- Healthcare & Company Pension.
- Cycle to work and Wellbeing Programme.
- Global Company gatherings and events.
- E-learning and excellent career progression opportunities.
- Plus more that can be found on the benefits section on the Careers page, https://careers.creditsafe.com/gb/
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs AWS AWS Glue ChatGPT Claude Copilot Data pipelines Data warehouse DynamoDB ECS GPT Pipelines Python Redshift Step Functions Testing
Perks/benefits: Career development Competitive pay Salary bonus Startup environment Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.