AWS Data Engineer with Python
POL-Gdynia-3T Office Park, Tower C, Poland
LSEG
LSEG is your trusted global financial markets infrastructure and data provider. Discover how we deliver value for our customers.ROLE PROFILE:
Are you ready to take your engineering career to the next level? Join us as a Mid Lead Engineer and contribute to building state-of-the-art data platforms in AWS, leveraging Python and Spark. Be part of a dynamic team, driving innovation and scalability for data solutions in a supportive and hybrid work environment.
ROLE SUMMARY:
This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with cutting-edge technologies. You will design, implement and optimize ETL workflows using Python and Spark, contributing to our robust data lakehouse architecture on AWS. Success in this role requires technical expertise, strong problem-solving skills and the ability to collaborate effectively within an agile team.
WHAT YOU'LL BE DOING:
- Design, build, and maintain robust, scalable and efficient ETL pipelines using Python and Spark.
- Develop workflows leveraging AWS services such as EMR Serverless, Glue, Glue Data Catalog, Lambda and S3.
- Implement data quality frameworks and governance practices to ensure reliable data processing.
- Collaborate with cross-functional teams to gather requirements, provide technical insights and deliver high-quality solutions.
- Optimize existing workflows and drive migration to a modern data lakehouse architecture, integrating Apache Iceberg.
- Enforce coding standards, design patterns, and system architecture best practices.
- Monitor system performance and ensure data reliability through proactive optimizations.
- Contribute to technical discussions, mentor junior team members and foster a culture of learning and innovation.
WHAT YOU'LL BRING:
Essential Skills
- Expertise in Python and Spark, with proven experience in designing and implementing data workflows.
- Hands-on experience with AWS EMR Serverless, Glue, Glue Data Catalog, Lambda, S3, and EMR.
- Strong understanding of data quality frameworks, governance practices and scalable architectures.
- Practical knowledge of Apache Iceberg within data lakehouse solutions.
- Problem-solving skills and experience optimizing workflows for performance and cost-efficiency.
- Agile methodology experience, including sprint planning and retrospectives. Excellent communication skills for articulating technical solutions to diverse stakeholders.
Desirable Skills
- Familiarity with additional programming languages such as Java.
- Experience with serverless computing paradigms.
- Knowledge of visualization or reporting tools.
YOUR PACKAGE WHEN JOINING GDYNIA TEAM:
- Bonus: bonus plan assigned to every position
- Wellbeing: monthly wellness and work-from-home allowance, and employee assistance program
- Lunch card: meal allowance on personal lunch card provided monthly
- Healthcare: private medical care with Medicover, premium package fully covered by employer and life insurance with Generali
- Future: corporate pension plan supported by Fidelity International offering additional 5% of base salary to invest in selected funds, and LSEG Employee Share Purchase plan available
- Reward and Recognition: additional awards and vouchers available for extra achievements
- Referral: Bonus between 8,000 to 10,000 PLN for successful recommendation of a new colleague
- Development: E-learning platforms access with a range of training and certified courses
- LSEG Products: availability to access to real-time economic data through our flagship Workspace platform
- Diversity: Inclusive culture built by colleagues from over 40 countries representing various age, gender, race, and beliefs
- Charity: 2 additional days off for voluntary jobs
- Office: brand new, sustainable office with cafeteria and chillout space. Location 3T Office, Gdynia is less than 200m to PKM station and a walking distance to SKM station. Underground car park with 122 spaces for LSEG employees
- Activities: sport teams and social events to join e.g. weekly yoga classes in the office
- Company events: Annual Summer and Winter Parties for colleagues and Family Day for employees with partners and children
Proud to share LSEG in Poland is Great Place to Work certified (Feb ’24 – Feb ’25).
Learn more about life and purpose of our company directly from the Gdynia colleagues’ video: https://www.lseg.com/en/careers/where-we-work/gdynia-poland Follow us on Facebook, Carers at LSEG Gdynia
LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.
Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.
Working with us means that you will be part of a dynamic organisation of 25,000 people across 65 countries. However, we will value your individuality and enable you to bring your true self to work so you can help enrich our diverse workforce. You will be part of a collaborative and creative culture where we encourage new ideas and are committed to sustainability across our global business. You will experience the critical role we have in helping to re-engineer the financial ecosystem to support and drive sustainable economic growth. Together, we are aiming to achieve this growth by accelerating the just transition to net zero, enabling growth of the green economy and creating inclusive economic opportunity.
LSEG offers a range of tailored benefits and support, including healthcare, retirement planning, paid volunteering days and wellbeing initiatives.
We are proud to be an equal opportunities employer. This means that we do not discriminate on the basis of anyone’s race, religion, colour, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law. Conforming with applicable law, we can reasonably accommodate applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.
Please take a moment to read this privacy notice carefully, as it describes what personal information London Stock Exchange Group (LSEG) (we) may hold about you, what it’s used for, and how it’s obtained, your rights and how to contact us as a data subject.
If you are submitting as a Recruitment Agency Partner, it is essential and your responsibility to ensure that candidates applying to LSEG are aware of this privacy notice.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture AWS Data quality Engineering ETL Java Lambda Pipelines Privacy Python Spark
Perks/benefits: Career development Equity / stock options Health care Home office stipend Insurance Lunch / meals Salary bonus Startup environment Team events Wellness Yoga
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.