Senior Data Engineer
INBLR02 - Bangalore - Milesstone Buildcon
Maersk
A.P. Moller - Maersk is an integrated logistics company. We go all the way to connect and simplify global trade for a growing world.Maersk is improving life for all by integrating the world. From the farm to your refrigerator, or the factory to your wardrobe, we are developing software solutions to support our customer needs from one end of the supply chain to the other. Technology is taking center stage in enabling our customers to trade globally and we are building our core products in-house.
Join us to help re-think what technology can do and support our global logistics business with high-quality software solutions that enable us to reduce our environmental impact and provide a better experience to our customers through improved automation and decision making.
Your new job
You will join the Cargo Flow Automation team. We leverage state of the art data engineering, feeding operations and advanced data science and machine learning use cases. We are also responsible for bringing data together with ML predictions into advanced optimization and simulation frameworks to integrate automated data-driven decision-making under uncertainty into user workflows. We offer a diverse and highly collaborative work environment with flexibility to suit your life.
You will be designing, building and maintaining data systems for batch as well as real-time flows which play a central role in our strategy to deliver logistics to our customers with minimal manual intervention. You will collaborate closely with other engineers and scientists focusing on operational and analytical problems.
There are a lot of interesting challenges ahead and we need your help.
Your new team
We are a cross-functional team of data engineers, software engineers and data scientists working together to build reliable, performant and maintainable analytical and operational data flows and software.
We are accountable and proud of our work. Our culture is informal and built on respectful collaboration, experimentation, and continuous improvement. We spend time together at team events and hackathons to form a stronger, more collaborative unit and to grow and inspire each other.
We use modern engineering practices, pair-programming, and take on the full DevOps responsibility for what we build. We primarily use technologies such as Pyspark, and Scala Flink, rely heavily on open source and build software we deploy using Github Actions and Docker onto Kubernetes clusters operated in the Microsoft Azure cloud.
Key Responsibilities
Care about data. Think of it as a product that has to continuously evolve in order to improve. Use this to produce high-quality data as a foundation for our forecasting products by building and improving data pipelines on top of data from source systems.
Have a continuous focus on providing business value, while ensuring technical sustainability (including maintainability, reliability, performance, and availability).
Work with data and analytics experts to expand the functionality and possible use cases for our historical datasets that meet functional / non-functional business requirements.
Work with relevant stakeholders to find the right solutions to the right problems at the right time.
Promote and drive adoption of cutting-edge data engineering practices within the team.
We are looking for
You are collaborative by nature, care about others and are a general force for good.
You are motivated by ensuring the datasets you work on model the domain accurately, provide maximum value for the consumers and enable more business value.
You care about a great engineering culture and like to follow functional data engineering practices
You have an agile mindset and a learning mentality.
You have lots of experience with (Py)spark, Flink (or similar technologies) and are comfortable dealing with complex systems.
You can understand and express yourself in some SQL flavour, but it’s not your first choice
Maersk is committed to a diverse and inclusive workplace, and we embrace different styles of thinking. Maersk is an equal opportunities employer and welcomes applicants without regard to race, colour, gender, sex, age, religion, creed, national origin, ancestry, citizenship, marital status, sexual orientation, physical or mental disability, medical condition, pregnancy or parental leave, veteran status, gender identity, genetic information, or any other characteristic protected by applicable law. We will consider qualified applicants with criminal histories in a manner consistent with all legal requirements.
We are happy to support your need for any adjustments during the application and hiring process. If you need special assistance or an accommodation to use our website, apply for a position, or to perform a job, please contact us by emailing accommodationrequests@maersk.com.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Azure Data pipelines DevOps Docker Engineering Flink GitHub Kubernetes Machine Learning Open Source Pipelines PySpark Scala Spark SQL
Perks/benefits: Career development Medical leave Parental leave Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.