Big Data Engineer III
Krakow
OpenX
OpenX is the most dynamic independent supply-side platform and delivers a fair and transparent value exchange between publishers and advertisers to help power the open web. Learn more.At OpenX, we have built a team that is uniquely experienced in designing and operating high-scale ad marketplaces, and we are constantly on the lookout for thoughtful, creative executors who are as fascinated as we are about finding new ways to apply a blend of market design, technical innovation, operational excellence, and empathetic partner service to the frontiers of digital advertising.
We are operating at a scale:100% Cloud-based (GCP) platformOver 400 billion Ad requests every dayOver 120 000 CPU dailyOver 140 TB RAM dailyOver 50 PB of data per weekOver 1200 production deployments a month
You will work in all aspects of agile application development, including our enterprise platform that interfaces with a multitude of services that are dependent on to deliver billions of requests per day. Your opinions will be important in all phases of product development, starting from requirements to validation and deployment.Working on the enterprise platform, you will be working with multiple distributed teams to architect, create, and deliver new features and functionality in order to deliver the best possible advertising experience in the market. Scalability, performance, and rock-solid reliability are all factors to consider with every line you code.
The Team and Project:You will be part of the core data development team. Our exchange handles billions of ad requests daily connecting thousands of publishers with demand partners. Each request produces data events that have to be processed to extract business value from them. Daily our applications produce more than 1PB of data.
Please note: all interview stages are run remotely!
Key responsibilities:
- Design large-scale data processing systems.
- Work with Product to drive the requirements, and own the project end-to-end.
- Analyse and improve efficiency, scalability, and stability of applications.
- Think long-term and be unsatisfied with band-aids.
- Identify unnecessary complexity and remove it.
Required Qualifications:
- 8+ years experience in Java, Scala or Python development
- 3+ years of experience in Big Data systems development
- Experience building complex data pipelines with data transformation tools like dbt or Dataform and SQL.
- Expertise using BigQuery or other data warehouses including performance tuning and monitoring.
- Understands data orchestration tools like Airflow to extend it with new data pipelines and troubleshoot its operational issues.
- Cloud experience with Google Cloud Platform or AWS, k8s, and Docker.
- Understanding of CI/CD, automated testing, monitoring and other DevOps practices.
- Fluently speak algorithms, data structures, and platforms.
- Experience with database system design, RDBMs and/or NoSQL.
- Bachelor’s degree in computer science, physics, or related field. A Master’s degree is a plus.
- Communicative Polish and English.
Desired qualifications:
- Be comfortable using the right tools and languages for the job, even brand new ones.
- Have the ability to develop scalable, modular applications.
- SCRUM / Agile environment experience.
- Experience working in digital media, marketing technology or advertising technology is a big plus.
- Good written & oral communication skills.
- Good sense of humor.
- Team player.
- Self-starter with the ability to independently identify and act on areas of improvement.
What we offer:
- Employment contract (22 100 - 26 000 PLN gross/monthly) OR B2B (180 - 207 PLN net/hourly)
- Working with the newest technologies such as Cloud Computing (GCP)
- Experienced Team (50% of the company are senior developers!)
- Challenges at work that are difficult to find anywhere else!
- Solving important problems in a scale
- Joining a company that is growing and scaling
- Flexible working hours & remote work option (4 days a week)
Our benefits (on employment contract):
- Annual performance bonus
- Tax-deductible system due to copyright protection: 75%
- Private health care for you and your family (covered by OpenX)
- Private life and travel insurance (Covid insurance included)
- MultiKafeteria program
- Training: access to the LinkedIn learning platform and Tech workshops
- Holiday Allowance
- Pension scheme (PPK from PZU)
- Additional paid day off
- Free parking lot
- Access to peer to peer recognition platform
- Monthly work-from-home allowance and one-time payment when you join us to help you set up your home office
- We celebrate team members' important personal milestones (vouchers, gifts)
WE ARE ONEWe are one team. There are no exceptions. We are a group of strong and diverse individuals unified by a shared mission. We embrace challenges and win together as a team. We respect and care about our colleagues and cultivate an inclusive culture
WE ARE CUSTOMER CENTRICWe innovate on behalf of our customers. We understand, respect, and listen carefully to our customers. We build great products to solve our customers’ problems. We manage our customers’ expectations clearly and honestly. We are a trusted partner to all of our customers - we act with integrity at all times. We care.
OPENX IS OURSWe are all owners of OpenXWe all have a voice to improve OpenXWe stake our personal and professional reputations on the excellence of our workWe are not interested in just "doing our jobs"; we take ownership to drive results
WE ARE AN OPEN BOOKWe understand and respect what each of us does. We are eager to teach and share what we know with others, both internally and externally. We are eager to learn from others and we ask questions internally and externally.
WE EVOLVE FASTWe take responsible risks and own and learn from our mistakes. We recognize and repeat success. We actively seek out and provide constructive feedback. We adapt quickly and embrace change. We tackle growth and learning with real urgency. We are endlessly curious.
OpenX is committed to equal employment opportunities. It is a fundamental principle at OpenX not to discriminate against employees or applicants for employment on any legally-recognized basis including, but not limited to: age, race, creed, color, religion, national origin, sexual orientation, sex, disability, predisposing genetic characteristics, genetic information, military or veteran status, marital status, gender identity/transgender status, pregnancy, childbirth or related medical condition, and other protected characteristic as established by law.
OpenX Applicant Privacy PolicyApplicants can review our Applicant Privacy Policy at any time by visiting the following link: https://www.openx.com/privacy-center/applicant-privacy-policy/.
Effective Date: April 18, 2024
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow AWS Big Data BigQuery CI/CD Computer Science Data pipelines dbt DevOps Docker GCP Google Cloud Java Kubernetes NoSQL Physics Pipelines Privacy Python RDBMS Scala Scrum SQL Testing
Perks/benefits: Career development Flex hours Flex vacation Health care Home office stipend Insurance Salary bonus Startup environment Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.