Lead Data Engineer

Appodeal is a dynamic US-based product company with a truly global presence.

We have offices in Warsaw, Barcelona and Virginia along with remote team members located around the world.

Our company thrives on diversity, collaboration, and innovation, making us a leader in the mobile app monetization space.

Why Appodeal?

At Appodeal, we’re more than just a company—we’re a team united by a common mission: to help every person discover and grow their talents!

We take pride in our cutting-edge product and our internationally dispersed team of talented professionals.

Here’s what we value, and what we hope you do too:

• Continuous Learning and Growth: We are passionate about learning, growing personally, and building rewarding careers.
• Making an Impact: We are committed to building a history-defining company that leaves a lasting impact on the mobile app industry.
• Solving Exciting Challenges: We tackle complex problems every day, supported by a team of world-class professionals and mentors.
• Enjoying the Journey: We believe in having fun while working toward our goals.

We are seeking an experienced Lead Data Engineer to drive the development and optimization of our data infrastructure within the BidMachine team. As a key technical leader, you will play a pivotal role in enabling seamless data operations to support machine learning, analytics, and business needs. This is an exciting opportunity to shape the data engineering landscape and collaborate with cross-functional teams to achieve impactful outcomes.

Key Responsibilities:

• Lead the architecture and evolution of our ML data platform, ensuring efficient data collection, storage, transformation, and accessibility at scale.
• Design and optimize high-throughput data workflows and pipelines capable of handling real-time processing at 350k messages per second
• Automate data operations by developing internal tools and frameworks that enhance efficiency and scalability.
• Collaborate cross-functionally with MLOps, Data Science, and Product teams to provide a seamless data experience.
• Mentor and guide a team of data engineers, fostering growth, technical excellence, and knowledge-sharing.

Requirements:

• 3+ years of professional experience in data engineering, including 1+ years in a lead/senior role
• Strong Python 3 expertise, with experience in Pandas, PySpark, and scalable data processing frameworks
• Deep understanding of streaming data processing, including Kafka, Spark Streaming, or Flink
• Hands-on experience with cloud-based data architectures, including AWS S3, data lakes, and data warehouses
• Proficiency in data orchestration tools (e.g., Airflow, Dagster).
• Experience with Databricks and distributed computing.
• Solid understanding of ML and analytics workflows, including feature engineering and model data pipelines.

Nice to Have:

• Experience with Dagster for workflow orchestration.
• Knowledge of Druid or other OLAP databases for real-time analytics.
• Background in ML data platform development, supporting model training, monitoring, and deployment.

With an outstanding product and a mission that excites and inspires, Appodeal offers a unique opportunity to make an impact while being part of an amazing team.

Join us and help shape the future of mobile app success!