Senior Data Engineer

Description

LSports is the leading global provider of sports data, dedicated to revolutionizing the industry through innovative solutions. We excel in sports data collection and analysis, advanced data management, and cutting-edge services like AI-based sports tips and high-quality sports visualization. As the sports data industry continues to grow, LSports remains at the forefront, delivering real-time solutions. 

If you're passionate about both sports and technology and want to drive the sports-tech and data industries into the future, we invite you to  join the team! We are looking for a highly motivated Senior Data Engineer.

Responsibilities:

• Building a robust data collection and measurement infrastructure for the department and linked products
• Taking ownership of major projects from inception to deployment.
• Implementing a systematic approach for saving and managing scraper data.
• Enabling efficient data access for support teams
• Architecting simple yet flexible solutions and then scaling them as we grow.
• Establishing a strong data framework to support the department and linked products future developments
• Collaborating with cross-functional teams to ensure data integrity, security, and optimal performance across various systems and applications.
• Staying current with emerging technologies and industry trends to recommend and implement innovative solutions that enhance data infrastructure and capabilities.

Requirements

• 5+ years of experience as a Data Engineer.
• 3+ years of experience using Spark.
• Experience building and maintaining production grade data pipelines, and working in distributed architectures.
• Knowledge and understanding of work in a modern CI environment: Git, Docker, K8S.
• Experience with ETL tools: AWS Glue/Apache Airflow/Prefect, etc.
• Experience with big data like Iceberg, ClickHouse or similar.
• Experience with Kafka.

Advantages:

• Experience with designing and implementing big data infrastructure