Senior Data Engineering

Senior Data Engineering

Department: Operations

Employment Type: Full Time

Location: United States

Reporting To: Marvin Cuschieri

Description

We are seeking an expert in Clickhouse DBMS to lead a team of 10.  This person will be working alongside a data strategist to deploy the future  plans and visions outlined for future growth and objectives.  This person will be the technical visionary that guides projects from inception to completion. 

Oversee the design, development and maintenance of data pipelines and data warehousing reporting, together with high availability and integrity of data. 
You will work closely with cross-functional teams, predominantly architecture as well as product and software engineering
teams, to implement high-quality data solutions aimed at achieving the companys business goals.

Key Responsibilities

1. 
   Team Leadership & Development
   
   
   • Lead and manage a small team of data engineers, providing mentorship, guidance, and career development opportunities.
   • Drive a culture of continuous improvement and innovation within the data engineering team.
2. 
   Data Pipeline Development & Maintenance
   
   
   • Design, build, and maintain scalable, efficient, and reliable data pipelines to process, store, and query large volumes of data from various sources.
   • Optimize and improve existing data infrastructure and processes to enhance performance, scalability, and cost-efficiency.
3. 
   Data Quality & Integrity
   
   
   • Ensure the accuracy, integrity, and availability of data by implementing robust data validation, cleansing, and monitoring processes.
4. 
   Collaboration & Business Alignment
   
   
   • Collaborate with data scientists, architects, and software engineers to understand data requirements and deliver solutions that meet business needs.
5. 
   Best Practices & Standards
   
   
   • Develop and enforce data engineering best practices, coding standards, and documentation guidelines.
6. 
   Technology & Innovation
   
   
   • Stay current with emerging technologies and industry trends, evaluating and recommending new tools and technologies to improve data engineering capabilities.

.

Skills, Knowledge and Expertise

Essential Skills & Experience

• Excellent communication skills with the ability to communicate effectively in English.
• Must work in CET time zone (±3 hours).
• Must come from an iGaming or Betting background.
• Leadership experience, with the ability to manage and mentor a team.

Technical Expertise

• Expert in ClickHouse for analytical database management.
• Proficiency in SQL and experience with both relational and NoSQL databases.
• Strong programming skills in Python, Java, or Scala.
• Experience with cloud platforms such as AWS, Google Cloud, or Azure.
  • Familiarity with their data services (e.g., Redshift, BigQuery, Databricks).
• Experience in designing and building large-scale data pipelines and streaming ETL processes using technologies like Apache Spark, Kafka, or similar.
• Solid understanding of data warehousing concepts, data modeling, and database design.
• Familiarity with Apache Superset for data visualization and exploration.

Education & Experience

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
• 5+ years of experience in data engineering or a related field, with at least 2 years in a leadership or management role.

Key Attributes

• Strong problem-solving skills, with attention to detail and a focus on optimizing data infrastructure.