Senior Data Engineer
Barcelona, Spain; Greater Madrid Metropolitan Area
Lighthouse
Your dedicated Lighthouse team tailors advanced technology, AI, and proven processes to your needs across eDiscovery, review, and information governance.At Lighthouse, we’re on a mission to disrupt commercial strategy for the hospitality industry. Our innovative commercial platform takes the complexity out of data, empowering businesses with actionable insights, advanced pricing tools, and cutting-edge business intelligence to unlock their full revenue potential.
Backed by $370 million in series C funding and driven by an unwavering passion for growth, we’ve welcomed five companies into our journey and have surpassed $100 million in ARR in 2024. Our 700+ teammates span 35 countries and represent 34 nationalities.
At Lighthouse, we’re more than just a workplace – we’re a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry’s most exciting rocket-ship? 🚀
What you will do
As a Senior Data Engineer, you'll be instrumental in building and optimizing the data pipelines that power Lighthouse's core products and services. You'll collaborate with product teams to ensure seamless data delivery, enabling the development of innovative features and insights. You'll work on strategic data projects, ensuring high data quality and reliability, and play a crucial role in establishing Lighthouse as a leader in data-driven hospitality solutions
Where you will have impact
- Design and develop scalable, reliable data pipelines using the Google Cloud stack.
- Optimise data pipelines for performance and scalability.
- Implement and maintain data governance frameworks, ensuring data accuracy, consistency, and compliance.
- Monitor and troubleshoot data pipeline issues, implementing proactive measures for reliability and performance.
- Collaborate with the DevOps team to automate deployments and improve developer experience on the data front.
- Work with data science and analytics teams to enable them to bring their research to production grade data solutions, using technologies like airflow, dbt or MLflow (but not limited to)
- As a part of a platform team, you will communicate effectively with teams across the entire engineering organisation, to provide them with reliable foundational data models and data tools.
- Mentor and provide technical guidance to other engineers working with data.
About our team
Lighthouse is not only a data-driven company, we are a data company. The heart of all our products is data. It enables hotels to make the right decisions and fuel our analytical solutions. Being a growth company enables us to regularly attract new and interesting datasets, which can unlock new product directions. Today we process billions of data points and +100TB of data on a daily basis, containing hotels' pricing information, search data, hotel bookings, etc.
The Data Platform team is part of the Data Organization (within Engineering). We manage state-of-the-art infrastructure, services and products and are constantly innovating to support all our business needs and products at scale.
Lighthouse’s Data Platform team has the following responsibilities and goals:
- Scalability, reliability, and security: We make sure that our platform can handle increasing volumes of data and user demands, provide reliable access to data, and protect data from unauthorised access or loss.
- Enabling data-driven decisions and innovation: The ultimate goal of our team is to support the organisation's strategic objectives, whether that's making better business decisions based on data, developing new data-driven products or services, or improving operational efficiency.
- User empowerment: A data platform should not just be a tool for data experts, but for all users in the organisation. This includes providing user-friendly tools, clear documentation, and training to help users access and understand the data they need.
- Data governance and compliance: With the increasing importance and sensitivity of data, it's crucial to have clear policies and procedures for managing data, as well as ensuring compliance with data protection regulations.
What's in it for you?
- Flexible working environment: Work from home or at one of our global offices.
- Flexible time off: Autonomy to manage your work-life balance.
- Alan Health benefits: 160€/month for food, transportation, or nursery.
- Language learning: 40€/month on Preply.
- Comprehensive health insurance: 100% Alan coverage for you, your spouse, and dependents.
- Collaborative team: High-bar, friendly, creative, and passionate colleagues.
- Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.
- Impactful work: Shape products relied on by 85,000+ users worldwide.
- Competitive compensation: Proactively maintained to value your work.
- Referral bonuses: Earn rewards for bringing in new talent.
Who you are
- 4+ years of professional experience using Python, Java, or Scala for data processing (Python preferred)
- You stay up-to-date with industry trends, emerging technologies, and best practices in data engineering.
- Improve, manage, and teach standards for code maintainability and performance in code submitted and reviewed
- Ship large features independently, generate architecture recommendations and have the ability to implement them
- Great communication: Regularly achieve consensus amongst teams
We welcome
- Familiarity with GCP, Kubernetes (GKE preferred), CI/CD tools (Gitlab CI preferred), familiarity with the concept of Lambda Architecture.
- Experience with Apache Beam or Apache Spark for distributed data processing or event sourcing technologies like Apache Kafka.
- Familiarity with monitoring tools like Grafana & Prometheus.
Technologies you will work with
Python, BigQuery, Airflow, Terraform, GCP, dbt, Kubernetes, Kafka, Atlan
(feel free to ask us why these are the best fit for us)
Thank you for considering a career with Lighthouse. We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. Our commitment to equality is not just a policy; it's part of our culture.
If you share our passion for innovation and teamwork, we invite you to join us in shaping the future of the hospitality industry. At Lighthouse, our guiding light is to be an equal opportunity employer, and we encourage individuals from all walks of life to apply.
We value the unique perspective and talents that you bring, and we're excited to see how your light can shine within our team. We can't wait to meet you and explore how we can grow and succeed together, illuminating the path towards a brighter future for the industry.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture BigQuery Business Intelligence CI/CD Data governance Data pipelines Data quality dbt DevOps Engineering GCP GitLab Google Cloud Grafana Java Kafka Kubernetes Lambda MLFlow Pipelines Python Research Scala Security Spark Terraform
Perks/benefits: Career development Competitive pay Flex hours Flex vacation Health care Insurance Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.