Senior Data Engineer (Databricks Platform)

Work From Home - New York

Apply now Apply later

Job Summary:

WHO ARE WE?

Live Nation Entertainment is the world’s leading live entertainment company, comprised of global market leaders: Ticketmaster, Live Nation Concerts, and Live Nation Media & Sponsorship. Ticketmaster is the global leader in event ticketing with over 500 million tickets sold annually and more than 12,000 clients worldwide.  Live Nation Concerts is the largest provider of live entertainment in the world promoting more than 40,000 shows and 100+ festivals annually for nearly 4,000 artists in over 40 countries. These businesses allow Live Nation Media & Sponsorship to create strategic music marketing programs that connect over 1,000 brands with the 98 million fans that attend Live Nation Entertainment events each year. For additional information, visit www.livenationentertainment.com.

WHO ARE YOU?

Passionate and motivated. Driven, with an entrepreneurial spirit. Resourceful, innovative, forward thinking and committed. At Live Nation Entertainment, our people embrace these qualities, so if this sounds like you then please read on! 

THE TEAM

Core Data Services team is at the center of Data and Analytics initiatives. We are building a modern data platform to support enterprise data needs. Our mission and yours too should you choose to, is to empower and enable our data community of data engineers, data scientists, analysts, product teams and decision makers to create value.


The Core Data Services team consists of Platform Engineering, Data Engineering, Data Enablement and Operations teams. We are building a highly functional, performant modern enterprise Data Lake while supporting our current data platforms, so the focus is on maximizing functionality, creating value and content/data assets, cost optimizations and usability of the data delivery and services and all this is our measure of our success and defines us The Core Data Services Team! We are looking for a Data Engineer - Platform, You!

THE ROLE

This is a hands-on Data Engineering role that will require strong Python/PySpark coding skills.

 

WHAT THIS ROLE WILL DO

  • Contribute to the enhancements and continuous improvement of performance and reliability of the existing Data Platform Services to meet the requirements from Data Engineering/Product team
  • Design and build self servicing onboarding and automation capabilities in Core Data Platform services in a scalable, reliable and secure way.
  • Design and build platform capabilities to support onboarding and operation effectiveness 
  • Design and develop scalable data platform and integration solutions for various data sources leveraging Databricks Unified Platform
  • Ensure data quality and integrity across all data systems.
  • Ensure data security and compliance with relevant regulations.
  • Implement best practices for data management and governance.
  • Develop and maintain documentation for data systems and processes.
  • Monitor and troubleshoot data platform issues.
  • Participate in on-call rotations/Pagerduty for data platform support.

TECHNICAL SKILLS/COMPETENCIES

  • Good understanding of Data Lakes, Data Warehouses is MUST to have
  • Software development, coding expertise in the Data engineering field using any of the Python/PySpark is MUST to have
  • Hands on experience using version control systems such as Git and CI/CD workflows and practice
  • Design and Develop data ingestion services that are highly performant, reliable and scalable
  • Decent expertise using ANSI SQL and Spark SQL is key to have
  •  Workflow automation, orchestration using Airflow  or  equivalent tools stack
  • Hands on working knowledge on at least in one of these : Databricks, Hadoop and related stacks
  • Working experience
    • in at least one of cloud services from any of the Amazon AWS, Google GCP or Microsoft Azure, preferably AWS
    • streaming (Kafka) and batch based data sources
    • diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases
  • Any visualization experience is an advantage so you can bring clarity to prod incidents by using them is a nice to have
  • An excellent understanding of the nuances that add complexities around time zones, geo, various data formats, data types across different storage systems is nice to have
  • Agile development methodologies using the Atlassian suite: Jira, Confluence
  • Collaborate with cross-functional teams to deliver data solutions and provide technical support and guidance to team members.
  • Stay up-to-date with the latest data engineering technologies and trends.

BENEFITS & PERKS

Our motto is ‘Taking Care of Our Own’ through 6 pillars of benefits:

  • HEALTH: Medical, Dental and Vision benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs)
  • YOURSELF: Paid time off policy including holidays, sick time, and day off for your birthday, free concert tickets
  • WEALTH: 401(k) program with company match, Stock Program Reimbursement
  • FAMILY: New parent programs & support including caregiver leave and baby bonus, infertility support
  • CAREER: Tuition reimbursement, student loan repayment internal growth and development programs & trainings
  • OTHERS: Volunteer time off, crowdfunding network

Live Nation’s policy regarding vaccinations and masking related to a pandemic or other infectious disease control measures, acts of God, health and safety mandates and/or restrictions imposed by applicable local, state or federal governments has evolved over time. Currently, we strongly encourage employees to be fully vaccinated from such infectious diseases for which vaccinations are available. You are expected to follow Live Nation’s health and safety protocols and policies as they change from time to time.

EQUAL EMPLOYMENT OPPORTUNITY

We are passionate and committed to our people and go beyond the rhetoric of diversity and inclusion.  You will be working in an inclusive environment and be encouraged to bring your whole self to work.  We will do all that we can to help you successfully balance your work and homelife.  As a growing business we will encourage you to develop your professional and personal aspirations, enjoy new experiences, and learn from the talented people you will be working with.  It’s talent that matters to us and we encourage applications from people irrespective of their gender, race, sexual orientation, religion, age, disability status or caring responsibilities.


Live Nation strongly supports equal employment opportunity for all applicants regardless of age (40 and over), ancestry, color, religious creed (including religious dress and grooming practices), family and medical care leave or the denial of family and medical care leave, mental or physical disability (including HIV and AIDS), marital status, domestic partner status, medical condition (including cancer and genetic characteristics), genetic information, military and veteran status, political affiliation, national origin (including language use restrictions), citizenship, race, sex (including pregnancy, childbirth, breastfeeding and medical conditions related to pregnancy, childbirth or breastfeeding), gender, gender identity, and gender expression, sexual orientation, or any other basis protected by applicable federal, state or local law, rule, ordinance or regulation. 

We will consider qualified applicants with criminal histories in a manner consistent with the requirements of the Los Angeles Fair Chance Ordinance, San Francisco Fair Chance Ordinance and the California Fair Chance Act and consistent with other similar and / or applicable laws in other areas.

We also afford equal employment opportunities to qualified individuals with a disability. For this reason, Live Nation will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant  consistent with its legal obligations to do so, including reasonable accommodations related to pregnancy in accordance with applicable local, state and / or federal law. As part of its commitment to make reasonable accommodations, Live Nation also wishes to participate in a timely, good faith, interactive process with a disabled applicant to determine effective reasonable accommodations, if any, which can be made in response to a request for accommodations. Applicants are invited to identify reasonable accommodations that can be made to assist them to perform the essential functions of the position they seek. Any applicant who requires an accommodation in order to perform the essential functions of the job should contact a Human Resources Representative to request the opportunity to participate in a timely interactive process.  Live Nation will also provide reasonable religious accommodations on a case by case basis.

HIRING PRACTICES
The preceding job description has been designed to indicate the general nature and level of work performed by employees within this classification. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities, and qualifications required of employees assigned to this job.

Live Nation recruitment policies are designed to place the most highly qualified persons available in a timely and efficient manner. Live Nation may pursue all avenues available, including promotion from within, employee referrals, outside advertising, employment agencies, internet recruiting, job fairs, college recruiting and search firms.

#LI-EF1

#LI-RemoteUnitedStates

----------

The expected compensation for this position is:

$140,000.00 USD - $175,000.00 USD

** Pay is based on a number of factors including market location, qualifications, skills, and experience.

Apply now Apply later
Job stats:  0  0  0
Category: Engineering Jobs

Tags: Agile Airflow Avro AWS Azure CI/CD Classification Confluence Databricks Data management Data quality Engineering GCP Git Hadoop Jira JSON Kafka Parquet PySpark Python Security Spark SQL Streaming XML

Perks/benefits: 401(k) matching Career development Equity / stock options Flex hours Flex vacation Health care Medical leave Salary bonus Team events

Regions: Remote/Anywhere North America
Country: United States

More jobs like this