Sr Data Engineer - Pyspark
Estero, FL, United States
Hertz
Buchen Sie mit Hertz Mietwagen und Transporter in Deutschland und der Welt. Buchen Sie direkt mit uns, um von den besten Angeboten Gebrauch zu machen.A Day in the Life:
The Senior Data Engineer, PySpark will be responsible for building and maintaining data pipelines and workflows that support ML, BI, analytics, and software products. This individual will work closely with data scientists, data engineers, analysts, software developers and SME’s within the business to deliver new and exciting products and services. The main objectives are to develop data pipelines and fully automated workflows to drive operational efficiency and effectiveness by enabling data-driven decisions across the organization. This includes fostering collaboration, building partnerships, co-developing products, sharing knowledge, providing insights and valuable predictive information to business teams and leaders to highlight potential risks and opportunities that initiate the drive for change. The ideal candidate will be able to start work in Jan 2025.
What You'll Do:
- Development of high-quality code for the core data stack including data integration hub, data warehouse and data pipelines.
- Build data flows for data acquisition, aggregation, and modeling, using both batch and streaming paradigms
- Empower data scientists and data analysts to be as self-sufficient as possible by building core systems and developing reusable library code
- Support and optimize data tools and associated cloud environments for consumption by downstream systems, data analysts and data scientists
- Ensure code, configuration and other technology artifacts are delivered within agreed time schedules and any potential delays are escalated in advance
- Collaborate across developers as part of a SCRUM team ensuring collective team productivity
- Participate in peer reviews and QA processes to drive higher quality
- Ensure that 100% of code is well documented and maintained in source code repository.
- Strive to engineering excellence by simplifying, optimizing, and automating processes and workflows.
- Proactively educate others on basic data management concepts such as data governance, master data management, data warehousing, big data, reporting, data quality, and database performance.
- Superior & demonstrated team building & development skills to harness powerful teams
- Ability to communicate effectively with different levels of leadership within the organization
- Provide timely updates so that progress against each individual incident can be updated as required
- Write and review high quality technical documentation
- Ensures their workstation and all processes and procedures, follow organization standards
- Encourages and maintains a ‘Best practice sharing culture’, always striving to find ways to improve service and change mind set.
What We're Looking for:
- Minimum of 5 years professional experience as a data engineer, software engineer, data analyst, data scientist or related role
- Strongly prefer hands on experience with DataBricks
- Experience with relational and dimensional database modelling (Relational, Kimball, or Data Vault)
- Proven experience with all aspects of the Data Pipeline (Data Sourcing, Transformations, Data Quality, Etc…)
- Bachelors or Masters in Computer Science, Information Systems, or an engineering field or equivalent work experience
- Prefer Travel, transportation, or hospitality experience
- Prefer revenue management and pricing experience
- Prefer experience with designing application data models for mobile or web applications
- Excellent written and verbal communication skills.
- Prefer morning people - regular work hours are based on US Eastern Time, and this role will include collaboration with France based partners.
- Prefer occasional flexibility in scheduling which may include nights, weekends, and holidays
- Prefer experience with event driven architectures and data streaming pub/sub technologies such as IBM MQ, Kafka, or Amazon Kinesis.
- Prefer experience developing APIs to send and receive near real time data for up to 1 billion events per day.
- Prefer experience with Java / Scala and Springboot.
- Strong capabilities in a scripting language such as Python, R, etc.
- Strong capabilities in SQL and experience with stored procedures
- Strong interpersonal and communication skills with Agile/Scrum experience.
- Strong problem solving and critical thinking skills with a proven record for identifying and diagnosing problems, and solving complex problems with simple, logical solutions.
- Outstanding verbal, written, presentation, facilitation, and interaction skills, including ability to effectively communicate technical and non-technical issues and concepts to multiple organization levels.
What You'll Get:
- Up to 40% off any standard Hertz Rental
- Paid Time Off
- Medical, Dental & Vision plan options
- Retirement programs, including 401(k) employer matching
- Paid Parental Leave & Adoption Assistance
- Employee Assistance Program for employees & family
- Educational Reimbursement & Discounts
- Voluntary Insurance Programs - Pet, Legal/Identity Theft, Critical Illness
- Perks & Discounts –Theme Park Tickets, Gym Discounts & more
The Hertz Corporation operates the Hertz, Dollar Car Rental, Thrifty Car Rental brands in approximately 9,700 corporate and franchisee locations throughout North America, Europe, The Caribbean, Latin America, Africa, the Middle East, Asia, Australia and New Zealand. The Hertz Corporation is one of the largest worldwide airport general use vehicle rental companies, and the Hertz brand is one of the most recognized in the world. US EEO STATEMENT At Hertz, we champion and celebrate a culture of diversity and inclusion. We take affirmative steps to promote employment and advancement opportunities. The endless variety of perspectives, experiences, skills and talents that our employees invest in their work every day represent a significant part of our culture – and our success and reputation as a company. Individuals are encouraged to apply for positions because of the characteristics that make them unique. EOE, including disability/veteran
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Architecture Big Data Computer Science Databricks Data governance Data management Data pipelines Data quality Data warehouse Data Warehousing Engineering Java Kafka Kinesis Machine Learning Pipelines PySpark Python R Scala Scrum SQL Streaming
Perks/benefits: Career development Health care Insurance Medical leave Parental leave Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.