Senior Data Engineer

Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 114,000 colleagues serve people in more than 160 countries.

     

JOB DESCRIPTION:

Working at Abbott

At Abbott, you can do work that matters, grow, and learn, care for yourself and family, be your true self and live a full life. You’ll also have access to: 

• Career development with an international company where you can grow the career you dream of. 

• Free medical coverage for employees* via the Health Investment Plan (HIP) PPO 

• An excellent retirement savings plan with high employer contribution 

• Tuition reimbursement, the Freedom 2 Save student debt program and FreeU education benefit - an affordable and convenient path to getting a bachelor’s degree. 

• A company recognized as a great place to work in dozens of countries around the world and named one of the most admired companies in the world by Fortune.  

• A company that is recognized as one of the best big companies to work for as well as a best place to work for diversity, working mothers, female executives, and scientists.  

 

About Lingo

Meet Lingo, a new biosensing technology that provides users a window into their body. Lingo tracks key biomarkers – such as glucose, ketones, and lactate – to help people make better decisions about their health and nutrition. Biowearable technology will digitize, decentralize and democratize healthcare, enabling consumers to take control of their own health.

The Opportunity

This position works out of our Alameda location in the Lingo Division..   

We are seeking a Senior Data Engineer with deep expertise in Apache Spark to join our team. You will play a critical role in helping us deliver clinically validated, regulatory grade digital health products and solutions in preventive care using Bio-Wearables. In this role, you will design and optimize data pipelines, build scalable data workflows, and work closely with data analysts, scientists and back-end engineers to support teal-time analytics and machine learning initiatives. This is a hands-on technical role requiring strong problem-solving skills and deep knowledge of distributed systems.

What You’ll Work On 

• Developing, testing, and optimizing Apache Spark jobs for data acquisition, transformation and processing

• Build and maintain efficient data pipelines to support real-time and batch processing needs.

• Collaborate with data scientists to develop and integrate machine learning models into data workflows.

• Optimize Spark jobs to maximize speed, scalability and compliance with data-use regulations.

• Perform advanced data analysis and contribute to the development of analytics solutions. • Integrate pipelines with distributed file systems such as HDFS, S3 or Ceph.

• Work alongside back-end engineers to design and manage interactive Spark pipelines

• Develop REST APIs to enable seamless integration with Spark jobs and data workflows.

Required Qualifications 

• 3-5 years of experience in building and maintaining large-scale data pipelines.
• Expertise in Apache Spark, including Spark SQL, RDD, DataFrame, Dataset APIs, and PySpark.
• Solid programming skills in Python, and Java (Scala experience is a plus).
• Knowledge of Spark internals and real-time streaming technology (e.g., Kafka, KSQL, etc.)
• • Experience with big data processing tools (Experience with Apache Druid is a huge plus).
• Familiarity with ETL tools and expertise in managing post-loading transformations.
• Experience working with distributed file systems like HDFS, or S3. • Understanding of cloud platforms such as AWS or Azure for managing Apache Spark clusters
• Familiarity with machine learning frameworks and algorithms (Experience integrating ML models is a plus).
• Strong problem-solving and debugging skills.
• Ability to collaborate effectively in cross-functional teams.

Apply Now 

 

* Participants who complete a short wellness assessment qualify for FREE coverage in our HIP PPO medical plan. Free coverage applies in the next calendar year. 

Learn more about our health and wellness benefits, which provide the security to help you and your family live full lives:  www.abbottbenefits.com  

Follow your career aspirations to Abbott for diverse opportunities with a company that can help you build your future and live your best life. Abbott is an Equal Opportunity Employer, committed to employee diversity. 

Connect with us at www.abbott.com, on Facebook at www.facebook.com/Abbott and on Twitter @AbbottNews. 

     

The base pay for this position is

$112,000.00 – $224,000.00

In specific locations, the pay range may vary from the range posted.

     

JOB FAMILY:

Product Development

     

DIVISION:

LNGO Lingo

        

LOCATION:

United States > Alameda : 2901 Harbor Bay Parkway

     

ADDITIONAL LOCATIONS:

     

WORK SHIFT:

Standard

     

TRAVEL:

Not specified

     

MEDICAL SURVEILLANCE:

Not Applicable

     

SIGNIFICANT WORK ACTIVITIES:

Continuous sitting for prolonged periods (more than 2 consecutive hours in an 8 hour day), Keyboard use (greater or equal to 50% of the workday)

     

Abbott is an Equal Opportunity Employer of Minorities/Women/Individuals with Disabilities/Protected Veterans.

     

EEO is the Law link - English: http://webstorage.abbott.com/common/External/EEO_English.pdf

     

EEO is the Law link - Espanol: http://webstorage.abbott.com/common/External/EEO_Spanish.pdf