Data Pipeline Engineer
Phoenix, AZ
Lucid Motors
Lucid is the future of sustainable mobility, designing electric cars that further reimagines the driving experience.Overview:
This role is for the Data team in the ADAS/AD org. We manage the data collected by all Lucid cars. Our primary role is to enable the teams to train & refine their AI/ML models; and our scope extends to on-car programming, frontend, backend, data-pipelines, ML models, dashboards, and analytics.
Roles and responsibilities:
- Devise, develop, and maintain Autonomous Driving data processing pipelines on the AWS cloud, Kubernetes clusters, and on-prem servers.
- Develop scalable microservices following industry standards and deploy on K8s cluster. Add support for logging, testing, and alarms to ensure maintainability.
- Work with structured data. Adopt the OLAP and OLTP databases that suite your application.
- Cleanup, parse, process, store, and dashboard unstructured data recorded from on-board vehicle sensors (e.g. Camera, Lidar, RADAR, GPS, and other timeseries data).
- Help us optimize the data storage, search, and data processing based on a diverse mix of storage solutions, caching techniques, and big data frameworks.
- Work with multiple cross-domain teams (e.g. Data Collection, Machine Learning, testing engineers, 3rd party data-annotation vendors etc.). Create or modify software solutions that fit their needs.
Qualifications:
- Bachelor’s degree in Computer Science or related.
- 5 years of related experience or 3 years experience with masters degree.
- Ability to architect and deliver the software solutions from loosely described technical and non-technical requirements.
- Proficiency in Python and/or Golang.
- Experience working with Relational database, preferably PostgreSQL.
- Professional experience with AWS cloud and deploying to Kubernetes cluster.
- Experience with developing parallel-processing software, containerized applications, and backend microservices.
Preferred:
- Experience in building efficient and scalable distributed systems capable of handling many terabytes of data per day.
- Previous experience in the Autonomous Driving industry, specifically read/write/use the sensor data.
By Submitting your application, you understand and agree that your personal data will be processed in accordance with our Candidate Privacy Notice. If you are a California resident, please refer to our California Candidate Privacy Notice.
To all recruitment agencies: Lucid Motors does not accept agency resumes. Please do not forward resumes to our careers alias or other Lucid Motors employees. Lucid Motors is not responsible for any fees related to unsolicited resumes.* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Autonomous Driving AWS Big Data Computer Science Distributed Systems Golang Kubernetes Lidar Machine Learning Microservices ML models OLAP Pipelines PostgreSQL Privacy Python Radar RDBMS Testing Unstructured data
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.