R&D AI Software Engineer / End-to-End Machine Learning Engineer / RAG and LLM

Palo Alto, California, United States - Remote

⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️

Pathway

Python ETL framework for stream processing, real-time analytics, RAG, and LLM pipelines.

View all jobs at Pathway

Apply now Apply later

About Pathway

Pathway is building live AI systems that think and learn in real time as humans do.  Our mission is to deeply understand how and why LLMs work, fundamentally changing the way models think.

The team is made up of AI luminaries. Pathway's CTO, Jan Chorowski, co-authored papers with Geoff Hinton and Yoshua Bengio and was one of the first people to apply attention to speech. Our CSO, Adrian Kosowski, received his PhD in Theoretical Computer Science at the age of 20 and made significant contributions across numerous scientific fields, including AI and quantum information. He also served as a professor and a coach for competitive programmers at Ecole Polytechnique. The team also includes numerous world's top scientists and competitive programmers, alongside seasoned Silicon Valley executives.

Pathway has strong investor backing. To date, we have raised over $15M; our latest reported round was our seed. Our offices are located in Palo Alto, CA, as well as Paris, France, and Wroclaw, Poland.


The Opportunity

We are currently searching for 2 ML/AI Engineers with a solid software engineering backbone who are able to prototype, evaluate, improve, and productionize end-to-end Machine Learning projects with enterprise data.

For representative examples of the type of projects you would be expected to create or deliver, see our pipelines" rel="nofollow noreferrer noopener" target="_blank">AI pipelines templates.

If you would consider it would be fun to create a hybrid Vector/Graph index that beats the state of the art on a RAG benchmark, to deliver a working AI pipeline to a client in a critical industry, or to pre-process datasets in a way which would boost LLM accuracy in inference & training - this is the job for you!

You Will

  • help design experimental end-to-end ML/AI pipelines
  • contribute to addressing new use cases, beyond state of the art
  • improve/adapt AI pipelines for production, working directly with client data (often live data streams)
  • invent ways to pre-process data sources and perform tweaks (reranking, model paramater configuration...) for optimal performance of AI pipelines.
  • design benchmark tasks and perform experiments.
  • build unit tests and implement model monitoring.
  • contribute high-quality production code to our developer frameworks, used by thousands of developers.
  • help to pre-process data sets for LLM training.

The results of your work will play a crucial role in the success of both our developer offering and client delivery.

Requirements

Cover letter

It's always a pleasure to say hi! If you could leave us 2-3 lines, we'd really appreciate that.

You Are

  • A graduate of a 4+-year university degree in Computer Science, where you have received A-grades in both foundational courses (Algorithms, Computational Complexity, Graph Theory,...) and Machine Learning courses.
  • Passionate about delivering high-quality code and solutions that work.
  • Good with data & engineering innovation in practice - you know how to put things together so that they don't blow up.
  • Experienced at hands-on Machine Learning / Data Science work in the Python stack (notebooks, etc.).
  • Experienced with model monitoring, git, build systems, and CI/CD.
  • Respectful of others
  • Curious of new technology - an avid reader of HN, arXiv feeds, AI digests, ...
  • Fluent in English

Bonus Points

  • Successful track-record in algorithms (ICPC / IOI), data science contests (Kaggle), or a HuggingFace leaderboard.
  • Showing a code portfolio.
  • PhD in Computer Science.
  • Authoring a paper at major Machine Learning conference.
  • You like playing/tinkering with new tools in the LLM stack.
  • You are already a part of the Pathway community, or have been recognized for your work in one of our bootcamps.

Why You Should Apply

  • Join an intellectually stimulating work environment.
  • Be a technology innovator that makes a difference: your code gets delivered to a community of thousands of developers, and to clients processing billions of records of data.
  • Be part of one of an early-stage AI startup that believes in impactful research and foundational changes.

Benefits

  • Type of contract: Full-time, permanent
  • Preferable joining date: January 2025. The positions are open until filled – please apply immediately.
  • Compensation: competitive base salary (80th to 99th percentile) based on profile and location + Employee Stock Option Plan + possible bonuses if working on client projects. The stated lower band of EUR 72k/ USD 75k for the salary base concerns senior candidates; mid-senior or mid candidates may be considered with adapted salary bands.
  • Location: Remote work. Possibility to work or meet with other team members in one of our offices: Palo Alto, CA; Paris, France or Wroclaw, Poland. As a general rule, permanent residence will be required in the EU, UK, US, or Canada.
    (Note for candidates based in India: We are proud to be part of the current Inter-IIT as well as a partner of ICPC India. Top IIT/IIIT graduates are more than welcome to apply regardless of current location.)

If you meet our broad requirements but are missing some experience, don’t hesitate to reach out to us.

Apply now Apply later
Job stats:  0  0  0

Tags: CI/CD Computer Science Engineering Git HuggingFace LLMs Machine Learning PhD Pipelines Python R RAG R&D Research

Perks/benefits: Career development Competitive pay Equity / stock options Salary bonus Startup environment

Regions: Remote/Anywhere North America
Country: United States

More jobs like this