Data Engineer

Description

Prisma Photonics, a fast growing stat up, transforms infrastructure monitoring by leveraging optical fibers to monitor critical, large-scale systems like power grids and oil & gas pipelines across thousands of kilometers without the need for traditional sensors.

Our Hyper-Scan Fiber-Sensing™ technology, combined with advanced machine learning, empowers utility operators to achieve environmental and renewable energy goals while maintaining operational excellence on their path to net-zero emissions.

Founded in 2017, with offices in the U.S., Europe, and Israel (HQ), Prisma Photonics is led by an expert team with a proven track record in building and scaling successful companies within the lasers and deep-tech sectors.

We are seeking a talented, self-driven and passionate Data Engineer to build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting. 

What You’ll Do

• Design data collection, storage, search and access APIs.   
• Develop the data storage and meta data databases for our AI and Algorithms teams to access train and test. 
• Design and implement data pipelines and ETLs both for on-prem and cloud environments. 
• Make data easily and fast accessible and searchable. 
• Work closely with Software, AI and Algorithm teams on system integration, benchmarking and data access. 

Requirements

What You Bring

• Bachelor’s degree in a quantitative field such as math, computer science, engineering, etc. 
• Know how and experience in building databases and organizing it. 
• 2-3 years of experience with SQL and NoSql DBs (MySql, Elastic, MongoDB, Postgres). 
• Strong programming skills - mostly python. 
• Experience with design and implementation of data pipelines. 
• Strong collaborator with teams and peers 
• Innovative with a growth mindset 

Advantages

• Experience with streaming technologies, unstructured data and different data types (other than text and tables) 
• Additional software programming experience 
• Experience with any of the following: Airflow, Jenkins, Git, Kubernetes, distributed computing. 
• Cloud provisioning and administration experience. 
• Working on cloud environment (preferably AWS). 
• Knowledge of data analysis tools s.a. Grafana or DataDog.