Data Engineer (Databricks)

Solvd Inc. is a premier software engineering company. We have 8 offices across the globe and over 800 international employees on staff. With over 12 years of experience, highly skilled teams around the world and deep industry knowledge, we help clients create software that improves their operations and opens new markets. We have built an impressive roster of digital-native enterprise clients including some of the biggest brands in retail and social media.
We are looking for an experienced Data Engineer to join our growing team.

Requirements:

• 8+ years in Python and SQL.
• Passionate about science and building solutions to make the data more accessible to end-users.
• Elasticsearch, science background, or experience with scientific instruments.
• Experience with tools like Spotfire, Tableau, Jupyter notebook (any of them).
• Undergraduate degree in Chemistry, Biology, Computer Science, Statistics, Public Health, etc.
• Excellent communication skills, attention to detail, and the confidence to take control of project delivery.
• Quickly understand a highly technical product and effectively communicate with product management and engineering.
• Proactive problem-solving skills.
• High-bandwidth: thrives when managing multiple simultaneous projects.
• Experience with AWS, Databricks, data pipelines, Node Js.
• Intellectually curious unwavering drive to learn more every day.
• Ability to think creatively about how to solve projects risks without.
• Experience with Snowflake, Lakehouse, and Databricks architecture.

Responsibilities:

• Own, prototype, and implement customer solutions.
• Research and prototype data acquisition strategy for scientific lab instrumentation.
• Research and prototype file parsers for instrument output files (.xlsx, .pdf, .txt, .raw, .fid, and many other vendor binaries).
• Design and build data models.
• Design and build Python data pipelines, unit tests, integration tests, and utility functions.
• Build visualization, report, and dashboards using Spotfire, Tableau, Jupyter notebook and etc.
• Work with the customer to test and make sure the solution fulfills their requirements and solves their need.
• Coordinate project kickoff meetings; manage the customer relationship throughout the project, and conduct formal project closeout meetings.
• Facilitate internal project post-mortems to identify areas of improvement on the next implementation.