Senior C++ Software Engineer, Data Engines
US Remote
Full Time Senior-level / Expert USD 171K - 210K
We are looking for a highly motivated Senior C++ Software Engineer for Data Engines, you’ll have the opportunity to work directly on Theseus, the accelerator-native data processing engine built for composability. You will work closely with Voltron Data development teams to build, optimize and maintain our data execution framework, adding new features, making it run faster and more scalable and even contributing to new core architectural components that will enable the engine to run at Petabyte scale.
Why work at Voltron Data?
- We are Going for Impact: We are a Series A, venture-backed startup assembling a global team to build a new foundation for data analytics with Apache Arrow. This foundation will usher in a wave of innovation in data processing that can take full advantage of the speed and efficiency offered by modern hardware.
- We are Committed to Bridging Open Source Communities: We are a collection of open source maintainers who have been driving open source ecosystems over the last 15 years, particularly in the C++, Python, and R programming ecosystems.
- We are Building a Diverse, Inclusive Company: We are creating a representative, equitable, and respectful workplace that prioritizes employee growth. Everyone at Voltron Data is bought into the company’s success; all voices are critical to shaping the organization’s future.
Timeline:
Below is a rough timeline of where you can expect to be at different points during your career path starting in this position.
Upon Joining:
- Spending time learning about the Apache Arrow, the compute primitives we use in Theseus, the query parser and optimizer and other foundational components.
- Diving into the data processing engine architecture, how all the different components interact with each other and how data flows through the compute graph.
- Understanding memory management mechanics, including spilling memory from GPU, to Host and Disk.
- Learning and embracing the software development culture at Voltron Data.
Within a month:
- Profiling single node and distributed queries executions and analyzing the engine telemetry to better understand how the engine works and how to solve distributed engine issues.
- Diving deep into the various distributed relational algebra algorithms to understand how they work and how they can be improved.
- Working with the team on fixing bugs, implementing simple optimizations or code refactoring projects.
Within 6 months:
- Building new relational algebra components to expand SQL coverage or DataFrame functionality coverage.
- Making small improvements to more sophisticated engine components such as resource management, task scheduling, and fault tolerance.
Within 12 months:
- Proposing and implementing core architecture improvements to the engine.
- Working on challenging tasks such as language agnostic user defined functions, multi-query concurrency, and multi-tenancy.
- Integrating the engine with other components and features developed by other teams in the company to provide enterprise grade customer experiences.
Previous experience that could be helpful:
- Experience with data processing engines or frameworks
- Experience in distributed and multi-threaded systems
- Experience in HW resource management including memory and thread pools
- Working with SQL and non-SQL systems and their computational abstractions
- Developing in C++, especially using modern C++
- Developing for multiple types of hardware (i.e. CPU, GPU)
US Compensation - The salary range for this role is between $171,000.00 to $210,000.00. We have a global market-based pay structure which varies by location. Please note that the base pay range is a guideline and for candidates who receive an offer, the exact base pay will vary based on factors such as actual work location, skills and experience of the candidate. This position is also eligible for additional incentives such as equity awards.
#LISM1
Benefits
• Work from Anywhere - Payroll and Benefits in 150+ Countries • Unlimited PTO • Medical, Dental, and Vision • Retirement [USA Only] • Home Office Budget • Continuing Education Budget We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.To All Agencies: Please, no phone calls or emails to any employee of Voltron Data outside of the Talent Acquisition team. Voltron Data's policy is to only accept resumes from agencies via the Voltron Data Agency Portal. Agencies must have a valid fee agreement in place and they must have been assigned the specific requisition to which they submit resumes, by the Talent Acquisition team. Any resume submitted outside of this process will be deemed the sole property of Voltron Data and in the event a candidate is submitted outside of this policy is hired, no fee or payment of any kind will be paid
Tags: Architecture Arrow Data Analytics GPU Open Source Python R SQL
Perks/benefits: Career development Equity Health care Startup environment Unlimited paid time off
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Intern jobs
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Sr Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open LLMs-related jobs
- Open APIs-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open Hadoop-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs