System Software Architect

Description

We are seeking a System Architect to join our team and play a key role in shaping the architecture of NeuReality's AI inference appliance.

As a System Architect, you will be integral in driving the company's architectural roadmap, working closely with the product team, CTO, and development teams. Together, you’ll analyze new market demands and define the product architecture for our Server-on-Chip system, which caters to a wide range of AI verticals.

  Responsibilities: 

• Collaborate closely with the product team and CTO to assess new requirements and define the company’s architectural roadmap and Plan of Record (POR).
• Design system flows and deployment models for NeuReality’s AI inference appliance in advanced cloud environments.
• Establish architecture guidelines, requirements, and the division of labor between software toolchain components, firmware, and hardware elements of the SoC.
• Lead performance estimations, measurements, and optimizations, as well as system-level integration efforts.
•  Engage directly with end customers to shape use cases and system solutions, including demos and Proofs of Concept (PoCs). 

Requirements

·        BSc/MSc in Electrical Engineering, Computer Science, or a related field

·        10+ years of proven experience working with complex systems that integrate hardware, firmware, and software

·        Familiarity with deep learning frameworks such as PyTorch and TensorFlow

·        Strong background in software architecture, particularly in HW/SW APIs, CPU and memory subsystems, system performance, scaling, and optimization

·        Hands-on approach with practical experience in software development

·        Excellent communication skills and a collaborative team player 

Advantages: 

·        Familiarity with AI systems and hardware acceleration engines for AI workloads

·        Experience in compiler development, particularly with MLIR/LLVM frameworks

·        Knowledge of Kubernetes orchestration, load balancing, and data-center architecture

·        Familiarity with high-speed I/O subsystems like PCIe, CXL.io, CXL.mem, as well as storage technologies including NVMe, NVMeOF, Object, and Block storage