Principal Software Engineer
Boston, United States
USD 187K-250K (estimate) Senior-level Full Time
Tasks
- Balance load across nodes
- Build instrumentation and tracing
- Build routing and batching
- Collaborate on architecture and roadmaps
- Create dynamic loading mechanisms
- Design inference engine
- Develop inference engine
- Document engineering best practices
- Implement memory management
- Mentor engineers
- Optimize LLM inference performance
- Orchestrate distributed inference
- Profile system bottlenecks
Perks/Benefits
Skills/Tech-stack
AWS | Azure | Batching | CI/CD | Controller patterns | Distributed Systems | GCP | GPU | GitOps | Go | Helm | Kubernetes | Load Balancing | Memory Management | Networking | Observability | Orchestration | Profiling | Pulumi | Python | Routing | Scaling | Scheduling | Terraform | Tracing
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior Platform Engineer - Databricks Integration USD 180K-247KAPI Integration | AWS GovCloud | Agile Development | Auto Scaling | CI/CDSenior-level Full TimeFalls Church, VA, United States6h ago
-
Analytics Engineer USD 120K-175KData Cataloging | Data Governance | Data Pipelines | Data Quality | Data Quality ManagementHybrid work schedule | Mentorship and training | Professional office environmentSenior-level Full TimeMilwaukee, WI, United States8h ago
-
Entry-level Full TimeCary, NC, United States8h ago
-
Apache Spark | Clustering | Data Ingestion | Data Ingestion Pipelines | Data ModelingSenior-level ContractLos Angeles, United States9h ago
-
Cloud Computing | Data Pipelines | Experimental Design | Java | Machine LearningCommunity volunteering | Internal mobility | Learning opportunities | Mentorship programs | Recognition programsMid-level Full TimeAustin, TX, United States9h ago
-
Senior-level Full TimeAustin, TX, United States9h ago
-
Availability Engineering | Canary Deployment | Capacity Planning | Cause analysis | Change ManagementSenior-level Full TimeSeattle, Washington, United States10h ago
-
Data Analysis | Distributed Systems | Experimentation | Information Retrieval | Language ModelsSenior-level Full TimeSan Jose, California, United States11h ago
-
Automation | Canary Deployment | Capacity Planning | Cause analysis | Change ManagementSenior-level Full TimeSeattle, Washington, United States11h ago
-
Apache Spark | Computer Vision | Data Curation | Data Pipelines | GroundingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …12h ago
-
Computer Vision | Data Preparation | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA12h ago
-
Staff Software Engineer, AI/ML, App Ads Quality USD 207K-300KCross-Functional Collaboration | Cross-functional | Data Processing | Data Storage | Data StructuresSenior-level Full TimeMountain View, CA, USA12h ago
-
Agentic AI | Computer Vision | Continuous integration | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA12h ago
-
Senior Software Engineer, AI Powered GRC Automation USD 174K-252KContinuous controls monitoring | Controls monitoring | Data Mining | Data Processing | Data StructuresSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA12h ago
-
Staff Software Engineer, NotebookLM, Generative AI, Labs USD 207K-300KAlerting | Computer Vision | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA12h ago
-
Systems Development Engineer, Quantum AI USD 138K-198KAutomation | CI/CD | Cloud APIs | Cloud infrastructure | Configuration ManagementMid-level Full TimeGoleta, CA, USA12h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KAlgorithms | C++ | Data Analysis | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA12h ago
-
Embedded Firmware Engineer, Digital Signal Processing USD 192K-278KAuto-negotiation | Bring-up | DSP | Digital Signal | Digital Signal ProcessingSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Senior-level Full TimeUnited States14h ago
-
AI/ML Engineer USD 117K-171KA/B | A/B Testing | API Development | AWS | B testingDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US14h ago
-
Cloud Data Engineer USD 92K-113KAgile | Apache Airflow | Beam | BigQuery | Cloud ComposerOnsite workMid-level Full TimeAda, MI, United States, 4935516h ago
-
AWS | Azure | Cloud platform | Data Pipelines | Demand forecastingOnsite collaborationSenior-level Full TimeLewisville, TX, US19h ago
-
Sr. Staff Software Engineer - Managed Tables USD 228K-314KAlgorithms | Automation | Capacity Planning | Data Structures | Database systemsSenior-level Full TimeMountain View, California21h ago
-
Senior Embedded Software Engineer USD 170K-210KC++ | Cause analysis | Configuration Management | Device identity | Diagnostics401k | FSA or HSA | Health, dental, vision insurance | Incentive stock options | Pre-tax commuter benefitsSenior-level Full TimeEmeryville, United States22h ago
-
Senior Machine Learning Engineer, Agentic USD 163K-245KArtificial Intelligence | Direct Preference Optimization | Evaluation | Fine Tuning | Human-in-the-loop401k matching | Catered meals | Employee events | Employer-paid disability insurance | Employer-paid life insuranceSenior-level Full TimeBellevue, WA; Menlo Park, CA22h ago