Senior Software Engineer 3 - (Inference, AI Infrastructure, Python)
Tasks
- Configure inference models
- Deploy inference models
- Develop in house inference services
- Establish infrastructure for LLM powered tools
- Evaluate inference models
- Integrate LLM tools with user needs
- Maintain inference service quality
- Mentor engineers and develop best practices
- Support surge inference needs
- Translate stakeholder goals into engineering outcomes
Perks/Benefits
Skills/Tech-stack
AWS | Argo CD | CI/CD | Docker | Elastic | Grafana | Helm | Helm Charts | Inference Serving | Kubernetes | LLM Hosting | Litellm | Observability | Prometheus | Python | Quality of Service | Reliability Engineering | Site Reliability | Site Reliability Engineering | Traffic shaping | VLLM
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
C# | Data Governance | Data Modeling | Data Structures | Data pipeline401k | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2h ago
-
Software Engineer 1 - (AI/ML, Terraform, AWS) USD 164K-201KAI machine learning | Amazon Web Services | C++ | Data analytics | Databases401k match | Educational assistance | Healthcare coverage | PTOSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
Software Engineer 1 - (Python, JavaScript, AI/ML) USD 163K-199KArtificial Intelligence | CI/CD | Confluence | Docker | Git401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeFort Meade, Maryland2h ago
-
AWS | Artificial Intelligence | Confluence | Data Analysis | Eclipse401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …2h ago
-
Software Engineer 2 - (Python, PySpark, AWS) USD 208K-254KAWS Glue | AWS Lambda | Algorithms | Amazon DynamoDB | Amazon Web Services401k match | Educational assistance | Federal Holidays | Health insurance | PTOSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
Senior Applied AI Engineer 3 - (Python, LLMs, RAG) USD 232K-283KAI Agents | Backend Development | Distributed Systems | Docker | Elasticsearch401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
Software Engineer 1 - (AI, Python, LLM) USD 163K-199KAWS | ArgoCD | CI/CD | Docker | Helm401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2h ago
-
AWS | Argo CD | CI/CD | Docker | Elastic401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …2h ago
-
Anomaly Detection | Clustering | Data Analysis | Data Science | Elasticsearch401k matching | Direct employer 401k contribution | Educational assistance | Federal Holidays | Healthcare coverageSenior-level Full TimeFort Meade, Maryland2h ago
-
Senior Data Engineer (Remote) USD 108K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data VisualizationRemote workSenior-level Full TimeUnited States R2h ago
-
Amazon EKS | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon Web ServicesComprehensive insurance | Diversity and inclusion | Flexible work arrangements | Hybrid remote workMid-level Full TimeReston, VA R2h ago
-
Amazon Redshift | Amazon Web Services | Apache Airflow | CI/CD | CTEComprehensive insurance | Diversity and inclusion | Flexible work arrangementsMid-level Full TimeReston, VA; Reston, VA R2h ago
-
Big Data | Cloud Architecture | Containerization | Data Engineering | Data Transformation10 percent 401k match | 401k match | Comprehensive healthcare | Generous PTOMid-level Full TimeMcLean, VA2h ago
-
Apache Flink | Apache NiFi | Apache Spark | Apache Storm | Bash401k company contribution | Telework up to 16 hours weeklyMid-level Full TimeAnnapolis Junction, MD; Annapolis Junction, MD; …2h ago
-
AWS | Agentic AI | Deep learning | Docker | Generative AI401k contributions | Health insurance | Paid time off | Remote workSenior-level Full TimeAurora, CO2h ago
-
AWS | AWS S3 | Amazon SQS | Apache Airflow | Apache Kafka401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD R2h ago
-
Algorithm tuning | Confusion matrix | Data Mining | Data Visualization | Feature Engineering401k contribution | Flexible schedule | Health insurance | Paid time offSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Agile | Amazon S3 | Amazon SQS | Apache NiFi | Bash401k match | Fully paid medical | PTO | Training supportSenior-level Full TimeSan Antonio, TX R2h ago
-
Agile | Amazon S3 | Amazon SQS | Apache NiFi | Bash401k match | Fully paid medical | Hybrid work | Onsite clearance support | Paid time offSenior-level Full TimeColumbia, MD R2h ago
-
Data Governance | Data Modeling | Docker | ETL | JSON401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD R2h ago
-
Data Governance | Data Modeling | Data Quality | Data schemas | Docker401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeSan Antonio, TX R2h ago
-
Data Visualization | DevOps | JQuery | JSON | JavaScriptFull Scope Polygraph | TS/SCI clearanceMid-level Full TimeLaurel, MD2h ago
-
Data Analysis | Data Science | Exploratory Data Analysis | Java | Machine Learning401k contribution | Annual bonuses | Company paid Vision insurance | Company paid dental insurance | Company-paid disability insuranceMid-level Full TimeLaurel, MD2h ago
-
Senior Robotics Software Engineer (Full Stack) USD 100K-150KAlgorithm Design | C++ | IMU | Lidar | LinuxOnsite collaborationSenior-level ContractWilmington, MA; Wilmington, MA; Wilmington, MA3h ago