Senior Software Engineer 3 - (Inference, AI Infrastructure, Python)
Tasks
- Configure inference models
- Deploy inference models
- Develop in house inference services
- Establish infrastructure for LLM powered tools
- Evaluate inference models
- Integrate LLM tools with user needs
- Maintain inference service quality
- Mentor engineers and develop best practices
- Support surge inference needs
- Translate stakeholder goals into engineering outcomes
Perks/Benefits
Skills/Tech-stack
AWS | Argo CD | CI/CD | Docker | Elastic | Grafana | Helm | Helm Charts | Inference Serving | Kubernetes | LLM Hosting | Litellm | Observability | Prometheus | Python | Quality of Service | Reliability Engineering | Site Reliability | Site Reliability Engineering | Traffic shaping | VLLM
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
ActiveMQ | Agile | Amazon Web Services | Apache Beam | Apache CassandraMid-level Full TimeSan Mateo, CA; Irving, TX; Sunnyvale, …1h ago
-
AI/ML Engineer II USD 125K-180KData Engineering | Data Governance | Data Modeling | Data Pipelines | Data StructuresMid-level Full TimeAnnapolis Junction, MD; Annapolis Junction, MD; …1h ago
-
A/B | A/B Testing | AWS Bedrock | Adversarial Machine Learning | Artificial IntelligenceFull relocation | Industry-best benefits | StockSenior-level Full TimeSarasota, Florida2h ago
-
Java | MySQL | Oracle | Python | Relational databasesEntry-level Full TimeJohnson City, Tennessee; Offutt Air Force …2h ago
-
C# | Data Governance | Data Modeling | Data Structures | Data pipeline401k | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland3h ago
-
Software Engineer 1 - (AI/ML, Terraform, AWS) USD 164K-201KAI machine learning | Amazon Web Services | C++ | Data analytics | Databases401k match | Educational assistance | Healthcare coverage | PTOSenior-level Full TimeAnnapolis Junction, Maryland3h ago
-
Software Engineer 1 - (Python, JavaScript, AI/ML) USD 163K-199KArtificial Intelligence | CI/CD | Confluence | Docker | Git401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeFort Meade, Maryland3h ago
-
Software Engineer 3 - (Python, LLM, AI) USD 232K-283KAI orchestration | API Integration | Confluence | Data Manipulation | Data Parsing401k employer match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland3h ago
-
AWS | Artificial Intelligence | Confluence | Data Analysis | Eclipse401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …3h ago
-
Software Engineer 2 - (Python, PySpark, AWS) USD 208K-254KAWS Glue | AWS Lambda | Algorithms | Amazon DynamoDB | Amazon Web Services401k match | Educational assistance | Federal Holidays | Health insurance | PTOSenior-level Full TimeAnnapolis Junction, Maryland3h ago
-
Senior Applied AI Engineer 3 - (Python, LLMs, RAG) USD 232K-283KAI Agents | Backend Development | Distributed Systems | Docker | Elasticsearch401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland3h ago
-
Software Engineer 1 - (AI, Python, LLM) USD 163K-199KAWS | ArgoCD | CI/CD | Docker | Helm401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland3h ago
-
AWS | Argo CD | CI/CD | Docker | Elastic401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …3h ago
-
Anomaly Detection | Clustering | Data Analysis | Data Science | Elasticsearch401k matching | Direct employer 401k contribution | Educational assistance | Federal Holidays | Healthcare coverageSenior-level Full TimeFort Meade, Maryland3h ago
-
Senior Data Engineer (Remote) USD 108K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data VisualizationRemote workSenior-level Full TimeUnited States R3h ago
-
Amazon EKS | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon Web ServicesComprehensive insurance | Diversity and inclusion | Flexible work arrangements | Hybrid remote workMid-level Full TimeReston, VA R3h ago
-
Amazon Redshift | Amazon Web Services | Apache Airflow | CI/CD | CTEComprehensive insurance | Diversity and inclusion | Flexible work arrangementsMid-level Full TimeReston, VA; Reston, VA R3h ago
-
Big Data | Cloud Architecture | Containerization | Data Engineering | Data Transformation10 percent 401k match | 401k match | Comprehensive healthcare | Generous PTOMid-level Full TimeMcLean, VA3h ago
-
Apache Flink | Apache NiFi | Apache Spark | Apache Storm | Bash401k company contribution | Telework up to 16 hours weeklyMid-level Full TimeAnnapolis Junction, MD; Annapolis Junction, MD; …3h ago
-
AWS | Agentic AI | Deep learning | Docker | Generative AI401k contributions | Health insurance | Paid time off | Remote workSenior-level Full TimeAurora, CO3h ago
-
AWS | AWS S3 | Amazon SQS | Apache Airflow | Apache Kafka401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD R3h ago
-
Algorithm tuning | Confusion matrix | Data Mining | Data Visualization | Feature Engineering401k contribution | Flexible schedule | Health insurance | Paid time offSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Agile | Amazon S3 | Amazon SQS | Apache NiFi | Bash401k match | Fully paid medical | PTO | Training supportSenior-level Full TimeSan Antonio, TX R3h ago
-
Agile | Amazon S3 | Amazon SQS | Apache NiFi | Bash401k match | Fully paid medical | Hybrid work | Onsite clearance support | Paid time offSenior-level Full TimeColumbia, MD R3h ago