Software Engineer, Cloud Infrastructure (Multiple Seniority Levels)
Tasks
- Build CI CD and testing for apps infra and ML pipelines
- Build application services for LLM API access with streaming and batching
- Build data ingestion and processing pipelines with data lineage and cataloging
- Build knowledge bases and data syncs
- Create offline and online evaluation harnesses for LLMs
- Design RAG chunking and embedding pipelines
- Design provision and maintain AWS infrastructure
- Implement PII detection and redaction and access controls
- Implement guardrails rate limits and provider routing
- Implement prompt and tool execution flows with LangChain
- Instrument telemetry with CloudWatch and OpenTelemetry
- Integrate retrieval services embeddings and LLM chains into products
- Manage IoT deployment and secure messaging and OTA updates
- Operate secure networking and IAM with audit logging
- Operate vector search and tune retrieval latency and cost
- Optimize inference with model selection autoscaling and quantization
- Optimize storage and data movement in S3 and Glacier
- Orchestrate RAG pipelines with Step Functions or Airflow
- Provide troubleshooting for cloud and ML services
- Stand up and operate model endpoints for inference
- Tune retrieval quality caching and context window usage
Perks/Benefits
Skills/Tech-stack
AWS | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS Glue | AWS KMS | AWS Secrets | AWS Secrets Manager | Amazon Athena | Amazon Bedrock | Amazon SageMaker | Aurora PostgreSQL | CI/CD | CloudWatch | Docker | ECS | EKS | Event Driven | Event-driven architecture | EventBridge | GitHub Actions | IAM | Kubernetes | Lake Formation | Lambda | Langchain | OpenAI | OpenAI API | OpenSearch | OpenTelemetry | PGVector | Pinecone | PrivateLink | PyTorch | Python | RAG | Redis | S3 | SQS | Secrets Manager | Step Functions | Streaming | Terraform | VPC | VPC Endpoints | Vector Databases | Vector Search
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior AI Software Engineer, Python USD 135K-175KAsync Programming | Azure | Distributed Systems | Error Tracking | Event DrivenFlexible paid time off | Manager check ins via Lattice | Medical dental and vision insurance 100 percent employer paid | Paid cell phone and service | Paid parental leaveSenior-level Full TimeRemote - United States R7h ago
-
Senior Business Intelligence and Analytics Engineer USD 100K-155KAirflow | BigQuery | Command Line | DBT | Data Catalog401k matching | Company offsite | Dental insurance | Employee wellness | Free therapySenior-level Full TimeUS - Remote R13h ago
-
Machine Learning Engineer USD 150K-180KBatching | Deep learning | Embeddings | GPU | Inference Optimization401k matching | Company sponsored offsite | Employee wellness | Free therapy | Hardware or software stipendMid-level Full TimeUS - Remote R13h ago
-
Sr Data Platform Engineer - MongoDB USD 114K-152KAWS | Aggregation Pipeline | Ansible | Backup and Recovery | Bash401k matching | Accident and life insurance | Dental insurance | Education reimbursement | Health insuranceSenior-level Full TimeOffice Location or Remote - USA R13h ago
-
Associate Data Scientist - Originations USD 85K-115KData pipeline | Machine Learning | PyTorch | Python | SQL401k match | Company equipment provided | Company in person events | Company-paid medical, dental & vision | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R13h ago
-
Senior Software Engineer, Data Engineering USD 220K-240KAWS Athena | AWS EC2 | AWS EMR | AWS Glue | AWS Lambda401k match | Backup child elder and pet care support | Chime Days paid days off | Community organization time support | Family planning tool benefitsSenior-level Full TimeSan Francisco, CA, USA R14h ago
-
AI Engineer USD 120K-158KAI Foundry | AIOps | Automated testing | Azure AI | Azure AI Foundry401k match | Dental insurance | Medical insurance | Paid Holidays | Paid time offMid-level Full TimeLos Angeles, CA, USA; Remote, CA, … R14h ago
-
Data Engineer USD 100K-120KAPI | Data Quality | Data Reconciliation | Data Validation | Data Warehousing401k match | Adoption support | Company holidays | Fertility support | Flexible PTOMid-level Full TimeRemote - US R15h ago
-
Senior AI/ML Engineer USD 125K-157KAWS | Access Controls | Agent Orchestration | Audit trails | CI/CD401k | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R15h ago
-
Calibration | Causal Inference | Distributed machine learning | Experimentation | JavaCommuter benefits | Dental insurance | Disability insurance | Fully stocked pantry | Healthcare insuranceSenior-level Full TimeRedwood City, US; Remote R15h ago
-
Senior Embedded Software Engineer - Future Forward USD 153K-218KAuthentication | Board Bring-up | Bring-up | C# | C++Senior-level Full TimeSunnyvale, CA, United States R16h ago
-
Senior Platform Analytics Engineer USD 196K-269KAWS | Apache Airflow | Apache Spark | Big Data | DBTHybrid workSenior-level Full TimeSan Francisco, CA R17h ago
-
Bioinformatics Production Analyst/Production Engineer USD 102K-128KData Visualization | Genomics | HIPAA | Health information | Linux401k benefits | Commuter benefits | Disability insurance | Employee referral program | Fertility care benefitsEntry-level Full TimeUS Remote R17h ago
-
Enterprise Sales Engineer - Rockies USD 118K-157KC# | Go | Java | Node.js | PHPCareer pathing | Hybrid work | Inclusion programs | Mentor/Buddy program | OnboardingSenior-level Full TimeColorado, USA, Remote R18h ago
-
Full Stack Engineer, Machine Learning Tooling USD 145K-165KAPI Design | Angular | Docker | Helm | JavaScriptCaregiver support | ERGs | Equity Tax Advice | Family leave | Fertility benefitsMid-level Full TimeRemote - USA R18h ago
-
Senior Data Engineer USD 117K-162KAWS | Azure | BigQuery | DBT | Data Architecture401k | Disability insurance | Family Assistance Benefit | Flexible spending account | Flexible time offSenior-level Full TimeRemote - US R18h ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | API Integration | Automation | Backend Services | Customer OnboardingDirect impact on company growth | Equity | Fast-moving startup environment | Hybrid work environment | Significant ownershipMid-level Full TimeKing of Prussia, PA, United States R19h ago
-
Senior Software Engineer, Data Infrastructure USD 243K-295KAWS | Apache Airflow | Apache Druid | Apache Flink | Apache KafkaSenior-level Full TimeSan Mateo, CA, United States R19h ago
-
Staff Enterprise AI Engineer USD 181K-235KAPI Integration | AWS | Agent Orchestration | Artificial Intelligence | Cloud Security401k employer matching | Disability insurance | Health insurance | Learning and development | Life insuranceSenior-level Full TimeSan Francisco, California, United States R19h ago
-
Senior Data Engineer USD 118K-178KAPI Gateway | AWS | AWS CloudWatch | AWS Lambda | AWS S3Comprehensive health benefits | Flexible remote work | Parental leave | Professional development stipendSenior-level Full TimeRemote - US R20h ago
-
Platform Database Engineer (MONGO DB) USD 101K-198KAWS | Amazon CloudWatch | Amazon EC2 | Amazon EKS | BashOn-call rotation | Remote work | Travel Less Than 10 PercentMid-level Full TimeUnited States - Remote R20h ago
-
AI Engineer USD 226K-306KAI Agents | Context engineering | Cost Optimization | Distributed tracing | Error HandlingAdditional company holidays | Enhanced parental leave | Generous vacation policy | Medical/Dental/Vision insurance | Mental wellness benefitSenior-level Full TimeSan Francisco, US (Hybrid) R21h ago
-
Staff Data Engineer USD 130K-150KAWS | Apache Spark | Batch Processing | Data Architecture | Data Lake401k match | Bereavement leave | Cell phone reimbursement | Company equipment reimbursement | Dental insuranceSenior-level Full TimeUnited States - Remote Flexibility R22h ago
-
Senior Data Engineer USD 145K-160KAWS Glue | AWS Glue Data Catalog | AWS Lake Formation | Agile | Amazon Athena401k match | Day-one medical/dental/vision | Discretionary time off | Employee assistance programs | Employer-paid life insuranceSenior-level Full TimeRemote - United States R22h ago
-
Data Engineer USD 125K-140KAWS Glue | AWS Lake Formation | AWS RDS | AWS S3 | Athena401k match | Discretionary time off | Employee assistance program | Employer-paid life insurance | Fitness creditMid-level Full TimeRemote - United States R22h ago