Software Engineer, Cloud Infrastructure (Multiple Seniority Levels)
Tasks
- Add PII detection redaction access controls and content filtering
- Build CI CD and testing for apps infra and ML pipelines
- Build LLM application services with streaming batching and backoff
- Build cost dashboards with budgets and alerts
- Build ingestion and processing pipelines with Glue and Lake Formation
- Build knowledge bases and data sync from storage services
- Create offline and online eval harnesses for prompts and retrievers
- Design embedding pipelines for documents and multimedia
- Design provision and maintain AWS infrastructure using IaC
- Enforce safety standards with Bedrock Guardrails or policy services
- Evaluate when to use ECS EKS Lambda or Batch for inference
- Implement guardrails rate limits and provider routing
- Implement prompt tool execution and function calling workflows
- Instrument telemetry with CloudWatch and OpenTelemetry
- Manage IAM KMS secrets management and audit logging
- Manage IoT deployment edge messaging and identity
- Operate secure networking with VPC and PrivateLink
- Operate vector search and tune recall latency and cost
- Optimize inference with model selection quantization and autoscaling
- Optimize storage and data movement in S3 and Glacier
- Orchestrate RAG pipelines with Step Functions or Airflow
- Partner to integrate retrieval services and LLM chains into features
- Provide cloud and ML troubleshooting for uptime and performance
- Stand up and operate model endpoints on AWS
- Support secure messaging and over the air updates for edge devices
- Tune retrieval quality context window and caching
- Use Athena for ad hoc analysis
Perks/Benefits
Skills/Tech-stack
AWS | AWS Batch | AWS CDK | Airflow | Amazon Bedrock | Amazon SageMaker | Athena | Aurora | Aurora PostgreSQL | Autoscaling | Batching | CI/CD | CloudWatch | CodeBuild | CodePipeline | DynamoDB | ECS | EKS | Embeddings | Event Driven | Event-driven architecture | EventBridge | Function Calling | GitHub Actions | Glue | Guardrails | IAM | Inference Server | KMS | Lake Formation | Lambda | Langchain | Mqtt | OTAA | OpenAI Function Calling | OpenSearch | OpenSearch Serverless | OpenTelemetry | PGVector | PII Detection | PII Redaction | Pinecone | PrivateLink | Prompt engineering | Quantization | RAG | Rate Limiting | Redis | Retrieval-Augmented Generation | S3 | SQS | Secrets Manager | Step Functions | Streaming | TensorRT-LLM | Terraform | Triton Inference | Triton Inference Server | VPC | VPC Endpoints | Vector Search
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R1d ago
-
Senior Data Engineer USD 195K-352KAWS | Apache Airflow | Apache Spark | Batch Processing | Cloud platformCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeAustin, Texas R1d ago
-
Senior Staff Data Platform Engineer - Data Access Team USD 201K-352KAlgorithms | CI/CD | Data Structures | Design Patterns | Distributed Systems401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, CALIFORNIA, United States R1d ago
-
Deployed Engineer, Professional Services USD 150K-215KAgent systems | Deterministic systems | Evaluation | Fine Tuning | JavaScript401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceMid-level Full TimeAtlanta, GA R1d ago
-
Deployed Engineer, Professional Services (NYC) USD 150K-215KAgent systems | Axolotl | DPO | Evaluation methodology | Fine Tuning401k plan | Flexible vacation | Meals on in office days | Medical, dental & vision coverageMid-level Full TimeNew York, NY R1d ago
-
Data Engineer – Databricks USD 152K-200KAWS | Apache Airflow | Azure | Azure Data | Azure Data FactoryContract-to-hire | Hybrid work onsite 3 days per weekSenior-level Contract Full TimeBeaverton, OR, United States R1d ago
-
Principal AI Engineer USD 180K-200KAPI Development | AgentCore) | Agentic AI | AutoGPT | CI/CD401k employer match | Career advancement | Employee assistance program | Employee recognition | FSASenior-level Full TimeRemote US R1d ago
-
Senior AI Engineer USD 180K-240KCause analysis | Context Management | Evaluation Frameworks | Experiment design | Golden datasetsCompetitive compensation | Equity compensation | Remote-first environmentSenior-level Full TimeRemote, Americas R1d ago
-
Senior Data Engineer USD 190K-240KAWS Bedrock | AWS Lambda | AWS S3 | AWS Secrets | AWS Secrets ManagerEquity upside | Optional retreats | Remote work | Work from anywhereSenior-level Full TimeRemote R1d ago
-
Senior Data Infrastructure Engineer USD 202K-237KAWS Glue | Amazon Redshift | Apache Airflow | Apache Spark | CDCCareer development opportunities | Dental insurance | Flexible vacation policy | Health insurance | Hybrid workSenior-level Full TimeUS, Remote R1d ago
-
Lead AI Engineer USD 120K-175KAWS | Agentic AI | Artificial Intelligence | Benchmarking | Data Preparation401k match | Background check required | Certification reimbursement | Health insurance | Maternity & paternity leaveSenior-level Full TimeSchenectady, New York, United States, Remote R1d ago
-
Senior Software Engineer - Applied AI USD 160K-160KAsynchronous processing | CI/CD | Context Management | Django | FastAPIHealth insurance | Paid parental leave | Paid time off | Remote-first work environmentSenior-level Full TimeAustin, TX R1d ago
-
Lead Data Engineer USD 174K-230KAirflow | BigQuery | DBT | Dagster | Data Modeling401k | Education/training stipend | Free OneMedical membership | HSA/FSA | Internet stipendSenior-level Full TimeRemote R1d ago
-
Senior Software Engineer - Machine Learning Platform USD 166K-230KAPIs | AWS | Automation | Backtesting | DBT401k matching | Annual productivity allowance | Employee assistance program | Employee stock purchase plan | Health, dental, and vision insuranceSenior-level Full TimeUnited States | Remote R1d ago
-
Forward Deployed Engineer (FDE), Legal-SF USD 162K-280KBackend Development | Frontend Development | Full Stack | Full-Stack Development | Generative AIHybrid work model | Relocation assistance | Travel Opportunities up to 50 PercentMid-level Full TimeNew York City R1d ago
-
Senior Machine Learning Engineer, Agent Eval Platform USD 176K-308KData labeling | Distillation | Evaluation | Fine Tuning | Information RetrievalInclusive work environment | Remote work flexibilitySenior-level Full TimeSanta Clara, CALIFORNIA, United States R1d ago
-
Data Scientist - Foward Deployed Engineer USD 160K-170KAPIs | Agentic Workflows | Anomaly Detection | Context engineering | Experimentation401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractPalo Alto, California, USA R1d ago
-
AI/ML Engineer USD 220K-260KAUC | AWS | CI/CD | Cross-validation | Databricks401k matching | Commuter benefits | Dental insurance | Health insurance | Paid lunch and dinnerSenior-level Full TimeNew York R1d ago
-
Data Engineer II USD 78K-117KCI/CD | Cortex AI | Data Lake | Data Warehouse | ETL401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level Full TimeBaltimore, Maryland, USA R1d ago
-
Fullstack AI Engineer USD 117K-147KAWS | Anthropic | CI/CD | Go | JavaScriptDental insurance | Flexible time off | Medical insurance | Paid parental leave | SabbaticalMid-level Full TimeUnited States (Remote-First) R1d ago
-
Staff Data Engineer USD 134K-175KAWS EMR | AWS Glue | AWS S3 | Agile | Apache Airflow401k matching | Dental insurance | Disability insurance | Employee assistance program | Employee referral programSenior-level Full TimeDenver, CO, USA R1d ago
-
Product Engineer, AI Email App USD 150K-215KA/B | A/B Testing | B testing | Cost Optimization | ExperimentationMid-level Full TimeUnited States R1d ago
-
BeeGFS | CI/CD | CUDA | Caching | CephSenior-level Full TimeSan Jose, CA / Austin, TX-%LABEL … R2d ago
-
Data Engineer II USD 150K-225KAmazon EKS | Amazon MSK | Amazon Web Services | Apache Flink | Apache Kafka401k match | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, Aliso Viejo, CA R2d ago
-
Senior Data Engineer USD 135K-145KAWS | Agile | Airflow | Constraints | Data ModelingFull-time position | Remote work | Use AI toolsSenior-level Full TimeRemote, United States R2d ago