Software Engineer, Cloud Infrastructure (Multiple Seniority Levels)
Tasks
- Add guardrails rate limits and provider routing
- Build LLM application services with streaming and batching
- Build ingestion and processing pipelines with Glue and Lake Formation
- Build knowledge bases and data syncs
- Build token usage and cost dashboards with alerts
- Create RAG chunking and embedding pipelines
- Create offline and online eval harnesses
- Deploy and operate model endpoints
- Design provision and maintain AWS infrastructure
- Implement CI CD and testing for apps infra and ML pipelines
- Implement PII detection redaction and content filters
- Implement prompt and tool execution flows
- Instrument telemetry with CloudWatch and OpenTelemetry
- Integrate retrieval services embeddings and LLM chains into features
- Manage IoT deployment edge messaging and OTA updates
- Operate secure networking and manage IAM KMS and secrets
- Operate vector search and tune recall latency and cost
- Optimize data movement and storage in S3 and Glacier
- Orchestrate data pipelines with Step Functions or Airflow
- Troubleshoot cloud and ML services for uptime and performance
- Tune retrieval context window caching and autoscaling
Perks/Benefits
Skills/Tech-stack
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS IAM | AWS KMS | AWS Lambda | AWS Secrets | AWS Secrets Manager | Airflow | Athena | Aurora PostgreSQL | Bedrock Knowledge Bases | CI/CD | CloudWatch | ECS | EKS | EventBridge | GitHub Actions | Glacier | Glue | Knowledge bases | Lake Formation | Langchain | N A | OpenAI N/A | OpenSearch Serverless | OpenTelemetry | PGVector | Pinecone | PrivateLink | Redis | S3 | SQS | SageMaker | Secrets Manager | Step Functions | Terraform | VPC | VPC Endpoints
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R22d ago
-
AI & Machine Learning Vice President USD 120K-220KAWS | Alteryx | Anomaly Detection | Azure | C#401k | Dental insurance | Disability insurance | Health insurance | Hybrid work modelExecutive-level Full TimeUnited States R12h ago
-
Director, Data Analyst/BI Engineer USD 138K-175KAWS | Access Control | Aggregated Event Measurement | Airflow | BigQuery401k match | Healthcare Dental Vision | PTO | Paid Holidays | Parental leaveExecutive-level Full TimeUnited States R14h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Cloud Computing | Data Association401k match | Dental insurance | Emotional & mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeSeattle, Washington, United States R14h ago
-
Senior Data Engineer II, AI Native USD 148K-216KAmazon Web Services | Apache Airflow | Apache Spark | Azure | BigQuery401k matching | Dental insurance | Disability insurance | Employee assistance program | Equipment reimbursementSenior-level Full TimeRemote, USA R14h ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R15h ago
-
Senior Data Engineer USD 115K-175KAWS Fargate | AWS Glue | AWS IAM | AWS Lambda | AWS MWAACharitable giving program | Company-Paid Holidays | Dental insurance | Flexible PTO | Life insuranceSenior-level Full TimeMassachusetts - Boston R16h ago
-
Senior Analytics Engineer USD 148K-218KAutomation | BI tools | CCPA | CI/CD | DBTDental insurance | Equity | Medical insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, USA ; Remote, Canada R17h ago
-
A/B | A/B Testing | API Development | AWS Bedrock | Access Control401k plan | Healthcare premium coverage | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R17h ago
-
AI Engineer II USD 125K-145KAPI Gateway | AWS | AWS Bedrock | AWS Lambda | Amazon APICareer advancement | Employee recognition | LinkedIn Learning Platform | Open PTO | Paid HolidaysMid-level Full TimeRemote US R17h ago
-
Principal AI Engineer (Remote) USD 128K-200KAPI Gateways | Agent Orchestration | Artificial Intelligence | BigQuery | By DesignAfter hours incident support | Occasional overtime | Occasional travel | Remote workSenior-level Full TimeOak Brook, IL, United States R18h ago
-
Cleared Hybrid Data Engineer (5418) USD 103K-171KAPI strategy | AWS | AWS Glue | AWS Redshift | Access ControlHealth insurance | Paid leave | RetirementSenior-level Full TimeHanover, MD R20h ago
-
APIs | AWS | Agentic AI | Azure | Claude401k | Dental insurance | Fully remote US based | Generous PTO | HolidaysSenior-level Full TimeRemote USA, United States R20h ago
-
Principal Data Engineer USD 190K-210KAmazon Kinesis | Containerization | Helm | Infrastructure as Code | JuliaEquity | In person office hubs | PTO | Remote workSenior-level Full TimeBoston, MA / Remote R21h ago
-
Principal Software Engineer, Data USD 190K-210KAmazon Kinesis | Containerization | Data Engineering | Event Processing | HelmEquity | PTO | Remote workSenior-level Full TimeBoston, MA / Remote R21h ago
-
AWS | Agile | Apache Hive | Apache Spark | Cloudera Data PlatformRemote workSenior-level ContractLincoln, United States R21h ago
-
Middle Data Engineer (Azure Databricks) USD 160K-223KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Mentorship | Professional development opportunities | Relocation programMid-level Full TimeMadrid, MD, Spain R22h ago
-
Senior Data Engineer, Platform USD 116K-146KAWS | AWS DMS | Airflow | CI/CD | CloudFormationBonus | Equity | Health benefitsSenior-level Full TimeRemote - US, United States R1d ago
-
Architect MLE USD 160K-201KAKS | AWS | Arize AI | Asynchronous programming | AzureCareer development | Flexible work environment | Learning and growthSenior-level Full TimeUSA - Remote, United States R1d ago
-
Software Engineer, AI/ML USD 102K-160KAWS | AWS Bedrock | Azure | Azure OpenAI | C#401k matching | Disability insurance | Employee ownership | Growth opportunities | Health insuranceSenior-level Full TimeUSA-GA-Office-Atlanta, United States R1d ago
-
Senior MLOps & Generative AI Engineer - Remote USD 91K-152KAI Evaluation | APIs | AWS | Alerting | AzureAdoption reimbursement | Emergency backup care | Family caregiver leave | Fertility reimbursement | Medical, dental, vision plansSenior-level Full TimeCorp Facilities MPB - 350 Centre … R1d ago
-
Snowflake Data Engineer USD 80K-115KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage401k retirement plan | Dental insurance | Employee stock purchase plan | Learning opportunities | Long-term disabilityMid-level Full TimeRemote - USA, United States R1d ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R1d ago
-
Senior Analytics Engineer USD 157K-185KAirflow | Anonymization | BigQuery | Compliance | DBT401k match | Cellphone stipend | Commuter benefits | Company-Paid Holidays | Family planning benefitsSenior-level Full TimeRemote U.S. R1d ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agile | Algorithms | C++ | CI/CDHybrid remote workSenior-level Full TimeWoburn, MA R1d ago