Software Engineer, Cloud Infrastructure (Multiple Seniority Levels)
Tasks
- Build LLM application services with streaming and batching
- Build RAG chunking and embedding pipelines
- Build and maintain CI/CD pipelines
- Build data ingestion and processing pipelines
- Create eval harnesses for prompts and retrievers
- Deploy and operate model endpoints
- Design provision and maintain AWS infrastructure
- Implement guardrails rate limits and fallbacks
- Implement prompt and tool execution flows
- Instrument telemetry and build cost dashboards
- Integrate retrieval embeddings and LLM chains into features
- Manage IoT deployment and edge updates
- Operate secure networking and IAM
- Operate vector search and knowledge bases
- Optimize retrieval context caching and inference performance
Perks/Benefits
Skills/Tech-stack
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS Glue | AWS IAM | AWS KMS | AWS Lake Formation | AWS Lambda | AWS Secrets | AWS Secrets Manager | Access Control | Amazon Athena | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon CloudWatch | Amazon EventBridge | Amazon Glacier | Amazon S3 | Amazon SQS | Amazon SageMaker | Apache Airflow | Aurora PostgreSQL | CI/CD | Docker | ECS | EKS | Event Driven | Event-driven architecture | GitHub Actions | Human-in-the-loop | Infrastructure as Code | Lake Formation | Langchain | OpenSearch | OpenSearch Serverless | OpenTelemetry | PGVector | PII Detection | Pinecone | PostgreSQL | PrivateLink | Redis | Secrets Manager | Step Functions | Terraform | The Loop | VPC | VPC Endpoints | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Cities
Related jobs
-
Senior Software Engineer, Storage USD 166K-210KAmazon CloudWatch | Amazon EC2 | Backups | Cause analysis | Cloud-basedAnnual equity refresh grants | Equity grants | Remote workSenior-level Full TimeUnited States - Remote R16h ago
-
Senior Software Engineer II, Storage USD 192K-242KAmazon CloudWatch | Amazon EC2 | Amazon RDS | Backups | Cloud platformAnnual refresh grants | Equity grant | Remote workSenior-level Full TimeUnited States - Remote R16h ago
-
Senior Software Engineer, Data Governance & Foundations USD 166K-210KApache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache KafkaAnnual refresh grants | Equity grant | Remote work flexibilitySenior-level Full TimeUnited States - Remote R17h ago
-
Associate Software Engineer, Embedded Development USD 100K-150KAOSP | Android | Bash | Black box testing | Black-box401k match | Dental insurance | Free snacks | Health insurance | Life insuranceMid-level Full TimeRaleigh, NC R17h ago
-
Sr. Machine Learning Engineer USD 175K-230KAWS | C plus plus | Deep learning | Kubernetes | Language Models401k plan | Cell phone internet reimbursement | Company-Paid Holidays | Flexible paid time off | Health Savings Account employer contributionSenior-level Full TimeRemote - United States R18h ago
-
Lead Data Scientist USD 210K-240KAPIs | Apache Airflow | Apache Beam | Cloud Dataflow | Cloud Dataproc401k | Dental insurance | Employee assistance program | Health insurance | Life insuranceSenior-level Full TimeRemote - USA R23h ago
-
Sr. Solutions Engineer - AI Natives Business USD 152K-209KAWS | Apache Spark | Azure | Data Engineering | Data ScienceAnnual performance bonus | Equity | Remote work | Travel requiredSenior-level Full TimeRemote - California; Remote - Colorado; … R1d ago
-
Data Engineer Lead | $140k-$175k + Hybrid + Equity | Exciting High Growth AI Operational Intelligence Startup A USD 140K-175KApache Airflow | Apache Kafka | DBT | Dagster | Data LineageEquity | Health insurance | Hybrid work | Medical insurance | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
Senior AI Engineer USD 160K-200KAPI Gateway | AWS ECS | AWS Fargate | AWS IAM | Amazon APIHealth care benefitsSenior-level Full TimeUnited States R1d ago
-
Agent Frameworks | Deep learning | Distributed Systems | Fine Tuning | LLM InferenceEquity package | High-impact work | Hybrid schedule | Remote work optionSenior-level Full TimeRemote; New York, New York; Onsite R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Governance | Data LineageCareer growth | H1B transfer support | Remote work | W2 employmentMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | CompressionRemote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Ingestion | Data LineageBenefits package | Career growth potential | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | Code reviewBenefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Automation | CRUSH maps | CSI | Capacity PlanningSenior-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backup | CRUSH maps | CSI | Capacity PlanningBenefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backup | CRUSH | CSI | Capacity PlanningSenior-level Full TimeUnited States - Remote R1d ago
-
Solutions Engineer (AI Services) USD 97K-145KAI Safety | AI alignment | Adversarial Testing | Benchmarking | Bias detection401k match | Dental insurance | Medical insurance | Paid time off | Performance bonusMid-level Full TimeUSA - Remote - US - … R1d ago
-
Data Science Engineer USD 121K-154KArtificial Intelligence | Data Visualization | Entity Resolution | Fine Tuning | Generative AI401k | Education reimbursement program | Flexible schedule | Hybrid work | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R1d ago
-
Senior Software Engineer, Data Platform USD 150K-200KAccess Control | Apache Airflow | Apache Spark | Auditability | Change Data CaptureBenefits package | Equity | Flexible remote working hours | Fully remoteSenior-level Full TimeUS - Remote, Canada - Remote R1d ago
-
Sr. Machine Learning Solutions Architect USD 156K-216KAWS | Amazon EMR | Amazon Redshift | Apache Spark | AzureAutonomy to Deliver Results | Continuous improvement culture | Professional mentorship | Remote-first cultureSenior-level Full TimeUS-Remote R1d ago
-
Senior AI Engineer, Forward Deployed USD 191K-253KAPI | AWS | Amazon S3 | Asynchronous programming | BAAOccasional on site customer engagement | Remote work flexibilitySenior-level Full TimeUnited States R1d ago