Software Engineer, Cloud Infrastructure (Multiple Seniority Levels)
Tasks
- Build CI CD for apps and ML pipelines
- Build LLM API services with streaming and backoff
- Build ingestion pipelines for structured and unstructured data
- Build knowledge bases and data syncs
- Build token usage and cost dashboards with alerts
- Create RAG pipelines with chunking and embeddings
- Create offline and online eval harnesses
- Design AWS infrastructure using IaC
- Enforce safety guardrails and access controls
- Evaluate LLM deployment options
- Implement PII detection and redaction
- Implement prompt and tool execution flows
- Implement secure networking with VPC and IAM
- Instrument telemetry with CloudWatch and OpenTelemetry
- Integrate retrieval services into user features
- Manage IoT edge device deployment and updates
- Manage data cataloging with Glue and Lake Formation
- Operate LLM model endpoints
- Operate vector search and tune retrieval
- Optimize storage and data movement in S3
- Orchestrate workflows with Step Functions or Airflow
- Provide troubleshooting for uptime and performance
- Provision and maintain AWS services
- Tune retrieval quality and caching with Redis
Perks/Benefits
Skills/Tech-stack
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CloudWatch | AWS CodeBuild | AWS CodePipeline | AWS EventBridge | AWS Glue | AWS IAM | AWS KMS | AWS Lake Formation | AWS Lambda | AWS S3 | AWS Secrets | AWS Secrets Manager | Amazon Athena | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon ECS | Amazon EKS | Amazon SQS | Amazon SageMaker | Amazon VPC | Apache Airflow | Aurora PostgreSQL | Autoscaling | Bedrock Guardrails | CI/CD | Docker | Event Driven | Event-driven architecture | GitHub Actions | GitOps | Human-in-the-loop | Kubernetes | Lake Formation | Langchain | Model Serving | OpenSearch | OpenSearch Serverless | OpenTelemetry | PGVector | PII Redaction | Pinecone | Quantization | RAG | Rate Limiting | Redis | Retrieval-Augmented Generation | Secrets Manager | Step Functions | Terraform | The Loop | Vector Databases
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R10d ago
-
Senior-level Full TimeMansfield, MA (Remote) R12h ago
-
Staff Software Engineer, Applied AI USD 200K-240KDataset curation | Evaluation | FastAPI | LLM | Langchain401k | Co-working space reimbursement | Equity incentive | Flexible vacation policy | HSA contributionSenior-level Full TimeU.S. (Remote) R13h ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | On call production supportMid-level Full TimeOrlando, FL, United States R17h ago
-
Cleared Hybrid Data Engineer (5418) USD 103K-171KAPI Integration | AWS | AWS Glue | AWS Redshift | Access ControlHealth insurance | Learning and development opportunities | Paid leave | RetirementSenior-level Full TimeHanover, MD R17h ago
-
Senior DataOps Engineer USD 130K-258KAgent Jobs | App Service | App Service Environments | App Services | Azure AutomationSenior-level Full TimeRemote R19h ago
-
Apache Airflow | BigQuery | Cloud Dataflow | Cloud platform | DBTAnnual company off site events | Annual professional development budget | Co-working space allowance | Comprehensive health insurance | Equity via ESOPSenior-level Full TimeCanada R19h ago
-
Senior-level Full TimeChicago, Illinois, USA R21h ago
-
Staff Designated Support Engineer USD 122K-160KAWS | AWS Glue | As-a-Service | Azure | Azure DataOn-call support availabilitySenior-level Full TimeUS-TX-Remote R21h ago
-
AI Solutions Engineer - Professional Services USD 107K-144KAPI Integration | Anthropic Claude | Benefit Analysis | Change Management | Code MigrationRemote work | Work from anywhereMid-level Full TimeUnited States R22h ago
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R22h ago
-
Senior Software Engineer- Big Data & Java USD 133K-160KADLS | AWS | Amazon S3 | Apache Beam | Apache FlinkAllyship and inclusion communities | Caregiver leave | Continuous development support program | Employee assistance program | Employee recognitionSenior-level Full TimeRemote, USA R1d ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch pipelines | ChunkingHybrid work schedule | Learning and development opportunities | MentorshipSenior-level Full TimeHartford CT- Home Office, United States R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
AI Engineer - Application Development USD 75K-158KAPI Integration | AWS | Agno | Amazon Bedrock | AzureFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R1d ago
-
Embedded AI Engineer USD 100K-150KC++ | Core ML | Edge AI | Edge inference | Energy EfficiencyCareer growthSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | Energy Efficiency | Federated Learning | Hybrid Cloud100 percent remote | Diversity and inclusion | Long-term career growthSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Computer Vision | Data Quality | Data labeling100 percent remote work | Benefits packageMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Baseline Models | Computer Vision | Data QualityFull-time benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Lead Full Stack Engineer, AI Solutions USD 129K-177KAgentic AI | Angular | Artificial Intelligence | Automated testing | Azure401k retirement savings | Hybrid work option | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeWork at Home - Kentucky, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergCareer growth opportunities | Health benefits | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago