Software Engineer, Cloud Infrastructure (Multiple Seniority Levels)
Tasks
- Build LLM application services with streaming batching and backoff
- Build and maintain CI CD pipelines for apps infrastructure and ML pipelines
- Build data ingestion and processing pipelines with Glue and Lake Formation
- Build offline and online eval harnesses for LLM systems
- Design embedding and chunking pipelines for RAG
- Design provision and maintain AWS infrastructure using infrastructure as code
- Enforce safety privacy and compliance with guardrails and access controls
- Implement observability using telemetry and dashboards
- Implement prompt tool and agent execution flows using LangChain
- Manage AWS identity and access management and encryption keys
- Manage IoT deployments including secure messaging and over the air updates
- Operate secure AWS networking with VPC and PrivateLink
- Operate vector search and tune retrieval recall latency and cost
- Optimize retrieval context window caching and inference performance
- Stand up and operate LLM inference endpoints
Perks/Benefits
Skills/Tech-stack
AWS | AWS Athena | AWS Bedrock | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS ECS | AWS EKS | AWS Glue | AWS Lambda | AWS SQS | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Airflow | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon S3 | Amazon SageMaker | Aurora PostgreSQL | Autoscaling | Bedrock Knowledge Bases | CI/CD | CloudWatch | Data redaction | Embeddings | EventBridge | Function Calling | GitHub Actions | Guardrails | IAM | Infrastructure as Code | KMS | Knowledge bases | Lake Formation | Langchain | OpenSearch | OpenSearch Serverless | OpenTelemetry | PGVector | PII Detection | Pinecone | PrivateLink | Quantization | RAG | Rate Limiting | Redis | Retrieval-Augmented Generation | Secrets Manager | Step Functions | Terraform | Token budgeting | VPC | VPC Endpoints | Vector Databases | “as-code”
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Machine Learning Engineer, Ops USD 125K-165KCI/CD | GPU Acceleration | Go | Inference Optimization | Inference Server401k matching | Company equity | Dental insurance | Fertility support | Health insuranceMid-level Full TimeRemote (U.S. or Europe) R11h ago
-
Staff Data Engineer USD 170K-200KAccess Controls | Airflow | Alerting | Amazon Web Services | Anomaly Detection401k employer matching | Comprehensive health benefits | Employee stock purchase program | Offsite team retreats | Parental leaveSenior-level Full TimeUS Remote R12h ago
-
Analytics Engineer USD 150K-200KAmazon S3 | Analytics | BigQuery | Data Instrumentation | Data Modeling401k | Flexible PTO | Flexible hours | Home office stipend | Long-term disabilitySenior-level Full TimeRemote (United States) R12h ago
-
Machine Learning Engineer, Underwriting USD 166K-210KAWS | Calibration | Credit Risk | Credit risk modeling | Decision SystemsSenior-level Full TimeRemote R16h ago
-
AVP of Data Platform Services – Engineering & DevOps USD 177K-266KAzure DevOps | CI/CD | Data Architecture | Data Engineering | Data Factory401k | Generous PTO | Hybrid schedule | Longevity bonuses | Medical/Dental/VisionExecutive-level Full TimeWilkes Barre, PA, United States R1d ago
-
Principal Data & Analytics Engineer USD 140K-192KAWS | Agile | Azure | Cloud Computing | Cloud platform401k match | Dental insurance | Employee discounts | Hybrid work | Medical insuranceSenior-level Full TimeChandler, AZ, United States R1d ago
-
Senior AI Full Stack Engineer USD 66K-84KAPI Gateway | Agentic Workflows | Anthropic | Azure OpenAI | CI/CDSenior-level Full TimeIndianapolis, IN - Remote/Hybrid R1d ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R1d ago
-
Staff Data Eng, Data Systems, TCGplayer USD 136K-228KAccess Control | Change Data Capture | Cost Management | Data Capture | Data Governance401k eligibility | Medical benefits | Paid time off | Parental leave | Remote work not available for U S visa sponsorshipSenior-level Full TimeRemote Oregon, United States R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Interaction Designer USD 140K-155KAgent Frameworks | Deterministic systems | Embeddings | Evaluation | LLM APIsRemote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAccelerators | Computer Vision | Data labeling | Deep learning | Distributed TrainingSenior-level Full TimeUnited States - Remote R1d ago
-
Analytics Data Engineer USD 100K-120KAWS | Artificial Intelligence | Automation Scripting | Azure | CI/CD401k matching | All-hands meetings | Cell phone reimbursement | Dental insurance | FSA accountSenior-level Full TimeUnited States - Remote R1d ago
-
Big Data Application Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Cloud Data Architect USD 145K-160KAWS | Access Management | Amazon Redshift | Apache Flink | Apache KafkaCareer growthSenior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer USD 72K-130KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
ML Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Data Platform Engineer USD 100K-150KAutoscaling | C++ | CUDA | Capacity Planning | Distributed SystemsCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Azure Data and MLOps Engineer USD 116K-222KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data Lake401k match | Company paid life insurance | Company paid vision plan | Company-paid disability insurance | PTOSenior-level ContractUnited States - Remote R1d ago
-
Prompt Engineer USD 100K-150KAgent Frameworks | Embeddings | Evaluation Pipelines | Fine Tuning | LLM APIsSenior-level Full TimeUnited States - Remote R1d ago
-
AI Operations Engineer USD 150K-165KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeWestford, MA R1d ago