Platform Engineer - Databricks and Cloud
Tasks
- Apply AWS Well-Architected Framework principles
- Automate Databricks job and workflow deployments
- Build CI/CD pipelines
- Create reusable templates and standard operating procedures
- Design scalable AWS infrastructure
- Enable data engineering pipeline execution
- Implement cloud and data platform governance and security
- Implement infrastructure as code with Terraform
- Manage Databricks workspaces and clusters
- Monitor platform reliability and performance
- Troubleshoot platform connectivity and workload issues
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | AWS | AWS CDK | AWS CodeBuild | AWS CodeDeploy | AWS Glue | AWS IAM | AWS Lambda | AWS Well Architected | AWS Well-Architected Framework | Amazon API | Amazon API Gateway | Amazon DynamoDB | Amazon EC2 | Amazon EKS | Amazon Redshift | Amazon VPC | ArgoCD | Batch Processing | CI/CD | Cloud Governance | CloudWatch | Data Lakes | Databricks | Databricks Jobs | ELK | ELT | ETL | GitHub | GitHub Actions | Grafana | Infrastructure as Code | Load balancers | Prometheus | Security groups | Terraform | Unity Catalog | Well-Architected Framework | Workflow Orchestration | “as-code”
Education
N/A
Roles
Related jobs
-
Artificial Intelligence Machine Learning Engineer USD 98K-163KArtificial Intelligence | CI/CD | Docker | Elasticsearch | FastAPIHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Ashburn5h ago
-
AI Software Engineer USD 260K-260KAI Search | API Integration | Agent Orchestration | Azure AI | Azure AI SearchCareer growth | Healthcare | On-site childcare | PTO | Paid HolidaysSenior-level Full TimeTexas-Dallas-5323 Harry Hines Blvd5h ago
-
Senior Production Engineer - Applied Machine Learning USD 218K-480KAlerting | Auto Scaling | Auto rollback | Auto-healing | CI/CDSenior-level Full TimeSan Jose, California, United States5h ago
-
Senior Data Engineer (Multiple Positions) USD 220K-387KApache Flink | Apache Spark | Architecture Design | Data Governance | Data ModelingSenior-level Full TimeSan Jose, California, United States5h ago
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R13h ago
-
Machine Learning Engineer, API Multicloud USD 295K-445KAPIs | AWS | Data Pipelines | Data Structures | Data structures algorithmsSenior-level Full TimeSan Francisco14h ago
-
Applied AI Engineer - iCloud Data USD 150K-220KAI Foundry | Apache Flink | Apache Kafka | Azure AI | Azure AI FoundrySenior-level Full TimeCupertino; Seattle17h ago
-
Applied AI Engineer - iCloud Data USD 150K-220KAWS | Agent Frameworks | Agent coordination | Apache Flink | AzureSenior-level Full TimeCupertino; Seattle17h ago
-
Consultant, Cybersecurity (Data Engineer) USD 118K-222KAccess Control | Apache Kafka | Apache Spark | Application Security | Automation401k matching | Health and wellbeing benefits | Hybrid schedule | Paid time off | Remote internal associates consideredSenior-level Full TimeOhio - Columbus, Three Nationwide Plaza, …17h ago
-
Senior Software Engineer - Storage Control Plane USD 266K-395KBlock Storage | C# | C++ | CI/CD | CephSenior-level Full TimeSan Francisco Office (Fremont St) R18h ago
-
Software Engineer, AML, Ai & Data Platforms (AiDP) USD 143K-225KCI/CD | Cassandra | Concurrency | Distributed Systems | ElasticsearchMid-level Full TimeSunnyvale18h ago
-
Senior Data Engineer (ETL / Python Developer) USD 120K-163KApache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeIndianapolis, IN, US19h ago
-
Applied AI/ML Engineer USD 150K-200KAPI Integration | Anomaly Detection | Apache Spark | CI/CD | Cloud Platforms401k match | Comprehensive benefits package | Flexible PTO | Paid Holidays | Remote workMid-level Full TimeWashington DC area R19h ago
-
Finance & Strategy AI Engineer USD 146K-246KAPI Integration | Adaptive Planning | Agentic Workflows | BigQuery | Data GovernanceFlexible remote work | Health benefits | Parental leave | Professional development stipendSenior-level Full TimeSan Francisco - SF9 R19h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-290KAir-gapped | ArgoCD | CAPI | CSI | Cluster APICompany outings | Conference attendance | Hackathons | Happy hours | Professional development and trainingExecutive-level Full TimeRemote, USA, United States R20h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-170KArgoCD | CSI | Cluster API | Flux | GitOpsCompany outings and happy hours | Conferences and working groups | Hackathons and tech talks | Professional development and trainingSenior-level Full TimeRemote, USA, United States R20h ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid work environment | Remote work optionMid-level Full TimeArlington, VA R21h ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDFlexible work schedule | Hybrid work environment | Remote work availableMid-level Full TimeWoburn, MA R21h ago
-
Senior-level Full TimeCupertino21h ago
-
Software Engineer I - Lab - 934 USD 125K-195KC plus plus | CI/CD | Data acquisition | Docker | Embedded SystemsMid-level Full TimeUS Broomfield, CO21h ago
-
Lead Data Engineer - Auctions & Outcomes USD 200K-230KAWS | Airflow | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeNew York, New York21h ago
-
Data Engineer - DataOps USD 130K-150KApache Airflow | Apache Iceberg | Apache Spark | CI/CD | Cause analysis401k match | Career growth | Hybrid work schedule | Medical, dental, and vision insurance | Paid parental leaveMid-level Full TimeCupertino, California, United States22h ago
-
Mid-level Full TimePhoenix, AZ, United States22h ago
-
AWS | Agile | Application Security | Azure | Azure DevOps401k match | Educational assistance | Employee assistance program | Employer subsidized medical dental vision and life insurance | Flexible spending accountsMid-level Full TimePhoenix, AZ, United States R22h ago
-
Manager, Engineering Operations USD 139K-258KAI Assisted Development | Automated testing | CI/CD | Cloud Native | Deployment AutomationSenior-level Full TimeLos Angeles, CA, US23h ago