Platform Engineer - Databricks and Cloud
Tasks
- Apply AWS Well-Architected Framework principles
- Automate Databricks job and workflow deployments
- Build CI/CD pipelines
- Create reusable templates and standard operating procedures
- Design scalable AWS infrastructure
- Enable data engineering pipeline execution
- Implement cloud and data platform governance and security
- Implement infrastructure as code with Terraform
- Manage Databricks workspaces and clusters
- Monitor platform reliability and performance
- Troubleshoot platform connectivity and workload issues
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | AWS | AWS CDK | AWS CodeBuild | AWS CodeDeploy | AWS Glue | AWS IAM | AWS Lambda | AWS Well Architected | AWS Well-Architected Framework | Amazon API | Amazon API Gateway | Amazon DynamoDB | Amazon EC2 | Amazon EKS | Amazon Redshift | Amazon VPC | ArgoCD | Batch Processing | CI/CD | Cloud Governance | CloudWatch | Data Lakes | Databricks | Databricks Jobs | ELK | ELT | ETL | GitHub | GitHub Actions | Grafana | Infrastructure as Code | Load balancers | Prometheus | Security groups | Terraform | Unity Catalog | Well-Architected Framework | Workflow Orchestration | “as-code”
Education
N/A
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R6d ago
-
Mid-level Full TimeMiami Lakes, FL, United States2h ago
-
AWS | Autogen | Automated testing | Azure | CI/CDOnsite workSenior-level ContractDallas, United States6h ago
-
Databricks Engineer USD 97K-162KAPI Integration | Agile | Data Governance | Data Modeling | Data QualityMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …7h ago
-
Data Scientist, Innovation Hub USD 108K-108KAudit Logging | Azure | CI/CD | Federated identity | Integration TestingCareer growth | Healthcare | On-site childcare | PTO | Paid HolidaysMid-level Full TimeTexas-Dallas-5323 Harry Hines Blvd7h ago
-
Databricks Engineer USD 107K-179KAPI Integration | Agile | Cloud Computing | Data Governance | Data ModelingTravel 10 to 15 percentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …7h ago
-
GenAI Engineer USD 113K-188KAWS | Amazon Bedrock | Data Management | Data integration | Generative AIMentorship | Onsite work | Professional development | Travel opportunitiesEntry-level Full TimeArlington/Rosslyn, Virginia, United States7h ago
-
Senior Data Engineer USD 133K-158KAKS | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeCincinnati, Ohio, United States7h ago
-
AI Program Lead USD 159K-265KAI Governance | Agent-Based Artificial Intelligence | Agent-based | Artificial Intelligence | Business IntelligenceMentorship | Professional development | Travel up to 25 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States7h ago
-
Associate BI Analytics Engineer USD 98K-163KDAX | Data Modeling | Data Warehousing | Databricks | ELTMid-level Full TimeUSA-VA-Herndon7h ago
-
Data Engineer, Employee Technology Support USD 110K-130KCause analysis | Data Governance | Data Modeling | Data Monitoring | Data Quality401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York7h ago
-
Security Engineer III - AI/ML USD 170K-215KAPI Development | AWS | Anomaly Detection | Azure | BERTSenior-level Full TimePlano, TX, United States8h ago
-
Principal Data Engineer USD 160K-170KAWS | Amazon Redshift | Apache Airflow | BigQuery | Cloud platform401k match | Dental insurance | Health insurance | Paid time off | Remote workSenior-level Full TimeRemote (United States) R19h ago
-
Presales Systems Engineer - SASE USD 127K-247KAWS | Access Control | BGP | CASB | DNSProfessional development programs | Remote work flexibility | Travel opportunitiesMid-level Full TimeDurham, North Carolina, United States of …19h ago
-
AI/ML Engineer - School USD 101K-163KAI Safety | AI safety evaluation | AWS Bedrock | AWS ECS | AWS LambdaMid-level Full TimeVirtual US IL, United States R19h ago
-
AI Software Engineer - Fixed Income Technology USD 110K-150KAPI Integration | AWS | Azure | CI/CD | Data PipelinesHealth insurance | Hybrid work | Life insurance | Paid time off | Retirement planSenior-level Full TimeIL01 - Chicago, United States19h ago
-
Senior Cloud Database Engineer (Hybrid - Seattle, WA) USD 142K-220KASM | AWR | AWS DMS | AWS RDS | Amazon AuroraDisability insurance | EAP Resources | Hybrid work location | Life insurance | Medical/Vision/DentalSenior-level Full TimeSeattle WA, United States R19h ago
-
Senior Machine Learning Engineer USD 159K-295KAUC-ROC | AWS | Causal Inference | Clean room | Data clean roomSenior-level Full TimeCA San Francisco 153 Kearny Street, …19h ago
-
Presales Systems Engineer - SASE USD 127K-247KAWS | Access Control | BGP | CASB | DNSHealth and wellbeing benefits | Inclusion programs | Personal and professional development | Remote work flexibilityMid-level Full TimeDurham, North Carolina, United States of …19h ago
-
Principal AI Platform Engineer USD 117K-206KAI | AWS | Agent workflows | Ansible | Argo CDHealth insurance | Hybrid work | Paid time off | Remote work | Retirement savings planSenior-level Full TimeUSA - MN - Minneapolis, United …19h ago
-
AI Solutions Engineer USD 195K-280KAPIs | Authentication | CI/CD | Containerization | DBTDental insurance | ESPP | Flexible spending accounts | Health insurance | Remote work flexibilityMid-level Full TimeRemote US R20h ago
-
Senior Data Engineer USD 185K-200KAWS Glue | Amazon Athena | Amazon Bedrock | Amazon OpenSearch | Amazon S3401k company match | Comprehensive health coverage | Equity purchase option | Flexible work schedule | Generous time offSenior-level Full TimeLos Angeles Office R20h ago
-
DevOps, MLOps & Security Engineering Lead - San Jose, CA USD 165K-260KAPI Security | AWS | Automated testing | Bash | CI/CDSenior-level Full TimeCalifornia21h ago
-
Software Engineer III - BI Developer & Data Analyst USD 170K-185KAPI Integration | Agile | Alteryx | Automated testing | CI/CDSenior-level Full TimeChicago, IL, United States21h ago
-
Senior Data Engineer USD 156K-204KApache Airflow | Data Ingestion | Data Pipelines | ETL | PythonIn-office 3 days per weekSenior-level Full TimeUS-CA-Menlo Park22h ago