Manager - Databricks Platform Engineer
Tasks
- Architect HA and DR with cross region replication
- Automate infrastructure provisioning with Terraform and GitHub Actions
- Build and maintain MLflow integrations for model lifecycle management
- Design Databricks workspaces and clusters on AWS
- Develop and maintain Unity Catalog for governance and lineage
- Enforce data governance tagging rightsizing SLAs and audit readiness
- Establish monitoring and alerting for cost usage pipeline health and data freshness
- Implement job orchestration cluster policies autoscaling and CI CD for notebooks and models
- Manage Fivetran connectors and dbt projects
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon CloudWatch | Amazon S3 | Apache Spark | Autoscaling | CI/CD | Cross Region | Cross-region replication | DBT | Databricks | Datadog | Disaster Recovery | Fivetran | GitHub Actions | High Availability | IAM | MLflow | PySpark | Python | Terraform | Unity Catalog | VPC
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior-level Full TimeAustin, TX, US4h ago
-
Mid-level Full TimeUnited States5h ago
-
Applied AI Engineer - Life Sciences & Healthcare USD 150K-200KAWS | Amazon S3 | CI/CD | Caching | Claims ProcessingSenior-level Full TimeAustin, TX, US6h ago
-
AWS | Amazon S3 | Artificial Intelligence | Cloud Databases | Data AnalysisEntry-level ContractNew York, United States6h ago
-
AI Governance | AI guardrails | API Integration | Agent workflows | AutoGPTSenior-level ContractAustin, United States6h ago
-
Staff Engineer – AI/ML & Digital Twin USD 112K-168KAWS | Autoencoders | Azure | Cloud Computing | Convolutional Neural NetworksSenior-level Full TimePennsylvania, Canonsburg7h ago
-
Research Engineer, MRS AI USD 117K-173KAgent Orchestration | Bias Mitigation | Continual Learning | Data Augmentation | DebiasingEntry-level Full TimeBellevue, WA | Menlo Park, CA …8h ago
-
Software Engineer, Play Analytics, Platforms and Devices USD 147K-211KArtificial Intelligence | C++ | Code Quality | Computer networks | Data StorageMid-level Full TimeMountain View, CA, USA8h ago
-
Software Engineer III, Machine Learning, Android AI USD 147K-211KAI Agents | Computer Vision | Data Pipelines | Data Processing | Data cleaningSenior-level Full TimeMountain View, CA, USA8h ago
-
Software Engineer III, Speech Production, Infrastructure USD 147K-211KAutomatic Speech Recognition | C++ | Data Structures | Data Structures and Algorithms | Distributed SystemsSenior-level Full TimeMountain View, CA, USA8h ago
-
Customer Engineer, Data Management, Retail, Google Cloud USD 153K-222KCloud Architecture | Code conversion | DB2 | Data Backup | Database AdministrationSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA8h ago
-
Senior Software Engineer, Core Developer Intelligence USD 174K-252KArtificial Intelligence | Data Analysis | Data Pipelines | Data Storage | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Senior Software Engineer, AI/ML, Maps Navigation USD 174K-252KC plus plus | Code review | Computational Geometry | Computer Vision | Data StructuresSenior-level Full TimeMountain View, CA, USA8h ago
-
Software Engineer III, AI/ML GenAI, YouTube USD 147K-211KC++ | Computer Vision | Data Processing | Debugging | Language ModelsSenior-level Full TimeMountain View, CA, USA8h ago
-
Senior Software Engineer, AI/ML, AI and Infrastructure USD 174K-252KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
AI/ML Engineer, National Security, Google Public Sector USD 153K-222KC plus plus | Data Validation | Deep learning | Feature Engineering | GPUsTravel up to 30 percentSenior-level Full TimeReston, VA, USA; Washington D.C., DC, …8h ago
-
C++ | Clustering | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA8h ago
-
Software Developer Backend and GenAI USD 147K-216KAlloyDB | BigQuery | CI/CD | Cloud Composer | Cloud RunSenior-level Full TimeUnited States16h ago
-
Data Scientist Lead - Payments USD 165K-205KAgile | Big Data | Distributed Computing | Language Processing | Machine LearningSenior-level Full TimeNew York, NY, United States16h ago
-
Senior Exploitation Specialist / Data Scientist USD 93K-166KData Analysis | Data Processing | Data Visualization | Machine Learning | PythonSenior-level Full TimeSpringfield, Virginia, United States18h ago
-
Engineer, Supercomputing & Distributed Systems USD 180K-287KDocker | DuckDB | ETL | Infiniband | KafkaSenior-level Full TimeSan Francisco19h ago
-
Video AI Engineer EUR 137K-275K3D Gaussian Splatting | 3D Reconstruction | Biometric analysis | C++ | Cloud processingHybrid work environment | Remote work optionMid-level Full TimeSan Jose (CA), United States19h ago
-
Embedded Systems Engineer USD 150K-180KBare Metal | Bring-up | C# | CI/CD | Drivers401k | Accidental insurance | Critical illness insurance | Family leave | Flexible time offSenior-level Full TimeSanta Barbara, California, United States19h ago
-
AWS | Access Control | Anomaly Detection | Artificial Intelligence | Azure401k | Fully onsite | Holiday pay | Medical/dental/vision/life insurance | Parental leaveSenior-level Full TimeUS328 CA Santa Clara - 5490 …19h ago
-
Staff Data Engineer: Robotics & Digital Surgery - OTTAVA USD 118K-179KAWS Kinesis | AWS S3 | Agile | Computer system | Computer system validationSenior-level Full TimeUS328 CA Santa Clara - 5490 …19h ago