Lead Assistant Manager
New York, United States
USD 180K-250K (estimate) Senior-level Full Time
Tasks
- Administer Unity Catalog permissions and governance
- Configure Git integration with Databricks Repos
- Configure audit logging
- Configure authentication and authorization
- Configure instance pools and job clusters
- Configure role-based access control
- Create and manage cluster policies
- Design deploy manage Databricks workspaces
- Establish workspace standards and environment isolation
- Implement infrastructure as code with Terraform
- Implement least privilege access controls
- Integrate Databricks with AWS IAM
- Maintain operational dashboards alerts and documentation
- Maintain platform availability reliability and performance
- Manage secret scopes
- Manage service principals and personal access tokens
- Monitor Databricks usage and cloud spending
- Monitor workspace jobs clusters and platform performance
- Optimize cluster startup times and resource utilization
- Plan test and rollout Databricks Runtime upgrades
- Recommend cluster sizing and auto scaling strategies
- Respond to incidents and perform root cause analysis
- Support CI CD pipelines for notebooks workflows and infrastructure
- Support security compliance and audits
- Track cost trends and recommend savings
Perks/Benefits
- N/A
Skills/Tech-stack
AWS IAM | Access Tokens | Audit Logging | Azure DevOps | CI/CD | CloudWatch | Cluster policies | Cost Optimization | Databricks | Databricks Repos | Databricks Runtime | EC2 | Git | GitHub Actions | Incident Management | Infrastructure as Code | Instance Pools | Jenkins | Job Clusters | KMS | Log Analysis | Monitoring | Performance Tuning | Personal Access Tokens | S3 | Secret Scopes | Security groups | Service principals | Terraform | Unity Catalog | VPC | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Related jobs
-
AI Hardware Accelerator | AI Practices | AI hardware | ASICs | Allocation OptimizationSenior-level Full TimeMenlo Park, CA3h ago
-
Senior Software Engineer, Embedded Systems/Firmware, XR USD 174K-252KAlgorithms | C# | C++ | Code review | Data StructuresSenior-level Full TimeSan Jose, CA, USA; Kirkland, WA, …4h ago
-
Artificial Intelligence | C# | C++ | Code review | Control SystemsMid-level Full TimeMountain View, CA, USA4h ago
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R10h ago
-
Applied AI Engineer - iCloud Data USD 150K-220KAI Foundry | Apache Flink | Apache Kafka | Azure AI | Azure AI FoundrySenior-level Full TimeCupertino; Seattle15h ago
-
Senior Software Engineer - Storage Control Plane USD 266K-395KBlock Storage | C# | C++ | CI/CD | CephSenior-level Full TimeSan Francisco Office (Fremont St) R15h ago
-
Software Engineer, AML, Ai & Data Platforms (AiDP) USD 143K-225KCI/CD | Cassandra | Concurrency | Distributed Systems | ElasticsearchMid-level Full TimeSunnyvale15h ago
-
Senior Data Engineer (ETL / Python Developer) USD 120K-163KApache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeIndianapolis, IN, US16h ago
-
Applied AI/ML Engineer USD 150K-200KAPI Integration | Anomaly Detection | Apache Spark | CI/CD | Cloud Platforms401k match | Comprehensive benefits package | Flexible PTO | Paid Holidays | Remote workMid-level Full TimeWashington DC area R17h ago
-
Finance & Strategy AI Engineer USD 146K-246KAPI Integration | Adaptive Planning | Agentic Workflows | BigQuery | Data GovernanceFlexible remote work | Health benefits | Parental leave | Professional development stipendSenior-level Full TimeSan Francisco - SF9 R17h ago
-
AI Assisted Query Profiling | AI assisted code | AI-assisted code review | ClickHouse | Code reviewSenior-level Full TimeUnited States R17h ago
-
Software Engineer, Data Infrastructure - AI Platform USD 200K-230KAI-assisted tooling | ClickHouse | Data Pipelines | Debugging | Distributed SystemsSenior-level Full TimeUnited States R17h ago
-
Staff Data Platform Engineer - AI Platform USD 200K-230KClickHouse | Compliance | Data Pipelines | Debugging | Distributed SystemsSenior-level Full TimeUnited States R17h ago
-
Senior Data Platform Engineer - AI Platform USD 200K-230KAI code review | AI-assisted debugging | ClickHouse | Code review | Data Pipeline ReliabilitySenior-level Full TimeUnited States R17h ago
-
Data Platform Engineer - AI Platform USD 200K-230KClickHouse | Data Pipelines | Distributed Systems | Incident Response | Log AnalysisSenior-level Full TimeUnited States R17h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-290KAir-gapped | ArgoCD | CAPI | CSI | Cluster APICompany outings | Conference attendance | Hackathons | Happy hours | Professional development and trainingExecutive-level Full TimeRemote, USA, United States R18h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-170KArgoCD | CSI | Cluster API | Flux | GitOpsCompany outings and happy hours | Conferences and working groups | Hackathons and tech talks | Professional development and trainingSenior-level Full TimeRemote, USA, United States R18h ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid work environment | Remote work optionMid-level Full TimeArlington, VA R18h ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDFlexible work schedule | Hybrid work environment | Remote work availableMid-level Full TimeWoburn, MA R18h ago
-
Senior-level Full TimeCupertino18h ago
-
Software Engineer I - Lab - 934 USD 125K-195KC plus plus | CI/CD | Data acquisition | Docker | Embedded SystemsMid-level Full TimeUS Broomfield, CO18h ago
-
Lead Data Engineer - Auctions & Outcomes USD 200K-230KAWS | Airflow | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeNew York, New York18h ago
-
Senior Software Engineer, Data Platform USD 196K-245KAirflow | BigQuery | Cost Optimization | Dagster | Data GovernanceBenefits | Equity | Relocation assistanceSenior-level Full TimeSan Francisco Bay Area or Remote … R19h ago
-
Data Engineer - DataOps USD 130K-150KApache Airflow | Apache Iceberg | Apache Spark | CI/CD | Cause analysis401k match | Career growth | Hybrid work schedule | Medical, dental, and vision insurance | Paid parental leaveMid-level Full TimeCupertino, California, United States19h ago
-
Staff Data Engineer - AI Platform USD 200K-230KAI Assisted Query Profiling | AI assisted code | AI-assisted code review | ClickHouse | Code reviewSenior-level Full TimeUnited States R19h ago