Senior Infrastructure Engineer (Databricks)
Tasks
- Architect implement and own CI CD tooling for Databricks workloads
- Create disaster recovery plan with backup automation fail over and restore drills
- Design IAM model for human users and service principals
- Design and enforce data isolation strategy with Unity Catalog
- Drive adoption of Databricks best practices
- Implement observability including tracing incident management alerting reliability metrics
- Manage and monitor Databricks costs
- Partner with data engineering and data science teams on infrastructure needs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alerting | Azure | Backup Automation | CI/CD | CloudFormation | Cross Component Tracing | Databricks | Datadog | Disaster Recovery | Distributed Computing | GCP | IAM | IaC | Incident Management | Monitoring | New Relic | Observability | Observability Metrics | PySpark | Python | RBAC | Relational databases | SRE | Snowflake | Spark | Terraform | Unity Catalog
Education
N/A
Related jobs
-
API Integration | Anthropic API | Automation Pipelines | Generative AI | Google Generative AISenior-level Full TimeRamat Gan, Israel, IL10h ago
-
CatBoost | Deep learning | Ensemble learning | Feature Engineering | Fine TuningComprehensive benefitsNone Part TimeIsrael, Yokneam20h ago
-
Mid-level Full TimeIsrael, Yokneam20h ago
-
Amazon S3 | Apache Airflow | Apache Kafka | Apache Spark | BashSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Senior-level Full TimeRa'anana, Center District, IL1d ago
-
Mid-level Full TimeJerusalem, Israel1d ago
-
Hands-On Data & AI Architect ILS 341K-443KApache Airflow | Audit Logging | DBT | Data Lake | Data ObservabilityFull-time employment | Hybrid work | Professional growthSenior-level Full TimeTel Aviv, Tel Aviv District, IL1d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
C# | Code review | Configuration Management | Defect Tracking | InterruptsMid-level Full TimeRosh Ha'Ayin, Israel, IL1d ago
-
Sr. AI-First Backend & Data Engineer ILS 341K-443KAWS | Agentic AI | Architecture Documentation | Athena | Automated testingSenior-level Full TimeHerzliya, IL1d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Senior Data Engineer - Application ILS 341K-443KAWS | Apache Airflow | ClickHouse | Data Governance | Data IngestionSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
AI Agents | APIs | Automation tools | Language Models | Large Language ModelsAccess to cutting-edge technologies | Autonomy | Collaboration with experienced professionals | Experimentation driven culture | Fully remoteEntry-level Full TimeIsrael R1d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Mid-level Full TimeTel Aviv, Tel Aviv District, IL1d ago
-
Amazon Redshift | Apache Beam | Apache Spark | Azure Data | Azure Data ExplorerSenior-level Full TimeTel Aviv, Tel Aviv1d ago
-
Principal AI Engineer (Prisma Browser - Agents Platform) ILS 341K-443KAgentic Workflows | Artificial Intelligence | Caching | Code Analysis | Context engineeringSenior-level Full TimeTel Aviv, Tel Aviv1d ago
-
AWS | Azure | Design Patterns | Docker | GCPFlexible work locationMid-level Full TimeTel Aviv, Tel Aviv1d ago
-
Mid-level Full TimeTel-Aviv, Israel, IL2d ago
-
Senior-level Full TimeIsrael - Office - Tel Aviv2d ago
-
Senior Data Engineer ILS 285K-366KBI Dashboards | Data Governance | Data Modeling | Data Pipelines | Data QualityAdvanced training fund | Company retreats | Dinners provided | Dog-friendly office | Equity optionsSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
3D Mapping | 3D Occupancy Mapping | 3D Scene | 3D Scene Understanding | Agile methodologyHigh performance compute resources | IP generation opportunities | Research publication support | Simulation environments accessSenior-level Full TimeAzrieli Building G, Herzliya, Israel2d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL3d ago
-
AI machine learning | AWS | Apache Airflow | BigQuery | ClickHouseSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL3d ago