DataBricks Administrator
Cincinnati, Ohio, United States
A USD 147K-190K (estimate) Mid-level Full Time
Tasks
- Administer Databricks clusters jobs notebooks and workflows
- Automate workspace deployment with Infrastructure as Code
- Deploy and manage Azure Databricks workspaces
- Enforce RBAC and integrate with Azure Active Directory
- Implement CI CD pipelines for Databricks job deployment
- Implement Unity Catalog for access control and data governance
- Implement monitoring with Azure Monitor Prometheus and Grafana
- Integrate Databricks with Azure Data Lake Azure Synapse and Snowflake
- Manage Databricks runtime libraries and dependencies
- Monitor and optimize compute utilization and autoscaling
- Optimize Delta Lake storage caching and indexing
- Set up audit logging monitoring and alerting
- Troubleshoot performance bottlenecks in ETL and ML
- Tune Apache Spark workloads for query performance
Perks/Benefits
Skills/Tech-stack
Active Directory | Apache Spark | Audit Logging | Azure | Azure Active Directory | Azure Data | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Monitor | Azure Resource | Azure Resource Manager | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Data Governance | Data Lake | Databricks Unity Catalog | Delta Lake | GitHub Actions | Grafana | Jenkins | Key Vault | MLflow | Prometheus | PySpark | RBAC | Resource manager | SQL | Scala | Synapse Analytics | Terraform | Unity Catalog
Education
N/A
Related jobs
-
AI Engineer USD 103K-140KAI Agents | AI Studio | Access Control | Anthropic Claude | AuthenticationBonus eligibleSenior-level Full TimeDenver, CO, United States6h ago
-
Data Engineering Analyst Lead/Scientist - Remote USD 90K-150KAWS | Data Compliance | Data Engineering | Data Privacy | PythonSenior-level Full TimeUnited States, UNITED STATES, United States R8h ago
-
Director, Data Governance & Observability USD 165K-190KAPI Design | Alerting | Automated testing | CI/CD | DashboardsExecutive-level Full TimeNew York, NEW YORK, United States8h ago
-
Senior-level Full TimeCincinnati, OH, United States8h ago
-
Bill of Materials | Change Management | Data Cleansing | Data Governance | Data Migration401k | Collaborative team environment | Cross training | Dental insurance | Medical insuranceMid-level Full TimeWichita, KS, United States8h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k with firm profit share | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States10h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R12h ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R12h ago
-
Senior DevOps Engineer ID63545 USD 135K-185KAWS | Apache Airflow | ArgoCD | Azure | BigQueryFlextime | Growth roadmaps | Mentorship | Office work options | Remote work optionsSenior-level Full TimeMiami, United States14h ago
-
BigQuery | Curriculum Development | Data Governance | Data Lakehouse | Data ModelingAsynchronous hiring process | Part-time hoursSenior-level Part TimeBoston, US14h ago
-
AFOPER commands | ASG Scheduler | Application Integration | Azure | CA GenHybrid work environmentSenior-level ContractTallahassee, United States R14h ago
-
Senior Director, AI / Machine Learning Software Engineer USD 136K-300KApache Flink | Apache Spark | CI/CD | Data Lineage | Data PrivacyHealth benefits | Paid leave | Paid volunteer timeSenior-level Full TimeNew York, NY, United States15h ago
-
Data Pipelines | Full Stack | Full-Stack Development | Machine Learning | PythonSenior-level Full TimeSan Jose, California, United States16h ago
-
Associate Principal, Trust and Safety, GenAI USD 142K-205KAbuse prevention | Cybersecurity | Dashboards | Data Transformation | Data VisualizationMid-level Full TimeWashington D.C., DC, USA; Seattle, WA, …17h ago
-
Customer Engineer, Data Analytics, Google Cloud USD 153K-222KBatch Processing | Big Data | Cloud Architecture | Cloud platform | Customer RequirementsSenior-level Full TimeSunnyvale, CA, USA17h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KC++ | Capacity Planning | Cloud Databases | Data Migration | Data PipelinesTravel up to 30 percentMid-level Full TimeReston, VA, USA17h ago
-
Data Scientist USD 67K-150KA/B | A/B Testing | B testing | Clustering | Drift monitoring401k plan | AD and D insurance | Child Life Insurance | Dental insurance | Educational Assistance PlanMid-level Full TimeUnited States18h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R19h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeDiversity and Inclusion Commitment | Flexible asynchronous culture | Laid-back atmosphere | Portfolio and LinkedIn supportMid-level Full TimeBellevue, WA, USA22h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Flexible management | Remote-friendly, distributed teamMid-level Full TimeDenver, CO, USA22h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimePalo Alto, CA, USA23h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible work environment | Remote-friendlyMid-level Full TimeLos Angeles, CA, USA23h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Flexible remote workMid-level Full TimeKirkland, WA, USA23h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible remote work | Work on impact driven productsMid-level Full TimeSan Jose, CA, USA23h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly work environment | Portfolio and LinkedIn submission flexibility | Remote-friendly environmentMid-level Full TimeCupertino, CA, USA23h ago