DataBricks Administrator
Cincinnati, Ohio, United States
A USD 147K-190K (estimate) Mid-level Full Time
Tasks
- Administer Databricks clusters jobs notebooks and workflows
- Automate workspace deployment with Infrastructure as Code
- Deploy and manage Azure Databricks workspaces
- Enforce RBAC and integrate with Azure Active Directory
- Implement CI CD pipelines for Databricks job deployment
- Implement Unity Catalog for access control and data governance
- Implement monitoring with Azure Monitor Prometheus and Grafana
- Integrate Databricks with Azure Data Lake Azure Synapse and Snowflake
- Manage Databricks runtime libraries and dependencies
- Monitor and optimize compute utilization and autoscaling
- Optimize Delta Lake storage caching and indexing
- Set up audit logging monitoring and alerting
- Troubleshoot performance bottlenecks in ETL and ML
- Tune Apache Spark workloads for query performance
Perks/Benefits
Skills/Tech-stack
Active Directory | Apache Spark | Audit Logging | Azure | Azure Active Directory | Azure Data | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Monitor | Azure Resource | Azure Resource Manager | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Data Governance | Data Lake | Databricks Unity Catalog | Delta Lake | GitHub Actions | Grafana | Jenkins | Key Vault | MLflow | Prometheus | PySpark | RBAC | Resource manager | SQL | Scala | Synapse Analytics | Terraform | Unity Catalog
Education
N/A
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R18d ago
-
Data Engineer, Product Analytics USD 192K-235KCompliance | Data Privacy | Data Quality | Data Security | Data WarehousingSenior-level Full TimeMenlo Park, CA1h ago
-
Data Engineer USD 185K-196KData Modeling | Data Warehousing | Dimensional Modeling | ETL | Object-OrientedMid-level Full TimeMenlo Park, CA1h ago
-
Data Engineer USD 183K-203KAnomaly Detection | Data Drift | Data Quality | Data Visualization | Feature DriftEntry-level Full TimeMenlo Park, CA1h ago
-
Data Engineer USD 185K-196KC++ | Data Migration | Data Modeling | Data Warehousing | Dimensional dataMid-level Full TimeMenlo Park, CA1h ago
-
Lead SAP Data Engineer - IT USD 105K-152KCDS Views | Data Governance | Data Lineage | Data Modeling | Data PipelinesAdoption Assistance | Education assistance | Health and life insurance | Paid Holidays | Paid time offSenior-level Full TimeLibertyville, IL, US, 60048-37816h ago
-
Senior-level Full TimeSan Francisco12h ago
-
Data Integration Lead USD 142K-178KData Architecture | Data Governance | Data Operations | Data Quality | Data Quality ManagementLeadership development | Professional developmentSenior-level Full TimeFort Belvoir, VA13h ago
-
Entry-level Full TimeNewport Beach, United States13h ago
-
Associate Technical Architect - DE - Databricks USD 121K-202KAWS S3 | AWS Secrets | AWS Secrets Manager | AWS Step Functions | AirflowCareer development | Innovation-focused culture | Learning and growth | Work-life balanceMid-level Full TimeUSA - Remote, United States R13h ago
-
Senior-level Full TimeRedmond, WA, US13h ago
-
AI Search | AWS Bedrock | Agentic Workflows | Amazon SageMaker | Anthropic401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
Backup and Recovery | Capacity Planning | Data Security | Database Design | Database performance401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceMid-level Contract Full TimeSavannah, GA, United States13h ago
-
AWS S3 | Access Control | Active IQ | Ansible | Audit Logging401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
Mid-level Full TimeDayton, Ohio, United States15h ago
-
Specialist Solutions Architect - AI & ML (Communications, Media, Entertainment & Games) USD 180K-247KAI guardrails | AWS | Agent Orchestration | Agentic Systems | Artificial IntelligenceMentorship | Remote work | Travel up to 30 percentSenior-level Full TimeUnited States15h ago
-
Senior-level Full TimeNew York15h ago
-
Analytics Engineer USD 57K-67KAPI Integration | DBT | Data Modeling | Data Warehouse | Data integration401k matching | Financial wellness counseling | Flexible work environment | Medical, dental, vision benefits | Paid vacationEntry-level Full TimeLos Angeles15h ago
-
AI Software Engineer USD 85K-117KAsynchronous systems | C# | C++ | CI/CD | Data Preparation401k | Dental insurance | Employee assistance program | Flexible time off | Medical insuranceMid-level Full TimePittsburgh, PA, United States16h ago
-
Associate, AI/ML Engineer USD 81K-106KAI Search | AWS | Azure | Azure AI | Azure AI Search401 k retirement plan | 401-k match | Dental insurance | Health insurance | Paid parental leaveMid-level Full TimeSomerset, New Jersey, United States16h ago
-
Analytics Engineer II USD 88K-113KAWS | Apache Spark | Azure | CI/CD | DBT401k match | Dental insurance | Disability insurance | Employee recognition programs | Health insuranceSenior-level Full TimeSaint Louis, Missouri, United States16h ago
-
Data Engineer, Analytics Data Products USD 110K-130KAWS | Airflow | BigQuery | Build tool | CI/CD401k match | Flexible spending accounts | Medical, dental, vision benefits | Paid parental leave | Paid sick daysMid-level Full TimeNew York, NY16h ago
-
Apache Spark | Automation | Big Data | Data Science | Distributed ComputingSenior-level Full TimeFoster City, CA16h ago
-
Manager, Data Engineering USD 112K-150KApache Spark | Automated testing | Azure Cosmos | Azure Cosmos DB | Azure DataMid-level Full TimeAtlanta, Georgia17h ago
-
Manager, Data Engineering USD 160K-190KApache Spark | Automated testing | Azure Cosmos | Azure Cosmos DB | Azure DataMid-level Full TimeChicago, Illinois17h ago