DataBricks Administrator
Cincinnati, Ohio, United States
A USD 147K-190K (estimate) Mid-level Full Time
Tasks
- Administer Databricks clusters jobs notebooks and workflows
- Automate workspace deployment with Infrastructure as Code
- Deploy and manage Azure Databricks workspaces
- Enforce RBAC and integrate with Azure Active Directory
- Implement CI CD pipelines for Databricks job deployment
- Implement Unity Catalog for access control and data governance
- Implement monitoring with Azure Monitor Prometheus and Grafana
- Integrate Databricks with Azure Data Lake Azure Synapse and Snowflake
- Manage Databricks runtime libraries and dependencies
- Monitor and optimize compute utilization and autoscaling
- Optimize Delta Lake storage caching and indexing
- Set up audit logging monitoring and alerting
- Troubleshoot performance bottlenecks in ETL and ML
- Tune Apache Spark workloads for query performance
Perks/Benefits
Skills/Tech-stack
Active Directory | Apache Spark | Audit Logging | Azure | Azure Active Directory | Azure Data | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Monitor | Azure Resource | Azure Resource Manager | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Data Governance | Data Lake | Databricks Unity Catalog | Delta Lake | GitHub Actions | Grafana | Jenkins | Key Vault | MLflow | Prometheus | PySpark | RBAC | Resource manager | SQL | Scala | Synapse Analytics | Terraform | Unity Catalog
Education
N/A
Related jobs
-
Data Engineer (remote) USD 87K-110KAgile | BigQuery | Data Governance | Data Modeling | Data Pipelines401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Health insuranceMid-level Full TimeWork From Home, United States R1h ago
-
Data Engineering Manager (remote) USD 87K-110KAgile | BigQuery | Data Governance | Data Modeling | Data Quality401k match | Employee assistance program | Employee stock purchase plan | Flexible schedules | Health insuranceMid-level Full TimeWork From Home, United States R1h ago
-
Microsoft Teams | Power BI | Python | SQL | SharePointHelp desk support | User trainingEntry-level ContractLansing, United States4h ago
-
AWS | Agentic AI | Angular | CI/CD | DatabricksHybrid work | Technical mentorshipSenior-level Full TimeNormal, United States5h ago
-
Sr. Data Engineer USD 108K-158KAWS | Apache Spark | Automated testing | Azure Event | Azure Event Hubs401k matching | Dental insurance | Disability insurance | Educational growth | Employee discount programSenior-level Full TimeNew York-TONAWANDA6h ago
-
Artificial Intelligence | Data Modeling | Data Pipelines | Data Quality | Data Visualization401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeNew York6h ago
-
AWS | AWS SDK | Amazon MSK | Apache Kafka | Generative AISenior-level Full TimeNew York, New York, United States7h ago
-
Production Engineer USD 178K-200KApache | Apache Spark | Application Programming | Application Programming Interfaces | C++Entry-level Full TimeMenlo Park, CA7h ago
-
Senior Data Engineer USD 155K-180KAWS | Agile | Alerting | Azure | Bash401k savings plan | Dental insurance | Employee assistance plan | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States9h ago
-
Data Engineer USD 118K-125KAWS | Agile | Apache Spark | Azure | Bash401k savings plan with profit sharing | Commuter parking tax savings | Employee assistance program | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States9h ago
-
Senior GenAI Engineer USD 119K-258KAI Foundry | AI Search | API Management | AWS Bedrock | Active DirectorySenior-level Full TimeMiami, FL, US, 3313111h ago
-
Staff Machine Learning Engineer USD 188K-221KAWS | Amazon Redshift | Amazon SageMaker | Apache Airflow | Apache FlinkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R15h ago
-
Staff Software Engineer, Data & AI USD 183K-214KAWS | Airflow | Analytics | Artificial Intelligence | BI AnalyticsSenior-level Full TimeCA - San Francisco; WA - …16h ago
-
Application Software Engineer, Data USD 150K-225KAngular | C# | CI/CD | Continuous integration | DeploymentSenior-level Full TimeStarbase, TX18h ago
-
Deployed Engineer (Denver) USD 150K-250KAI Agent | AI agent deployment | AWS | Agent deployment | Agent-based401-k plan | Dental coverage | Flexible vacation | Meals on in office days | Medical coverageSenior-level Full TimeDenver, CO18h ago
-
Deployed Engineer (Las Vegas) USD 150K-250KAWS | Azure | Docker | Failure handling | GCP401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimeLas Vegas, NV18h ago
-
Deployed Engineer (Phoenix) USD 150K-250KAWS | Agent Frameworks | Azure | Cloud Computing | Containers401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimePhoenix, AZ18h ago
-
Full Stack AI Developer USD 146K-222KAgile | Angular | Auto-tagging | CI/CD | Chunking401k | Education reimbursement program | Flexible schedule | Hybrid schedule | MentorshipSenior-level Full TimeLivermore, CA, United States R18h ago
-
Senior Data Engineer USD 239K-271KAirflow | Alerting | Amazon Redshift | Automated testing | Cost OptimizationFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R18h ago
-
Mid-level Full TimeUnited States - Remote R18h ago
-
AI/ML Subject Matter Expert (SME) / Analytics Team Lead USD 128K-206KData Visualization | Feature Engineering | Language Processing | Machine Learning | Model Evaluation100 percent on site | Active secret clearance requiredSenior-level Full TimeArlington, VA18h ago
-
Data Engineer USD 124K-149KAutomation | Data Analysis | Data Modeling | Data Security | Data Validation401k match | Paid time offSenior-level Full TimeUSA DC Washington - 330 C …18h ago
-
AI Foundry | Authentication | Authorization | Azure AI | Azure AI FoundryEntry-level Full Time3401 WEST END AVE (LOC00541), United … R18h ago
-
AI Engineer, Global Operations USD 107K-143KArtificial Intelligence | Data Governance | ETL | Langchain | LogisticsContinuous learning and professional growth | Flexible work options | Health, wellness, and retirement plansMid-level Full TimeCalifornia - Remote, United States R18h ago
-
Palantir Data Engineer USD 113K-188KAccess Control | CI/CD | Change Data Capture | Data Capture | Data Governance401k retirement plan | Dental insurance | Disability insurance | Employee referral program | Health insuranceMid-level Full TimeGH Office: Tysons Corner, VA (Headquarters), …18h ago