Databricks administrator
Houston, TX, United States
A USD 197K-270K (estimate) Senior-level Full Time
Tasks
- Administer Databricks workspaces
- Build cost usage dashboards
- Build observability dashboards
- Configure Databricks clusters
- Configure Delta architecture and lineage
- Define compute policies
- Define platform guardrails and templates
- Detect cost anomalies
- Enforce ABAC access controls
- Enforce RBAC access controls
- Enforce naming conventions
- Enforce schema rules
- Ensure platform reliability
- Implement CI CD templates
- Implement Unity Catalog governance
- Implement automated testing
- Implement data quality expectations
- Maintain code governance
- Manage Databricks jobs
- Manage Delta Lake design patterns
- Monitor job and cluster costs
- Prevent incident recurrence
- Provide team enablement and documentation
- Resolve platform incidents
- Review onboarded pipelines for compliance
- Set cost thresholds and alerts
- Set data ingestion standards
Perks/Benefits
- N/A
Skills/Tech-stack
ABAC | Airflow | Apache Spark | Automated testing | Azure DevOps | Billing logs | CI CD templates | CI/CD | CI/CD governance | Compute policies | Cost monitoring | DLT | Data Governance | Data Lineage | Data Modeling | Data Quality | Databricks | Databricks Workflows | Delta Lake | Delta architecture | GitHub Actions | Ingestion pipelines | Observability | PySpark | Python | RBAC | SQL | Schema Enforcement | Unity Catalog
Education
N/A
Related jobs
-
ABAC | Access Control | Airflow | Apache Spark | Attribute Based FilteringSenior-level Full TimeHouston, TX, United States5h ago
-
Data Engineer (Senior) USD 170K-225KAmazon Web Services | Apache NiFi | Apache Spark | Data Pipelines | Data VisualizationSenior-level Full TimeHuntsville, United States6h ago
-
Agent deployment | Agile | Automation | Azure AD | Azure MonitorKnowledge transfer | Long-term contract | Onsite 3 days per weekSenior-level ContractDeerfield Beach, United States6h ago
-
Senior Manager / Principal Data Science USD 155K-178KAI Agents | Dashboards | Data Pipelines | Data Visualization | LLMHybrid workSenior-level ContractDeerfield Beach, United States6h ago
-
API Development | AWS | Airflow | BigQuery | Cloud ComputingMid-level Full TimeDearborn, United States7h ago
-
Apache Spark | Cloud Computing | Data Governance | Data Lineage | Data WarehousingSenior-level Full TimeTexas-Austin7h ago
-
Gen AI Developer Specialist USD 118K-204KAWS | Access Management | Agents | Alerting | Amazon BedrockSenior-level Full TimeUnited States7h ago
-
GenAI Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Pipelines | Docker | Generative AISenior-level Full TimeArlington/Rosslyn, Virginia, United States7h ago
-
Generative AI Engineer III USD 110K-218KArtificial Intelligence | Data Pipelines | Docker | Kubernetes | Language ModelsSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …7h ago
-
Platform Ops & Support Lead - ETL/DBA USD 125K-155KAWS | Ataccama | CI/CD | Change Management | DataikuSenior-level Full TimeJersey City, New Jersey, United States7h ago
-
Senior Software Engineer, Managed Spark, OpenSource USD 174K-253KApache Hudi | Apache Iceberg | Benchmarking | C++ | CloudSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Staff Software Developer, AI/ML, Safety and Security USD 207K-301KClassification | Computer Vision | Data Processing | Debugging | Fine TuningSenior-level Full TimeWaterloo, ON, Canada; New York, NY, …9h ago
-
Artificial Intelligence | C++ | Data Analysis | Data Storage | Data VisualizationSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Senior Software Engineer, Storage AI/ML USD 174K-253KAlgorithms | Benchmarking | Cloud Storage | Data Structures | Deep learningSenior-level Full TimeSeattle, WA, USA9h ago
-
Senior Software Engineer, AI/ML Computer Vision, XR USD 174K-253KComputer Vision | Computer Vision Systems | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSan Jose, CA, USA9h ago
-
Senior Staff Software Engineer, Cloud AI, Full Stack USD 262K-365KC++ | CSS | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Senior Software Engineer, Google Cloud AI, Full Stack USD 174K-253KArtificial Intelligence | C++ | CSS | Data Storage | Data StructuresSenior-level Full TimeNew York, NY, USA9h ago
-
Senior Software Engineer, AI/ML, Creative Intelligence USD 174K-253KAd Creative Optimization | Ad creative | C++ | Creative Optimization | Data ProcessingSenior-level Full TimeMountain View, CA, USA9h ago
-
Databricks Solution Architect USD 180K-247KAWS S3 | Apache Spark | Autoscaling | Azure Data | Azure Data LakeSenior-level Full TimeUnited States R15h ago
-
Agentic Systems | Backend Development | Cloud Data | Cloud data warehousing | Cost OptimizationEquity | Remote workSenior-level Full TimeNew York, NY, United States15h ago
-
Lead Analytics Manager USD 120K-150KAffiliate Marketing | Business Intelligence | Dashboard Design | Data Ingestion | Data LiteracySenior-level Full TimeAustin, TX (remote); Dallas, TX (remote); … R16h ago
-
Perception Engineer USD 170K-275K2D vision | 3D Vision | C plus plus | Camera Calibration | Computer Vision401k | Dental insurance | End-of-year shutdown | Medical insurance | Mental health supportSenior-level Full TimeNew York, NY17h ago
-
Security Engineer (Embedded & Networking) USD 130K-175KApplication Firewall | C# | C++ | Cloud Security | GoExtended hours weekends as needed | Onsite work requirementMid-level Full TimeCape Canaveral, FL18h ago
-
Security Engineer (Embedded & Networking) USD 130K-180KAPI | Access Control | Access Management | Application Firewall | Authentication401k plan | Dental coverage | Disability insurance | Employee stock purchase plan | Life insuranceMid-level Full TimeHawthorne, CA18h ago
-
Senior Quantitative Developer USD 165K-240KAWS | Alerting | Amazon Kinesis | Cloud platform | Data Transformation401k match | Dental insurance | Hardware provided | Health insurance | Unlimited PTOSenior-level Full TimeNew York18h ago