Databricks Platform & Database Engineer
Arlington, Virginia, United States of America
USD 136K-177K Senior-level Full Time
Tasks
- Administer Databricks workspaces on AWS
- Administer DynamoDB and other NoSQL databases
- Administer relational databases on AWS and on premises
- Author operational runbooks for 247 operations
- Automate cluster and job lifecycle operations
- Build Terraform infrastructure as code for Databricks and databases
- Design end to end data workflows and pipelines
- Enforce cluster policies and workspace hardening
- Implement CI CD for platform configuration
- Implement encryption in transit and at rest
- Ingest data into Databricks from relational and NoSQL sources
- Lead root-cause analysis and incident response
- Manage Unity Catalog objects and permissions
- Manage audit logs and lineage
- Manage backups replication patching and failover
- Monitor and optimize clusters and SQL warehouses
- Perform workspace upgrades and migrations
- Set up monitoring and alerting
- Troubleshoot Spark performance issues
Perks/Benefits
Skills/Tech-stack
AWS | Access Control | Alerting | Amazon Aurora | Auto Loader | CI/CD | Database Auditing | Databricks | Delta Lake | DynamoDB | Encryption | Failover | Kafka | Lakehouse | Monitoring | MySQL | Networking | PostgreSQL | PySpark | Python | Query Optimization | Replication | SQL Server | Spark | Stored Procedures | Terraform | Unity Catalog
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R22d ago
-
Principal AI Engineer (Remote) USD 128K-200KAPI Gateways | Agent Orchestration | Artificial Intelligence | BigQuery | By DesignAfter hours incident support | Occasional overtime | Occasional travel | Remote workSenior-level Full TimeOak Brook, IL, United States R6h ago
-
12-Factor | 12-factor apps | API LED | API-led integration | AWSSenior-level Full TimeDearborn, United States8h ago
-
Infrastructure Engineer USD 180K-250KAWS | Azure | Docker | GCP | GPU ComputingOnsite in SF Bay Area | Relocation supportEntry-level Full TimeSan Francisco, CA, US8h ago
-
APIs | AWS | Agentic AI | Azure | Claude401k | Dental insurance | Fully remote US based | Generous PTO | HolidaysSenior-level Full TimeRemote USA, United States R9h ago
-
Staff Data Engineer USD 190K-250KAWS | Agent systems | Airflow | Alation | Amazon KinesisDental insurance | Flexible working hours | Health insurance | Hybrid options | Learning resourcesSenior-level Full TimeDallas, TX, United States9h ago
-
Staff Software Engineer USD 190K-250KAPI Design | AWS | Autogen | Azure | C#Dental insurance | Flexible working hours | Growth and learning resources | Health insurance | Hybrid optionsSenior-level Full TimeChicago, IL, United States9h ago
-
Staff Software Engineer USD 190K-250KAWS | Autogen | Azure | C# | CI/CDDental insurance | Flexible working hours | Health insurance | Hybrid options | Learning resourcesSenior-level Full TimeChicago, IL, United States9h ago
-
Staff Software Engineer USD 190K-250KAPI Design | AWS | Autogen | Azure | C#Dental insurance | Flexible working hours | Health insurance | Hybrid options | Learning resourcesSenior-level Full TimeChicago, IL, United States9h ago
-
.NET | ArgoCD | Automation | Bash | C#Mid-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …9h ago
-
AWS | Agile | Apache Hive | Apache Spark | Cloudera Data PlatformRemote workSenior-level ContractLincoln, United States R9h ago
-
12V Battery - Data Analytics Engineer USD 86K-144KCAN bus | Cause analysis | Data Engineering | Data analytics | Data loggingMid-level Full TimeAuburn Hills, MI, United States9h ago
-
AI & Machine Learning Engineer USD 98K-140KAmazon Web Services | Apache Kafka | Azure | C++ | CI/CD401k match | Company paid life insurance | Medical, dental, and vision insurance | Paid Holidays | Paid time offMid-level Full TimeUSA-WISCONSIN-Green Bay10h ago
-
Data Engineer, Technical Leadership (Ranking, AI) USD 182K-235KAI workflows | Data Architecture | Data Governance | Data Modeling | Data QualitySenior-level Full TimeMenlo Park, CA11h ago
-
Software Engineer, SystemML - AI Networking USD 170K-287KC# | C++ | CUDA | Data-parallel | Distributed Data ParallelMid-level Full TimeMenlo Park, CA11h ago
-
Senior Performance Co-Design Engineer, LLM Serving USD 174K-252KC++ | Co-design | Computer Architecture | Deep learning | Deep learning inferenceSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Staff Software Engineer, YouTube Ads Machine Learning USD 207K-300KData Processing | Data Storage | Distributed Computing | Embeddings | Fine TuningBonus | Equity | Health insurance | Paid time off | Retirement plansSenior-level Full TimeMountain View, CA, USA11h ago
-
Automated testing | C# | C++ | CI/CD | Continuous DeploymentMid-level Full TimeMountain View, CA, USA11h ago
-
Data Processing | Debugging | Distributed Computing | Information Retrieval | Language ModelsSenior-level Full TimeSunnyvale, CA, USA11h ago
-
C++ | Data Processing | Debugging | Generative AI | Google CloudHealth insurance | Learning and development opportunities | Paid time off | Relocation assistance | Retirement planSenior-level Full TimeMountain View, CA, USA11h ago
-
C++ | Data Processing | Debugging | Language Models | Language ProcessingSenior-level Full TimeMountain View, CA, USA11h ago
-
Senior Software Engineer, AI/ML GenAI, Google Workspace USD 174K-252KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-252KAlgorithms | C# | C++ | Cloud Computing | Data IntegritySenior-level Full TimeNew York, NY, USA11h ago
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-210KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Senior Performance Co-design Engineer, LLM Training USD 174K-252KC++ | Co-design | Computer Architecture | Data parallelism | Distributed TrainingSenior-level Full TimeSunnyvale, CA, USA11h ago