Senior Data Platform Engineer
Tasks
- Act as Databricks SME
- Administer Databricks workspaces
- Design scalable data solutions
- Develop Databricks platform admin tools
- Ensure security high availability disaster recovery compliance
- Evaluate performance cost security scalability observability
- Implement automated testing deployment observability and monitoring
- Implement infrastructure-as-code
- Lead rapid prototyping and proof of concepts
- Manage CI/CD pipelines
- Monitor Databricks resources
- Operationalize data pipelines
- Optimize workflows for data engineering analysts and data scientists
- Oversee data engineering dev ecosystem
- Provide mentorship and technical guidance
- Provision and manage AWS resources
- Support data governance and data integrity
- Troubleshoot Databricks clusters catalogs users groups databases storage security
Perks/Benefits
Skills/Tech-stack
API Gateway | AWS | Batch Loading | CI/CD | Cause analysis | Change Data Capture | CloudFormation | CloudWatch | Compliance | Data Capture | Data Governance | Data Pipelines | Databricks | Datadog | Disaster Recovery | EC2 | ECS | EKS | ETL | GitHub | GitLab | High Availability | IAAC | IAM | Incremental loading | Lambda | Monitoring | Observability | Python | RDS | Root Cause Analysis | Root cause | S3 | SQL | Securit | Terraform | Troubleshooting | Unity Catalog | VPC
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Quantum Cryptographic Engineer USD 160K-180KAutomated cryptographic discovery | CBOM | CNSA 2.0 | Compliance | Cryptographic discoveryRemote work | Secret clearanceMid-level Full TimeWork from home, VA, United States R13h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R21h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R1d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | Mathematics | NumPy | Number theoryFreelance opportunity | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R1d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R1d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R1d ago
-
API Integration | Agent systems | Asynchronous processing | Chunking | Cost OptimizationCompetitive salary based on experience | High-impact role | Opportunity to scale AI systems | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R1d ago
-
AI Full Stack Engineer - KS001 USD 160K-225KAds API | Agent systems | Anthropic Claude | Cost monitoring | EmbeddingsHigh-impact role | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R1d ago
-
Technical Architect - Machine Learning USD 165K-200KAKS | AWS | Async Programming | Autogen | AzureSenior-level Full TimeUSA - Remote, United States R1d ago
-
Senior Machine Learning Engineer USD 150K-185KAWS | Artifact management | Auditability | Azure | Batch inferenceDental insurance | Disability insurance | EAP | Life insurance | Medical insuranceSenior-level Full TimeCHICAGO, IL, USA R1d ago
-
Agile | CI | Economic Dispatch | Extreme programming | GitAdoption Assistance | Employee assistance program | Health benefits | Paid parental leave | Relocation assistanceSenior-level Full TimeBellevue WA US, United States R1d ago
-
Agile | CI | Documentation | Economic Dispatch | Git401k match | Adoption Assistance | Dental insurance | Employee assistance program | Health CoachSenior-level Full TimeBellevue WA US, United States R1d ago
-
ML Ops Engineer USD 174K-226KAWS | Cloud infrastructure | Cost Optimization | Data Ingestion | GCPHybrid work schedule | In-office at least 3 days per weekMid-level Full TimeSan Francisco HQ Office R1d ago
-
Machine Learning Engineer - 1 USD 130K-228KCNN | Cross-validation | Data Pipelines | Deep learning | Document processingEquity options | Flexible-hybrid work | Medical, dental & vision coverage | Professional development budget | Team offsitesNone Full TimeHybrid - San Mateo, California R1d ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R1d ago
-
AI/ML Engineer - Shared Services Automation-Remote USD 128K-200KAI Center | Agentic Frameworks | Azure | CI/CD | Cloud infrastructureDental insurance | FSA | HSA | Health insurance | Retirement planMid-level Full TimeRochester, MN, United States R1d ago
-
AI Software Engineer - Greenwood Village, CO Office USD 80K-120KAI Agents | API | Automation | C# | Computer VisionCollaborative environment | Comprehensive benefits package | Employee ownership | Flexible workplace | Innovative cultureEntry-level Full TimeGreenwood Village, Colorado, United States R1d ago
-
Sr. AI/ML Engineer - Shared Services Automation-Remote USD 145K-225KAI Center | AI Engineering | Azure | Cloud platform | Communications Mining100 percent remote work | Advancement opportunities | Continuing education | Dental insurance | Flexible spending accountSenior-level Full TimeRochester, MN, United States R1d ago
-
AI/ML Engineer - Revenue Cycle Automation-Remote USD 125K-171KAzure | Bias detection | Cloud infrastructure | Cloud platform | Data Engineering100 percent remote | Dental insurance | FSA | HSA | Health insuranceMid-level Full TimeRochester, MN, United States R1d ago
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Sr. Embedded Software Developer USD 130K-160KARM | Assembly | Bootloader development | C# | C++401k match | Employee assistance program | Medical, dental & vision coverage | Paid Holidays | Paid time offSenior-level Full TimeRemote (United States) R1d ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingFlexible work environment | Open office environment | Remote work | Team building eventsSenior-level Full TimeMinnesota R1d ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Team building eventsMid-level Full TimeMassachusetts R1d ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeIdaho R1d ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Remote work | Team building eventsSenior-level Full TimeIllinois R1d ago