Senior Data Platform Engineer
Tasks
- Act as Databricks SME
- Administer Databricks workspaces
- Design scalable data solutions
- Develop Databricks platform admin tools
- Ensure security high availability disaster recovery compliance
- Evaluate performance cost security scalability observability
- Implement automated testing deployment observability and monitoring
- Implement infrastructure-as-code
- Lead rapid prototyping and proof of concepts
- Manage CI/CD pipelines
- Monitor Databricks resources
- Operationalize data pipelines
- Optimize workflows for data engineering analysts and data scientists
- Oversee data engineering dev ecosystem
- Provide mentorship and technical guidance
- Provision and manage AWS resources
- Support data governance and data integrity
- Troubleshoot Databricks clusters catalogs users groups databases storage security
Perks/Benefits
Skills/Tech-stack
API Gateway | AWS | Batch Loading | CI/CD | Cause analysis | Change Data Capture | CloudFormation | CloudWatch | Compliance | Data Capture | Data Governance | Data Pipelines | Databricks | Datadog | Disaster Recovery | EC2 | ECS | EKS | ETL | GitHub | GitLab | High Availability | IAAC | IAM | Incremental loading | Lambda | Monitoring | Observability | Python | RDS | Root Cause Analysis | Root cause | S3 | SQL | Securit | Terraform | Troubleshooting | Unity Catalog | VPC
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Principal Data Engineer USD 200K-240KAWS | Agentic Workflows | Anomaly Detection | Batch pipelines | CCPA401k plan | Commuter benefits | Flexible vacation | Life insurance | Long-term disabilitySenior-level Full TimeBoulder, Colorado or New York City, … R2h ago
-
Senior Data Engineer USD 150K-165KAPIs | AWS | Automation | CI/CD | Data Pipelines401k matching | Birthday day off | Fitness stipend | Floating holidays | Health benefitsSenior-level Full TimeUnited States R9h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeChicago, IL R13h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDenver, CO R13h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | Azure | C++401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeHouston, TX R13h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | C plus plus | Cassandra401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDallas, TX R13h ago
-
Quantum Cryptographic Engineer USD 160K-180KAutomated cryptographic discovery | CBOM | CNSA 2.0 | Compliance | Cryptographic discoveryRemote work | Secret clearanceMid-level Full TimeWork from home, VA, United States R14h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R22h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R1d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | Mathematics | NumPy | Number theoryFreelance opportunity | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R1d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R1d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R1d ago
-
API Integration | Agent systems | Asynchronous processing | Chunking | Cost OptimizationCompetitive salary based on experience | High-impact role | Opportunity to scale AI systems | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R1d ago
-
AI Full Stack Engineer - KS001 USD 160K-225KAds API | Agent systems | Anthropic Claude | Cost monitoring | EmbeddingsHigh-impact role | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R1d ago
-
Technical Architect - Machine Learning USD 165K-200KAKS | AWS | Async Programming | Autogen | AzureSenior-level Full TimeUSA - Remote, United States R1d ago
-
Senior Machine Learning Engineer USD 150K-185KAWS | Artifact management | Auditability | Azure | Batch inferenceDental insurance | Disability insurance | EAP | Life insurance | Medical insuranceSenior-level Full TimeCHICAGO, IL, USA R1d ago
-
Agile | CI | Economic Dispatch | Extreme programming | GitAdoption Assistance | Employee assistance program | Health benefits | Paid parental leave | Relocation assistanceSenior-level Full TimeBellevue WA US, United States R1d ago
-
Agile | CI | Documentation | Economic Dispatch | Git401k match | Adoption Assistance | Dental insurance | Employee assistance program | Health CoachSenior-level Full TimeBellevue WA US, United States R1d ago
-
ML Ops Engineer USD 174K-226KAWS | Cloud infrastructure | Cost Optimization | Data Ingestion | GCPHybrid work schedule | In-office at least 3 days per weekMid-level Full TimeSan Francisco HQ Office R1d ago
-
Machine Learning Engineer - 1 USD 130K-228KCNN | Cross-validation | Data Pipelines | Deep learning | Document processingEquity options | Flexible-hybrid work | Medical, dental & vision coverage | Professional development budget | Team offsitesNone Full TimeHybrid - San Mateo, California R1d ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R1d ago
-
AI/ML Engineer - Shared Services Automation-Remote USD 128K-200KAI Center | Agentic Frameworks | Azure | CI/CD | Cloud infrastructureDental insurance | FSA | HSA | Health insurance | Retirement planMid-level Full TimeRochester, MN, United States R1d ago
-
AI Software Engineer - Greenwood Village, CO Office USD 80K-120KAI Agents | API | Automation | C# | Computer VisionCollaborative environment | Comprehensive benefits package | Employee ownership | Flexible workplace | Innovative cultureEntry-level Full TimeGreenwood Village, Colorado, United States R1d ago
-
Sr. AI/ML Engineer - Shared Services Automation-Remote USD 145K-225KAI Center | AI Engineering | Azure | Cloud platform | Communications Mining100 percent remote work | Advancement opportunities | Continuing education | Dental insurance | Flexible spending accountSenior-level Full TimeRochester, MN, United States R1d ago
-
AI/ML Engineer - Revenue Cycle Automation-Remote USD 125K-171KAzure | Bias detection | Cloud infrastructure | Cloud platform | Data Engineering100 percent remote | Dental insurance | FSA | HSA | Health insuranceMid-level Full TimeRochester, MN, United States R1d ago