Senior Data Platform Engineer
Tasks
- Act as Databricks SME
- Administer Databricks workspaces
- Design scalable data solutions
- Develop Databricks platform admin tools
- Ensure security high availability disaster recovery compliance
- Evaluate performance cost security scalability observability
- Implement automated testing deployment observability and monitoring
- Implement infrastructure-as-code
- Lead rapid prototyping and proof of concepts
- Manage CI/CD pipelines
- Monitor Databricks resources
- Operationalize data pipelines
- Optimize workflows for data engineering analysts and data scientists
- Oversee data engineering dev ecosystem
- Provide mentorship and technical guidance
- Provision and manage AWS resources
- Support data governance and data integrity
- Troubleshoot Databricks clusters catalogs users groups databases storage security
Perks/Benefits
Skills/Tech-stack
API Gateway | AWS | Batch Loading | CI/CD | Cause analysis | Change Data Capture | CloudFormation | CloudWatch | Compliance | Data Capture | Data Governance | Data Pipelines | Databricks | Datadog | Disaster Recovery | EC2 | ECS | EKS | ETL | GitHub | GitLab | High Availability | IAAC | IAM | Incremental loading | Lambda | Monitoring | Observability | Python | RDS | Root Cause Analysis | Root cause | S3 | SQL | Securit | Terraform | Troubleshooting | Unity Catalog | VPC
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R11d ago
-
Senior Machine Learning Engineer USD 120K-195KAnomaly Detection | Apache Beam | Apache Spark | BigQuery | CI/CD401k | Compassionate leave | Dental insurance | Discount Portal | HolidaysSenior-level Full TimeRemote - US R14h ago
-
AI Engineer (Hybrid @ Bellevue, WA or Remote @ Florida) USD 140K-160KAWS | Artificial Intelligence | Asyncio | Evals | Function Calling401k match | Disability benefits | Family leave | Health insurance | Life insuranceEntry-level Full TimeHybrid @ Bellevue, WA or Remote … R15h ago
-
Senior MLOps Platform Engineer {S} USD 120K-185KAWS EKS | Airflow | Amazon S3 | Argo CD | Batching401k match | Dental insurance | Employee assistance program | HSA contributions | Health insuranceSenior-level Full TimeColorado Springs, Colorado, United States R17h ago
-
Senior Machine Learning Engineer USD 108K-160KA/B | A/B Testing | AWS Lambda | Algolia | Amazon OpenSearch401k | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote US R17h ago
-
Senior Staff Engineer - Data Scientist USD 150K-190KAmazon Web Services | Anomaly Detection | Apache Airflow | Apache Kafka | Apache SparkContract-to-hire | Remote work | Travel opportunitiesSenior-level Full TimeRemote, REMOTE, United States R17h ago
-
Manager, Data Engineering USD 130K-166KAWS | Access Controls | Apache Airflow | Audit Logging | AzureCollaborative team culture | Remote work | Work-life balanceSenior-level Full TimeRemote, United States R18h ago
-
Senior Software Engineer - Data Platform USD 150K-195KAPIs | BigQuery | C++ | CI/CD | Cloud Storage401k company contribution | Disability insurance | Fertility and infertility benefits | Industry competitive PTO | Learning and development opportunitiesSenior-level Full TimeUnited States R19h ago
-
Senior Data Engineer (Remote, US) USD 140K-211KAirflow | Aiven | Apache Spark | BigQuery | CI/CD401k company contribution | Annual professional development fund | Be Well program | Paid volunteer service hours | Parental leaveSenior-level Full TimeRemote - United States R19h ago
-
Machine Learning Engineer USD 155K-228KAirflow | Amazon SageMaker | Apache Spark | Argo CD | Artificial IntelligenceHealthcare insurance | Paid parental leave | Paid personal time off | Paid sick time | Paid time offMid-level Full TimeRemote - US R20h ago
-
Data Engineer USD 104K-150KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOpsMid-level Full TimeRemote - USA, US R22h ago
-
Senior AI Engineer USD 170K-200KAgent systems | Agentic AI | Anthropic API | Automated evals | Backend architecture401k | Company-provided equipment | Comprehensive medical, dental and vision coverage | Disability insurance | Flexible vacation policySenior-level Full TimeRemote (United States) R1d ago
-
Data Solutions Engineer II USD 72K-115KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure SynapseMid-level Full TimeOhio WFH, United States R1d ago
-
Cloud Data Engineer USD 125K-205KApache Airflow | Apache Spark | Azure | CI/CD | ContainersFlexible work hours | Fully remote option | Occasional Evening CoverageMid-level Full TimeComerica Park, United States R1d ago
-
Sr AI Platform Specialist Solution Architect USD 206K-330KAnsible | CI/CD | Computer Vision | Data pipeline | Deep learningSenior-level Full TimeRemote US CA, United States R1d ago
-
Analytics Engineer - Remote USD 81K-138KCloud | Data Modeling | Data Warehousing | Data pipeline | Dimensional ModelingMid-level Full TimeHome, United States R1d ago
-
Analytics Engineer Sr - Remote USD 108K-184KBI tools | Cloud Computing | Data Architecture | Data Marts | Data WarehousingSenior-level Full TimeHome, United States R1d ago
-
API Integration | Apache Airflow | Apache Beam | Bash | BigQuerySenior-level Full TimeHome, United States R1d ago
-
Senior Database Site Reliability Engineer USD 120K-160KAlerting | Ansible | Automation | Azure | BashDental insurance | Disability insurance | Health insurance | Life insurance | Mentorship programSenior-level Full TimeUnited States - Remote R1d ago
-
Data Science AI Engineer, Advisor USD 117K-168KAWS | Azure | CMS | Cloud platform | Computer Vision401k employer match | Educational assistance | Flexible vacation policy | Fully remote | Health benefitsMid-level Full TimeAny city, NC, US, 99999 R1d ago
-
Senior Software Engineer, Data Platform USD 164K-227KAccess Control | Airflow | Amazon Kinesis | Amazon Redshift | Apache Flink401k match | Community volunteer time | Commuter benefit | Company-paid days off | Dental insuranceSenior-level Full TimeSan Francisco, CA, USA R1d ago
-
AI Research Engineer, Computer Vision USD 170K-210KAutoregressive models | CUDA | DDP | Data Pipelines | DeepSpeed401k retirement plan | Company equity | Dental insurance | Fertility support | Human Annotation SupportMid-level Full TimeRemote (U.S. or Canada) R1d ago
-
Senior AI Solutions Builder, People USD 134K-192KAgent Development | Artificial Intelligence | Automation | Coding | Data GovernanceSenior-level Full TimeRemote, United States R1d ago
-
Data Engineer USD 100KAPIs | Apache Kafka | Apache Spark | Azure | Azure Data401k match | Dental insurance | Life insurance | Medical insurance | Paid sick leaveEntry-level Full TimeRemote, US R1d ago
-
Senior Data Engineer USD 165K-175KAWS Glue | AWS Step Functions | Amazon Athena | Amazon EMR | Amazon KinesisEmployee discounts | Employee equity | Medical, dental & vision coverage | Unlimited PTOSenior-level Full TimeRemote - United States R1d ago