Senior Data Platform Engineer
Tasks
- Act as Databricks SME
- Administer Databricks workspaces
- Design scalable data solutions
- Develop Databricks platform admin tools
- Ensure security high availability disaster recovery compliance
- Evaluate performance cost security scalability observability
- Implement automated testing deployment observability and monitoring
- Implement infrastructure-as-code
- Lead rapid prototyping and proof of concepts
- Manage CI/CD pipelines
- Monitor Databricks resources
- Operationalize data pipelines
- Optimize workflows for data engineering analysts and data scientists
- Oversee data engineering dev ecosystem
- Provide mentorship and technical guidance
- Provision and manage AWS resources
- Support data governance and data integrity
- Troubleshoot Databricks clusters catalogs users groups databases storage security
Perks/Benefits
Skills/Tech-stack
API Gateway | AWS | Batch Loading | CI/CD | Cause analysis | Change Data Capture | CloudFormation | CloudWatch | Compliance | Data Capture | Data Governance | Data Pipelines | Databricks | Datadog | Disaster Recovery | EC2 | ECS | EKS | ETL | GitHub | GitLab | High Availability | IAAC | IAM | Incremental loading | Lambda | Monitoring | Observability | Python | RDS | Root Cause Analysis | Root cause | S3 | SQL | Securit | Terraform | Troubleshooting | Unity Catalog | VPC
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Engineer (remote) USD 85K-100KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data Factory401k match | Employee assistance program | Flexible schedule | Health insurance | Paid parental leaveMid-level Full TimeWork From Home, United States R6h ago
-
Data Engineer (Analytics) USD 191K-235KBig Data | Data Modeling | Data Warehousing | Data integration | Dimensional ModelingDomestic and international travel | TelecommutingMid-level Full TimeMenlo Park, CA | Remote, US R11h ago
-
Software Engineer II - Abnormal Data Platform USD 149K-214KAerospike | Amazon DynamoDB | Apache Spark | Data Storage | DatabricksDistributed team collaboration | Remote work | Technical mentorshipMid-level Full TimeRemote - USA R19h ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data mesh | Databricks | Delta Lake | ETL401k | Health insurance | Hybrid work | Paid time off | Remote workSenior-level Full TimeRemote-MO, United States R22h ago
-
Data Engineer II USD 63K-114KData Processing | ETL | Real Time | Real-time Data | Real-time Data Processing401k | Flexible work schedule | Health insurance | Paid time off | Tuition reimbursementMid-level Full TimeRemote-MN, United States R22h ago
-
Senior AI and LLM Engineer USD 184K-356KData-driven | Data-driven metrics | Deep learning | Generative AI | Language ModelsEquity | Hybrid workSenior-level Full TimeUS, CA, Remote, United States R22h ago
-
Scientist III, Data Engineer USD 161K-186KACID | API Gateway | AWS API | AWS API Gateway | AWS CodePipeline401k | Accident insurance | Commuter benefits | Dental insurance | Employee assistance programSenior-level Full TimeUS - Waltham, MA - 168 … R22h ago
-
Sr Engineer, Data Integration USD 101K-175K.NET | Azure | Cloverleaf Interface Engine | Csharp | EDIHealthcare benefits | Incentive programs | Professional development | Remote work | Retirement benefitsSenior-level Full TimeWork at Home - Ohio - … R22h ago
-
Data Warehouse Engineer USD 46K-60KCorepoint | Data Modeling | Data Quality | Data Validation | Data Warehousing401k match | Dental insurance | Discount programs | Employee counseling | FSAEntry-level Full TimeRemote, United States R1d ago
-
Sr Sales Engineer, West USD 160K-196KAnalytics | Apache Spark | Artificial Intelligence | Dataiku | Kubernetes401k match | Dental insurance | Employer paid disability coverage | Flexible spending accounts | Medical insuranceSenior-level Full TimeUnited States, Remote R1d ago
-
Data Engineer USD 129K-178KApache Kafka | Apache Spark | Cloud Platforms | Data Compliance | Data GovernanceMid-level Full TimeUS - Remote R1d ago
-
AI Engineer USD 53K-119KAPI Design | Cost Optimization | Embeddings | Evaluation | JSONDental insurance | Gym stipend | Health insurance | Medical membership | Offsite retreatsSenior-level Full TimeRemote, US R1d ago
-
Android Development | C Sharp | C plus plus | C# | Command LineMid-level Full TimeMountain View, CA, US; Redmond, WA, … R1d ago
-
Senior Machine Learning Engineer, Operations Research USD 173K-218KCombinatorial Optimization | Deep learning | Keras | Machine Learning | Mathematical ProgrammingAnnual refresh grants | Equity grant | Flexible work policy | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Engineer, Chakra USD 120K-235KAgentic AI | Benchmarking | Conversational AI | Data Pipelines | Deep learningMid-level Full TimeHybrid in Santa Clara, CA R1d ago
-
Senior Customer Solutions Engineer - US USD 111K-176KAPI Scripting | Access Tokens | Active Directory | Airflow | Azure Active Directory401k plan | Flexible stipends | Health and wellness stipend | Healthcare coverage | Home office setup stipendSenior-level Full TimeUS - Remote R1d ago
-
Analytics Engineer USD 125K-150KAmazon Redshift | Business Intelligence | DBT | Data Modeling | Data VisualizationCaregiver support | Company holidays | Dental insurance | Fertility benefits | Flexible PTOMid-level Full TimeRemote - USA R1d ago
-
Machine Learning & Game Tech Architect USD 186K-257KAPI Design | C# | C++ | Game engines | Go401k matching | Dental insurance | Flexible schedule | Flexible working hours | Health insuranceSenior-level Full TimeBoston, MA, United States R1d ago
-
Machine Learning Engineer, Integrity USD 120K-235KAdversarial Machine Learning | Anomaly Detection | Audio analysis | Behavioral analytics | BenchmarkingMid-level Full TimeHybrid in Santa Clara, CA R1d ago
-
Sr. Staff Software Engineer, Data Product Platform USD 208K-429KAI coding | AI coding tools | AI-assisted analytics | Apache Airflow | Apache SupersetEquity | Flexible work modelSenior-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Intern, Machine Learning & AI USD 80K-120KComputer Vision | Data Analysis | Deep learning | Embeddings | GDALAccess to LinkedIn Learning | Commuter benefits | Internet reimbursement | Paid time offEntry-level InternshipSan Francisco, CA R1d ago
-
Principal Machine Learning & Data Engineer USD 184K-271KA/B | A/B Testing | AWS | Autoscaling | B testing401k | Healthcare | Paid parental leave | Paid sick time | Paid time offSenior-level Full TimeRemote - US R1d ago
-
Data Engineer (remote) USD 85K-100KAgile | Apache Hive | Apache Impala | Apache Spark | Artificial Intelligence401k match | Employee assistance program | Flexible schedule | Health insurance | Life insuranceMid-level Full TimeWork From Home, United States R1d ago
-
Embedded Software Engineer I USD 106K-170KAlgorithms | C# | C++ | Code Quality | Data StructuresDiscretionary paid time off | Emotional & mental wellness support | Fitness programs | Learning and development programs | Medical, dental, vision plansMid-level Full TimeSeattle, Washington, United States R1d ago
-
Senior Forward Deployed AI Engineer (Remote Eligible) USD 227K-245KAWS Bedrock | Agent Framework | Agent Orchestration | Cloud infrastructure | Databricks401k match | Dental insurance | Flexible time off | Health insurance | Life insuranceSenior-level Full Time-REMOTE, USA- R1d ago