Staff Data Platform Engineer
Tasks
- Collaborate with data producers and consumers
- Deploy and maintain data platform infrastructure
- Design data platform infrastructure
- Design data system architecture
- Ensure data platform security
- Gather requirements and provide technical guidance
- Improve scalability, reliability, and performance
- Manage and optimize Databricks platform
- Optimize data platform cost
- Optimize data platform performance
- Resolve data platform incidents
- Stay current with big data technologies cloud computing and DevOps
- Troubleshoot Databricks issues
Perks/Benefits
Skills/Tech-stack
AWS | AWS IAM | Amazon EC2 | Amazon S3 | Apache Spark | Azure | CI/CD | Cloud platform | Data Governance | Databricks | Delta Lake | Google Cloud | Google Cloud Platform | Infrastructure as Code | Networking | PySpark | Spark SQL | Spark Streaming | Terraform | Unity Catalog | VPC | “as-code”
Education
Related jobs
-
Analytics Engineer USD 140K-190KCI/CD | DBT | Data Modeling | Data Quality | Data Testing401k match | Flexible time off | Growth opportunities | Health benefits | Remote-friendlySenior-level Full TimeUnited States (Remote) R11h ago
-
Analytics Engineer USD 110K-120KAmazon Redshift | BigQuery | Data Modeling | Data Pipelines | DatabricksCareer progression | Cross-functional collaboration | Equity | Remote-first workMid-level Full TimeRemote, United States R12h ago
-
Software Engineer, Data Integration USD 165K-225KAWS | Automated testing | Azure | Cloud Computing | Data IngestionSenior-level Full TimeRemote - US Only R12h ago
-
Software Engineer - AI Developer Productivity USD 165K-330KAudit Logging | Authentication | Authorization | CI/CD | Context ManagementCompany facilitated 401k | Fertility and family building stipend | Flexible PTO | Medical dental vision insurance 100 percent | Paid parental leaveSenior-level Full TimeSan Francisco R13h ago
-
Automated testing | Build Automation | C++ | CI/CD | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractDallas, Texas, USA R14h ago
-
AWS | AWS EC2 | Automation | Azure | Azure Virtual401k match | ESPP | Family leave programs | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R14h ago
-
Principal, Data Analyst/BI Engineer USD 108K-145KAWS | BigQuery | Cloud platform | Data Governance | Data Modeling401k match | Healthcare Dental Vision | Paid Holidays | Paid time off | Parental leaveSenior-level Full TimeUnited States R14h ago
-
Sr. Analytics Engineer/ Data Scientist USD 205K-249KAirflow | Amazon Redshift | Anomaly Detection | BigQuery | CI/CD401k | Bi annual company offsites | Commuter stipend | Dental insurance | EquitySenior-level Full TimeSan Francisco, CA R14h ago
-
AWS | Azure | CI/CD | Cloud platform | Containers401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R15h ago
-
Automated testing | C++ | CI/CD | Embedded Linux | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractTampa, Florida, USA R15h ago
-
Automated testing | C++ | CI/CD | Firmware Build | Firmware Testing401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractAtlanta, Georgia, USA R15h ago
-
Principal Software Engineer, Data USD 190K-210KAgentic coding | Amazon Kinesis | Apache Pulsar | Containerization | Data ModelingPTO | Remote workSenior-level Full TimeBoston, MA / Remote R17h ago
-
Principal Data Engineer USD 190K-210KAmazon Kinesis | Apache Pulsar | Containerization | Data Modeling | Event ProcessingEquity | PTO | Remote workSenior-level Full TimeBoston, MA / Remote R17h ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS IoTHealthcare | PTO | Paid Holidays | Phone stipend | Wellness stipendSenior-level Full TimeSan Carlos - Hybrid R17h ago
-
Data Engineer USD 130K-150KAlerting | Apache Spark | Azure | Azure DevOps | CI/CDFree on-site gym | Free parking | Free pet insurance | Hybrid remote work | Medical/Dental/Vision insuranceMid-level Full TimeSeattle, United States R17h ago
-
Data Engineer USD 133K-159KBigQuery | Cloud platform | DBT | Data Governance | Data Modeling401k match | Employee assistance program | Employee stock purchase program | Family planning support | Flexible vacationMid-level Full TimeSan Francisco, CA R18h ago
-
Senior Machine Learning Engineer USD 225K-300KActive Learning | Agentic Systems | CI/CD | Containerization | Docker401k match | Company off-sites | Dental insurance | Equipment provisioning | Flexible time offSenior-level Full TimeSan Francisco R18h ago
-
AWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftCollaborative environment | Mentorship and growth | Mission-driven impactEntry-level Full TimeVaughan, Ontario; Remote, Canada; Remote, US … R18h ago
-
Senior-level Full TimeAnnapolis Junction, United States R20h ago
-
Backend & Data Developer (.NET Core / Cloud) USD 115K-150KAWS | AWS Lambda | Alteryx | Amazon Athena | Amazon RedshiftSenior-level Full TimeCenter, Center District, IL R21h ago
-
Full-stack AI Application Engineer USD 160K-220KArtificial Intelligence | Deep learning | JavaScript | Language Models | Large Language ModelsRemote-friendlyMid-level Full TimeBerkeley CA R1d ago
-
Data Engineer USD 100K-132KAWS | Apache Airflow | Apache Spark | Azure | BigQuery401k plan | Dental insurance | Health insurance | Remote work options | Unlimited PTOMid-level Full TimeNew York, NY R1d ago
-
Analytics Engineer USD 115K-149KAirflow | BI Semantic Layer | CI/CD | DAX | DBT401k plan | Catered lunches | Dental insurance | Medical insurance | Onsite fitness centerSenior-level Full TimeIndianapolis, IN R1d ago
-
Specialist Solutions Architect - Data Engineering & Warehousing (Digital Native Business) USD 180K-247KAWS | Anomaly Detection | Apache Kafka | Automated Ingestion | AzureConference presentations | Hackathons | Mentorship | Remote work | Training programsSenior-level Full TimeUnited States R1d ago
-
Senior AWS Data Engineer USD 153K-207KAPI Integration | AWS Batch | AWS CloudTrail | AWS Glue | AWS LambdaRemote workSenior-level Full TimeMountain View, CA, US R1d ago