Data Platform Engineer, Senior Staff
San Diego, California, United States of America
USD 158K-237K Senior-level Full Time
Tasks
- Build and support end to end data pipelines
- Define and monitor SLIs and SLOs for reliability and data quality
- Design and build scalable distributed data platform systems
- Develop and maintain CI CD pipelines for data workloads
- Drive continuous improvement across platform architecture and tooling
- Implement infrastructure-as-code using Terraform
- Implement security, compliance, and governance controls
- Lead incident response and post-mortems
- Mentor engineers and influence platform standards and best practices
- Operate and optimize Amazon EKS clusters
- Own Databricks workspace architecture and governance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS IAM | AWS Networking | Amazon EKS | Amazon S3 | Amazon Web Services | Bash | CI/CD | Data Governance | Data Ingestion | Data Pipelines | Data Quality | Databricks | Databricks Lakehouse | Delta Lake | Distributed Systems | GitHub Actions | HashiCorp Vault | Helm | Incident Management | Infrastructure as Code | Jenkins | MLflow | NoSQL | OPA | Observability | On-Call | OpenTelemetry | Policy-as-Code | Python | SLI/SLO | SQL | Scripting | Secret management | Security Compliance | System design | Terraform | Unity Catalog | Web Services | “as-code”
Regions
Countries
States
Cities
Related jobs
-
ABAC | Access Control | Airflow | Apache Spark | Attribute Based FilteringSenior-level Full TimeHouston, TX, United States6h ago
-
ABAC | Airflow | Apache Spark | Automated testing | Azure DevOpsSenior-level Full TimeHouston, TX, United States6h ago
-
AI Developer USD 100K-165KAI Document Intelligence | API | AWS Lambda | Agent Framework | App ServiceMid-level Full TimeCenter, Center District, IL7h ago
-
Data Engineer (Senior) USD 170K-225KAmazon Web Services | Apache NiFi | Apache Spark | Data Pipelines | Data VisualizationSenior-level Full TimeHuntsville, United States7h ago
-
Agent deployment | Agile | Automation | Azure AD | Azure MonitorKnowledge transfer | Long-term contract | Onsite 3 days per weekSenior-level ContractDeerfield Beach, United States8h ago
-
Senior Manager / Principal Data Science USD 155K-178KAI Agents | Dashboards | Data Pipelines | Data Visualization | LLMHybrid workSenior-level ContractDeerfield Beach, United States8h ago
-
API Development | AWS | Airflow | BigQuery | Cloud ComputingMid-level Full TimeDearborn, United States8h ago
-
Apache Spark | Cloud Computing | Data Governance | Data Lineage | Data WarehousingSenior-level Full TimeTexas-Austin8h ago
-
Gen AI Developer Specialist USD 118K-204KAWS | Access Management | Agents | Alerting | Amazon BedrockSenior-level Full TimeUnited States8h ago
-
GenAI Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Pipelines | Docker | Generative AISenior-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Generative AI Engineer III USD 110K-218KArtificial Intelligence | Data Pipelines | Docker | Kubernetes | Language ModelsSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …9h ago
-
Senior Software Engineer, Cloud, ML Infrastructure USD 174K-253KC++ | Co-design | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Senior Software Engineer, Managed Spark, OpenSource USD 174K-253KApache Hudi | Apache Iceberg | Benchmarking | C++ | CloudSenior-level Full TimeSunnyvale, CA, USA10h ago
-
AI/ML | AI/ML Pipelines | Data Architecture | Data Ingestion | Data LakeSenior-level Full TimeAustin, TX, USA; New York, NY, …10h ago
-
Staff Software Developer, AI/ML, Safety and Security USD 207K-301KClassification | Computer Vision | Data Processing | Debugging | Fine TuningSenior-level Full TimeWaterloo, ON, Canada; New York, NY, …10h ago
-
Artificial Intelligence | C++ | Data Analysis | Data Storage | Data VisualizationSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Senior Software Engineer, Storage AI/ML USD 174K-253KAlgorithms | Benchmarking | Cloud Storage | Data Structures | Deep learningSenior-level Full TimeSeattle, WA, USA10h ago
-
Senior Software Engineer, AI/ML Computer Vision, XR USD 174K-253KComputer Vision | Computer Vision Systems | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSan Jose, CA, USA10h ago
-
Senior Staff Software Engineer, Cloud AI, Full Stack USD 262K-365KC++ | CSS | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Senior Software Engineer, Google Cloud AI, Full Stack USD 174K-253KArtificial Intelligence | C++ | CSS | Data Storage | Data StructuresSenior-level Full TimeNew York, NY, USA10h ago
-
Senior Software Engineer, AI/ML, Creative Intelligence USD 174K-253KAd Creative Optimization | Ad creative | C++ | Creative Optimization | Data ProcessingSenior-level Full TimeMountain View, CA, USA10h ago
-
Senior AI/ML Technical Lead (TS/SCI) USD 160K-180KContainerization | DevOps | Docker | Git | Hugging Face401k matching | Dental insurance | Flexible spending accounts | Health insurance | Paid HolidaysSenior-level Full TimeAlexandria, VA, US12h ago
-
Databricks Solution Architect USD 180K-247KAWS S3 | Apache Spark | Autoscaling | Azure Data | Azure Data LakeSenior-level Full TimeUnited States R16h ago
-
Agentic Systems | Backend Development | Cloud Data | Cloud data warehousing | Cost OptimizationEquity | Remote workSenior-level Full TimeNew York, NY, United States17h ago
-
Lead Analytics Manager USD 120K-150KAffiliate Marketing | Business Intelligence | Dashboard Design | Data Ingestion | Data LiteracySenior-level Full TimeAustin, TX (remote); Dallas, TX (remote); … R18h ago