Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark
San Diego, CALIFORNIA, United States
R
USD 181K-317K Senior-level Full Time
Tasks
- Architect and build distributed platform components
- Build and operate data lake solutions
- Deliver clean modular reusable code
- Design scalable data ingestion pipelines
- Enforce engineering best practices
- Lead complex technical initiatives
- Provide technical leadership for high complexity projects
- Research and adopt new technologies
- Troubleshoot complex production issues
Perks/Benefits
- 401k matching
- ESPP
- Family leave programs
- Flexible spending accounts
- Flexible time away
- Health plans
- Matching donations
Skills/Tech-stack
Apache Iceberg | Apache Spark | Avro | Concurrency | Data Ingestion | Data Lake | Data Modeling | DevOps | Distributed Systems | Garbage Collection | JVM | Java | Kafka | Metadata Management | Networking | ORC | Parquet | Profiling | Query engines | Schema evolution | Stream processing
Education
Regions
Countries
States
Cities
Related jobs
-
Data Platform Software Engineer USD 125K-194KCI/CD | Cloud Computing | Data Lakes | Data Modeling | Data Structures401k match | ESPP | Family leave programs | Flexible time off | Health plansEntry-level Full TimeSan Diego, CALIFORNIA, United States R4h ago
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R5h ago
-
Lead GenAI Engineer USD 150K-170KAgile | Azure | Cloud platform | Containerization | Cybersecurity401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilitySenior-level ContractMinneapolis, Minnesota, USA R7h ago
-
Agent systems | Agentic Workflows | Amazon Web Services | Azure | C#Customer site travel | Remote workSenior-level Contract Full TimeJersey City, NJ, United States R13h ago
-
AWS Glue | Amazon RDS | Amazon Redshift | Amazon S3 | Artificial Intelligence401k matching | Certification programs | Disability insurance | Employee resource groups | Fertility coverageEntry-level Full TimeRichmond, VA, United States R16h ago
-
Senior Software Engineer, Decision Intelligence Platform USD 180K-225KCloud Computing | Data Modeling | Data Pipelines | Data Quality | Distributed SystemsEquity compensation | Hybrid work option | Medical benefits | Onsite collaboration daysSenior-level Full TimeSeattle, Washington United States, United States R1d ago
-
PAHO Consultant - Data, Analytics, and AI (ITS) USD 53K-53KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeOff Site, United States R1d ago
-
Staff Software Engineer-AI Solutions USD 131K-210KAJAX | Agentic AI | Artificial Intelligence | Business Rules | CMDB401k | Dental insurance | FSA/HSA | Hybrid work | Life insuranceSenior-level Full TimeAshburn, VA, United States R1d ago
-
Big Data Engineer USD 90K-110KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 86K-103KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseCareer growth potential | Direct W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior SIEM Data Engineer USD 680K-1445KApache Kafka | Batch Processing | CI/CD | CIM | Cribl StreamSenior-level Full TimeQuincy, Massachusetts, United States R1d ago
-
AI Data Engineer USD 80K-100KApache Beam | Apache Spark | CI/CD | Code review | Data LineageCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 140K-180KAWS | Access Management | Amazon Redshift | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Quantitative Engineer USD 150K-185KC++ | Concurrency | Data Systems | FIX | High PerformanceCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Model Serving Engineer USD 74K-98KAutoscaling | C plus plus | Capacity Planning | Distributed Systems | GPU ArchitectureRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI/ML Engineer SME USD 195K-264K800-53 | AWS | AWS Cloud | AWS Cloud Development Kit | AWS SageMakerSenior-level Full TimeUSA LA Home Office (LAHOME), United … R1d ago
-
Data Engineer II USD 92K-147KApache Spark | Cloud Computing | Data Modeling | Data Testing | Data Validation401k match | Fitness reimbursement | Flexible work/hybrid | Paid time off | Tuition reimbursementMid-level Full TimeO'Fallon, Missouri (Main Campus), United States R1d ago
-
Lead Data Engineer USD 140K-231KAWS | Apache Airflow | Apache Spark | Automated testing | AvroFitness reimbursement | Paid leave | Tuition reimbursementSenior-level Full TimeO'Fallon, Missouri (Main Campus), United States R1d ago
-
Artificial Intelligence & Machine Learning Architect SME USD 195K-264K800-53 | AWS CloudFormation | AWS SageMaker | Airflow | Artificial IntelligenceSenior-level Full TimeUSA LA Home Office (LAHOME), United … R1d ago
-
Data Incident and Problem Management Analyst USD 128K-173KAgile | Amazon QuickSight | Amazon Web Services | Cause analysis | Confluence401k match | Bereavement leave | Critical Illness Insurance Options | Health savings account options | HolidaysMid-level Full TimeUSA DC Home Office (DCHOME), United … R1d ago
-
Senior Manager, Data Platform Engineering USD 175K-195KAWS | AWS Glue | Amazon Athena | Apache Airflow | Apache Iceberg401k match | Company holidays | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeUnited States R1d ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R3d ago
-
AIOps | Anomaly Detection | Anthos | CRD | Control Plane401k plan | Basic life insurance | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeResearch Triangle Park, North Carolina, United … R3d ago
-
Staff Data Engineer USD 162K-224KAmazon Managed Workflows for Apache Airflow | Apache Airflow | Apache Druid | Apache Iceberg | CCPA401k employer match | Annual WIN bonus | Flexible vacation | Mental health resources | Paid HolidaysSenior-level Full TimeU.S. Remote R3d ago