Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark
San Diego, CALIFORNIA, United States
R
USD 181K-317K Senior-level Full Time
Tasks
- Architect and deliver distributed platform components
- Build high-performance distributed systems
- Create foundational libraries and frameworks
- Deliver clean modular reusable code
- Design and build data ingestion pipelines
- Enforce engineering best practices
- Lead complex technical initiatives
- Provide technical leadership for high risk projects
- Research and adopt new platform technologies
- Troubleshoot complex production issues
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency | Data Ingestion | Data Ingestion Pipelines | Data Lake | Exactly once | Exactly-once semantics | Fault Tolerance | High Availability | Ingestion pipelines | JVM Performance | JVM performance tuning | Java | Kafka | Kafka Connect | Networking | ORC | Parquet | Performance Tuning | Profiling | Relational databases | Replication | Sockets | Stream processing | Topic partitioning
Education
Regions
Countries
States
Cities
Related jobs
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R1d ago
-
Senior Machine Learning Engineer, Search USD 361K-510KA/B | A/B Testing | Apache Airflow | Apache Spark | B testingCommuter benefits | Disability benefits | Equity awards | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R1d ago
-
Senior Staff Data Platform Engineer - Data Access Team USD 201K-352KAlgorithms | CI/CD | Data Structures | Design Patterns | Distributed Systems401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, CALIFORNIA, United States R1d ago
-
Machine Learning Engineer II, Responsible AI USD 138K-285K2 Tower Models | Bias Mitigation | Ethics | Experimentation | FairnessMid-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Data Engineer II USD 78K-117KCI/CD | Cortex AI | Data Lake | Data Warehouse | ETL401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level Full TimeBaltimore, Maryland, USA R1d ago
-
Senior Machine Learning Engineer USD 176K-308KAlgorithms | Artificial Intelligence | Code Tuning | Code profiling | Design PatternsFlexible work persona | Remote work flexibilitySenior-level Full TimeWest Palm Beach, Florida, United States R1d ago
-
BeeGFS | CI/CD | CUDA | Caching | CephSenior-level Full TimeSan Jose, CA / Austin, TX-%LABEL … R1d ago
-
Data Engineer II USD 150K-225KAmazon EKS | Amazon MSK | Amazon Web Services | Apache Flink | Apache Kafka401k match | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, Aliso Viejo, CA R2d ago
-
Sr. Software Engineer USD 150K-190KAI workflows | API | AWS | Agentic Workflows | Coordinate systems401k match | Dental insurance | Family plan benefits | Flexible time off | Hybrid work modelSenior-level Full TimeAtlanta, GA R2d ago
-
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency401k match | ESPP | Family leave | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R2d ago
-
Senior Manager, AI Software Engineering USD 199K-235KAWS | Agile | Automated testing | CI/CD | Cloud Native401k match | Flexible time off | Hybrid work model | Medical insuranceSenior-level Full TimeNew York, NY R2d ago
-
Lead Full-Stack Engineer -- Advanced AI USD 132K-238KAPI Design | Agentic Systems | Application Architecture | CI/CD | Code review401k | Dental insurance | Employee discount | Health insurance | Life insuranceSenior-level Full Time7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN … R2d ago
-
Data Engineer, Senior USD 77K-176K800-53 | AWS | AWS EMR | AWS Glue | Access ControlsDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, AL, Huntsville (4946 Fowler Rd), … R2d ago
-
Data Engineer USD 61K-141KAWS | AWS CloudFormation | AWS EMR | AWS Solutions | AWS Solutions ArchitectDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsEntry-level Full TimeUSA, CA, San Diego (1615 Murray … R2d ago
-
Manager, Data Scientist - Eso USD 86K-150KBias/fairness | Business Intelligence | CI/CD | CI/CD deployment | ContainerizationCollaborative team | Fully remote | Mentorship opportunities | Minimal travelMid-level Full TimePittsburgh, Pennsylvania R2d ago
-
Cyber Machine Learning Engineer USD 86K-198KAmazon Web Services | Azure | Bash | Cloud Computing | Data StreamingDependent care | Paid leave | Professional development | Recognition awards | TS/SCI clearance eligibilityMid-level Full TimeUSA, VA, McLean (8283 Greensboro Dr, … R2d ago
-
Machine Learning Engineer USD 77K-176KC++ | Computer Vision | Data handling | Deep learning | Generative AISecret clearanceMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr … R2d ago
-
Streaming Data Engineer USD 78K-105KAWS MSK | Ansible | Apache Flink | Apache Kafka | Apache Kafka ConnectRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
AI Data Platform Engineer USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiSenior-level Full TimeUnited States - Remote R2d ago
-
Mid-level Full TimeUnited States - Remote R2d ago
-
(Remote, Milwaukee) Data Engineer USD 80K-90KApache Spark | Azure | Azure Synapse | Data Lakehouse | Data ModelingEmployee stock ownership | Lifestyle rewards | Medical/Dental/Vision insurance | Paid time off | RRSP/401k matchingSenior-level Full TimeRemote - Wisconsin, United States R2d ago
-
AWS CloudFormation | AWS Glue | AWS Lambda | AWS S3 | Amazon EMRBackground investigation for public trust clearance | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Data Engineer USD 157K-168KAPIs | Amazon S3 | Apache Spark | Databricks | Delta LakeTelecommuting allowedMid-level Full TimeIrving, TX, USA - 6555 North … R2d ago
-
AI Operations Engineer USD 150K-165KAccelerator Based Training | Apache Beam | CI/CD | Data Lineage | Data ModelingCareer growth | Direct W2 employment | Remote workMid-level Full TimeUnited States - Remote R2d ago