Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark
San Diego, CALIFORNIA, United States
R
USD 181K-317K Senior-level Full Time
Tasks
- Architect distributed systems components
- Collaborate across engineering teams
- Design and build data ingestion solutions
- Design reusable libraries and frameworks
- Enforce engineering best practices
- Lead complex technical initiatives
- Provide technical leadership for high risk projects
- Research and adopt new technologies
- Troubleshoot complex production issues
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency | Data Ingestion | Data Ingestion Pipelines | Data Lake | Distributed Systems | Exactly once | Exactly-once semantics | Garbage Collection | High Availability | Ingestion pipelines | JVM Performance | JVM performance tuning | Java | Kafka | Kafka Connect | MySQL | Networking | ORC | Oracle | Parquet | Performance Tuning | PostgreSQL | Profiling | Replication | Topic partitioning
Education
Regions
Countries
States
Cities
Related jobs
-
Lead Full-Stack Engineer -- Advanced AI USD 132K-238KAPI Design | Agentic Systems | Application Architecture | CI/CD | Code review401k | Dental insurance | Employee discount | Health insurance | Life insuranceSenior-level Full Time7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN … R10h ago
-
Data Engineer I USD 80K-110KApache Airflow | Apache Kafka | Apache Spark | CI/CD | Cloud Data401k | Health dental vision HRA HSA | PTO and paid holidays | Parental leaveMid-level Full TimeDenver, CO or Long Beach, CA R10h ago
-
Machine Learning Engineer USD 155K-194KAWS | Airflow | Anomaly Detection | Apache Flink | Apache SparkMid-level Full TimeRemote - US R12h ago
-
Senior Software Engineer, Data Product - SF Only USD 190K-220KAirflow | BigQuery | Blockchain | DBT | DatadogEquity planSenior-level Full TimeSan Francisco, CA R13h ago
-
Full Stack Software Engineer USD 150K-350KAPI | Concurrency | Data Modeling | Database transactions | Distributed SystemsDental insurance | Expensed Dinners | Flexible PTO | Flexible WFH | Medical insuranceMid-level Full TimeNew York City R14h ago
-
Senior AI Engineer USD 188K-248KAPI Design | Agentic Systems | Agile | Cloud Architecture | Code reviewCell phone allowance | Comprehensive health coverage | Equity grants | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote - US R15h ago
-
Software Engineer Level 2-FFPP-8853 USD 78K-250KAccumulo | BSON | Bigtable | C++ | Distributed File System401k match | Dental insurance | Diverse and inclusive workplace culture | Employee referral program | Flexible spending accountsSenior-level Full TimeHanover, MD; Information Technology R17h ago
-
Software Engineer Level 2-FFPP-8934 USD 78K-250KAWS | Accumulo | BSON | HBase | HDFS401k match | Dental insurance | Employee referral programs | Flexible spending accounts | Flexible work arrangementsSenior-level Full TimeHanover, MD; Information Technology R17h ago
-
Data Engineer, Splunk & Snowflake USD 150K-160KAnomaly Detection | Apache Iceberg | Apache Spark | Business Intelligence | Cloud Data401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R17h ago
-
Sr. DevOps Engineer - Snowflake USD 165K-216KADLS | AWS | Amazon Redshift | Azure | Azure DataClient-focused work | Ownership culture | Professional mentoring | Remote-first work environmentSenior-level Full TimeUS - Remote R18h ago
-
AI Systems & ML Engineering Industry Expert USD 140K-209KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible schedule | Fully remote | Hourly payment | International teamSenior-level Part TimeNew York City, NY, US R19h ago
-
Machine Learning Engineer USD 100K-120KAWS | Apache Spark | Classification | Data Quality | Data Quality ChecksHybrid work model | Onsite 1 to 2 days per week | Opportunities for growthMid-level Full TimeOakbrook Terrace, IL, US R21h ago
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Anomaly Detection | Data Processing | Deep learning | Fine TuningSenior-level Full TimeRemote-USA R1d ago
-
Data Engineer, Hardware Reliability (Starlink) USD 135K-185KBash | C# | C++ | Concurrency | Data InfrastructureExtended hours and weekends | Onsite work required | Travel up to 10%Mid-level Full TimeBastrop, TX R1d ago
-
Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R1d ago
-
Performance & Data Optimization Engineer USD 128K-173KAWS | ArgoCD | Automated failover | Automation | Azure BicepMid-level Full TimeUSA LA Home Office (LAHOME), United … R1d ago
-
Senior Software Engineer, AI/ML (Hybrid - Aguadilla) USD 107K-204KAWS | Airflow | Apache Iceberg | CI/CD | Dagster401k match | Dental insurance | Disability coverage | Employee assistance program | Hybrid work scheduleSenior-level Full TimeUS-PR-AGUADILLA-110 ~ Rd 110 N Km … R1d ago
-
Software Engineer II - Embedded Software USD 68K-131KAARCH64 | Agile | AppArmor | Artifactory | C#RelocationMid-level Full TimeUS-TX-MCKINNEY-513WD ~ 2501 W University Dr … R1d ago
-
AWS | Apache Arrow | Apache Ray | Apache Spark | AzureSenior-level Full TimeSan Jose, United States R1d ago
-
Quantitative Trading Engineer (Java) - Vice President USD 155K-252KCode review | Continuous Delivery | E-trading | Java | KDBEmployee resource groups | Family building benefits | Generous vacation | Health and wellbeing benefits | Hybrid work modelExecutive-level Full TimeNew York, 1 Columbus Circle, United … R1d ago
-
Sr. Data Engineer USD 129K-194KAPI Development | Agile | Airflow | Apache Spark | CI/CD403b | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeSeattle, Washington, United States of America R1d ago
-
Cloud Pipeline Data Engineer USD 98K-206KAWS DMS | AWS Glue | AWS IAM | AWS Lambda | Amazon RedshiftFlexible time off | Learning resourcesSenior-level Full Time999 REMOTE, United States R1d ago
-
Sr. Data Engineer USD 129K-194KAPI Development | Agile | Apache Airflow | Apache Spark | CI/CD403b | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full Time818 Stewart, United States R1d ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Airflow | Anomaly DetectionSenior-level Full TimeNew York R1d ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Amazon Redshift | Apache AirflowSenior-level Full TimeSan Francisco R1d ago