Senior Software Engineer — Ingestion for Spark
Tasks
- Deliver ingestion control plane services
- Design file ingestion features
- Drive ingest technical initiatives
- Mentor engineers on design and code quality
- Partner to design scalable cloud architectures
- Prototype fixes and turn feedback into roadmap signal
- Root cause production issues with enterprise customers
- Write and review design documents
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Spark | C++ | Cache optimization | Cloud Architecture | Data Ingestion | Data Ingestion Pipelines | Distributed Systems | Ingestion pipelines | Java | Memory Management | Performance Engineering | Query Execution | SIMD | Vectorization
Education
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 915057h ago
-
Sr. Software Engineer, Data Streaming Systems USD 130K-195KAutoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems401k plan | Dental insurance | Disability benefits | Life insurance | Medical insuranceSenior-level Full TimeBurbank, CA, US, 915057h ago
-
Embedded Device Firmware Engineer USD 145K-195KAutomated testing | C# | C++ | CI/CD | Circuit debuggingMid-level Full TimeSanta Clara, CA10h ago
-
Member of Technical Staff (Storage) USD 185K-200KAI Assisted Development | C++ | Concurrency Control | Data replication | Distributed SystemsDental insurance | Flexible time off | Life and disability insurance | Medical insurance | Mental wellbeing benefitsSenior-level Full TimeNew York, NY R10h ago
-
Architecture Review | Assembly | C# | C++ | Code review401k retirement plan | Company shuttles | Dental insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimeRedmond, WA10h ago
-
Assembly | C# | C++ | Convex Optimization | Distributed Systems401k retirement plan | Dental insurance | Disability insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimePalo Alto, CA10h ago
-
Assembly | C# | C++ | Convex Optimization | Distributed Systems401k | Dental insurance | Employee stock purchase plan | Life insurance | Medical insuranceSenior-level Full TimePalo Alto, CA10h ago
-
Assembly | C# | C++ | Convex Optimization | Debugging401k | Company shuttle | Dental insurance | Disability insurance | Employee discountsSenior-level Full TimeRedmond, WA10h ago
-
Software Engineer - Sensor Systems, Robot Software USD 209K-291KBuild systems | C++ | Core dumps | Data Streaming | DebuggingHybrid work | Inclusive work environment | Work from home optionMid-level Full TimeSunnyvale11h ago
-
Senior Software Engineer - Data Platform USD 130K-220KAWS Lambda | AWS RDS | Airflow | Amundsen | Apache HiveHealth insurance | Parental leave | Professional development stipend | Remote workSenior-level Full TimeRemote - US R11h ago
-
Senior Robotics Software Engineer, Sensor Fusion USD 191K-253K*nix | C++ | CAN | Computer Vision | EthernetSenior-level Full TimeCosta Mesa, California, United States; Washington, …13h ago
-
Senior Data Engineer (Remote) USD 155KAgile | Apache Spark | BigQuery | Cassandra | Data Governance401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible scheduleSenior-level Full TimeWork From Home, United States R15h ago
-
Data Engineer USD 89K-167KAmazon S3 | Apache Airflow | Apache Spark | DBT | Data ModelingDental insurance | Health insurance | Vision insuranceMid-level Full TimeRemote, USA R16h ago
-
Senior Data Engineer | Bankrate USD 100K-210KAPIs | AWS Lambda | AWS S3 | Airflow | Amazon EC2401k matching | Eastern Standard Time schedule | Employee assistance program | Flexible paid time off | Flexible spending accountsSenior-level Full TimeUnited States R17h ago
-
Senior Lead AI Software Engineer USD 216K-324KAgentic Workflows | Alerting | Architectural patterns | Coding assistants | Cost OptimizationSenior-level Full TimeBoston, MA17h ago
-
API Design | AWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud developmentSenior-level ContractGlendale, United States18h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-208K.NET | AWS | Agentic AI | Agile | AngularSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …19h ago
-
Software Engineer/Researcher, AI-Native Database Systems USD 156K-387KC++ | Database Architecture | Distributed Systems | Indexing | Information RetrievalSenior-level Full TimeSan Jose, California, United States19h ago
-
Software Engineer Level 1 -FFNN-8889 USD 78K-250KAccumulo | BSON | Bigtable | Distributed Systems | HBase401k match | Employee referral programs | FSA | Flexible work arrangements | Mental health supportMid-level Full TimeHanover, MD19h ago
-
Software Engineer Level 2 -FFNN-8890 USD 78K-250KAccumulo | BSON | Bigtable | Database Design | Development Lifecycle401k match | Dental insurance | Employee referral programs | Flexible spending accounts | Flexible work arrangementsMid-level Full TimeHanover, MD19h ago
-
Data Pipelines | Data Storage | Distributed Systems | High Performance | High-Performance ComputingCareer growthEntry-level Full TimeSan Jose, California, United States19h ago
-
Apache Flink | Apache Spark | Automation | C++ | Cause analysisSenior-level Full TimeSan Jose, California, United States19h ago
-
Cost estimation | Distributed Caches | Distributed Systems | Document Databases | Embedding IngestionSenior-level Full TimeSeattle, Washington, United States19h ago
-
Research Engineer / Scientist - Storage for LLM USD 156K-387KAttention Mechanisms | CUDA | Caching | Distributed Systems | Eviction policiesCompetitive compensation | Conference attendance | Generous research resources | Innovation-driven culture | Open source contributionsEntry-level Full TimeSan Jose, California, United States19h ago