Staff Software Engineer - Streaming
Tasks
- Design and build new stream processing operators
- Design and build stream processing state management
- Drive stream processing adoption across product portfolio
- Guide architecture and technical debt decisions
- Improve streaming engine architecture latency and throughput
- Improve streaming engine cost efficiency
- Mentor and lead engineers
- Raise engineering quality and operability for production
- Set technical vision for Spark Structured Streaming
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Data Storage | Database systems | Distributed Systems | Latency optimization | Operational excellence | Performance optimization | Software Architecture | Spark Structured Streaming | Structured Streaming | Throughput Optimization
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Analytics and Insights Engineer III USD 131K-218KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeRichmond, Virginia, United States1d ago
-
Staff Software Engineer, AI and Infrastructure USD 207K-300KC++ | Cluster management | Distributed Systems | Kernel | LinuxSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Staff Software Engineer, AI/ML, Google Cloud Security USD 207K-300KAgentic AI | Artificial Intelligence | Cloud Security | Cloud platform | Data ProcessingSenior-level Full TimeReston, VA, USA; New York, NY, …1d ago
-
Senior Software Engineer, Google Cloud Dataproc USD 174K-252KApache Hive | Apache Spark | C++ | Data Warehouse | Data Warehouse InternalsSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Lead Firmware Engineer, Robotics USD 207K-300KBrushless DC | C# | C++ | Closed Loop | Closed loop controlSenior-level Full TimeMountain View, CA, USA1d ago
-
C++ | Cloud Platforms | Data Protection | Disaster Recovery | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Agentic Orchestration | C++ | Data Onboarding | Data Pipeline Engineering | Data pipelineSenior-level Full TimeSan Jose, CA, USA1d ago
-
Senior Software Engineer, AI/ML, Core USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA1d ago
-
Staff Software Engineer, Search Local Ads Data Platform USD 207K-300KC plus plus | CSS | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1d ago
-
Benchmarking | C plus plus | CUDA | Computational Engineering | Distributed Computing401k match | Generous paid time off | Medical, dental & vision coverage | Stock options | WFH Hardware ReimbursementSenior-level Full TimeSunnyvale, CA R1d ago
-
Staff Data Engineer USD 147K-184KAmazon Kinesis | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache SparkDental insurance coverage | Health insurance coverage | Paid parental leave | Paid vacation | Relocation assistanceSenior-level Full TimeBerkeley, CA1d ago
-
Associate, Client Intelligence (Data Scientist) USD 98K-132KAWS | Apache Spark | Azure | Big Data | Cloud platformEmployee resource groups | Matching gift program | Professional development | Sustainability and Climate Change Initiatives | Volunteerism programMid-level Full TimeNew York, NY, US, 100011d ago
-
Apple Neural Engine | C plus plus | CPU performance | Compilers | Computer ArchitectureMid-level Full TimeCupertino1d ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R1d ago
-
AIOps | Anomaly Detection | Anthos | CRD | Control Plane401k plan | Basic life insurance | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeResearch Triangle Park, North Carolina, United … R1d ago
-
Computer Vision & Machine Learning Engineer USD 150K-200KAblation Studies | CI/CD | Computer Vision | Data Pipelines | DockerEntry-level Full TimeRemote, US R1d ago
-
Staff Data Engineer USD 162K-224KAmazon Managed Workflows for Apache Airflow | Apache Airflow | Apache Druid | Apache Iceberg | CCPA401k employer match | Annual WIN bonus | Flexible vacation | Mental health resources | Paid HolidaysSenior-level Full TimeU.S. Remote R1d ago
-
Sr Staff AI Engineer - Veza USD 190K-334KAgent Orchestration | Algorithms | C++ | Data Structures | Distributed Systems401k plan with match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeMinneapolis, Minnesota, United States R1d ago
-
Site Reliability Engineer - Data, Apple Ads USD 170K-264KAWS | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkEntry-level Full TimeAustin1d ago
-
Senior GTM AI Engineer USD 154K-213KAgent Orchestration | Agent Performance | Agent Performance Monitoring | Anthropic Claude | App Development401k match | Catered lunch | Company events | Desk setup stipend | Flexible spending accountsSenior-level Full TimeOakland, California, United States R1d ago
-
AWS | Agentic Workflows | CI/CD | Concurrency | DevOpsSenior-level Full TimeSunnyvale1d ago
-
AI Architect USD 120K-197KAI orchestration | Automation | Cloud Computing | Data Governance | Distributed SystemsWeekly earned wage access optionSenior-level Full TimeDurant, OK, United States R1d ago
-
Apache Spark | CI/CD | Deep learning | Fine Tuning | GoSenior-level Full TimeSeattle1d ago
-
Data Platform SRE, AI & Data Platforms (AiDP) USD 170K-256KAWS | Apache Airflow | Apache Iceberg | Apache Spark | Cloud platformMid-level Full TimeAustin1d ago
-
Software Engineer II, Storage USD 140K-160KAnsible | Backups | Block Storage | C# | C++401k match | Cell phone stipend | Commuter benefits | Daily meals allowance | Dental insuranceEntry-level Full TimeSan Francisco, CA - US1d ago