Prinicpal Software Engineer - Data Engineering & Streaming Primitives
Tasks
- Contribute to technical reputation via talks and publications
- Define streaming transformation primitives direction
- Design distributed data pipeline architecture
- Gather customer usage signal and prioritize work
- Lead multi quarter performance scalability correctness reliability investments
- Operate systems for real time data pipelines
- Partner with product research and engineering teams
- Represent technical trade offs to stakeholders
- Run architectural reviews and set technical bar
Perks/Benefits
- N/A
Skills/Tech-stack
Algorithms | Apache Airflow | Apache Flink | Apache Spark | C++ | CDC | Change Data Capture | Consistency models | DBT | Data Capture | Data Transformation | Declarative Query Execution | Delta Lake | Distributed Systems | Fault Tolerance | Flink | Iceberg | Incremental Computation | Java | Kafka | Latency optimization | Pipeline Orchestration | Query Execution | Resource efficiency | Spark Structured Streaming | Stream processing | Structured Streaming | Throughput Optimization
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Software Engineer III - Senior Java Spark Developer USD 113K-188KAgile | Apache Spark | CI/CD | Concurrency | Distributed SystemsSenior-level Full TimeJersey City, New Jersey, United States2h ago
-
Applied AI Engineer - AI Solutions USD 172K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25% | Employee stock options | Hybrid work | Professional developmentMid-level Full TimeNew York City, NY (Hybrid); Redwood … R10h ago
-
Manager, Enterprise Data Engineering USD 180K-247KADLS | Active Directory | Agile | Apache Spark | Automated testing401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Fertility benefitsSenior-level Full TimeAnn Arbor, MI, United States11h ago
-
Intelligence Data Engineer USD 147K-199KAlgorithms | Data Design | Data Engineering | Data Exploration | Data GenerationSenior-level Part TimeUSA MD Bethesda - 9500 Macarthur …15h ago
-
Principal Product Manager, Inference Engine USD 218K-273KAutoscaling | Batching | Capacity Efficiency | Capacity Planning | GPU EconomicsEmployee assistance program | Flexible time off | LinkedIn Learning | Training reimbursementSenior-level Full TimeSeattle15h ago
-
Backend Engineer - Applied AI USD 175K-240KCRDT | Caching | Circuit Breakers | Database Query | Database Query OptimizationMid-level Full TimeNew York City15h ago
-
2026 Fall Health AI Scholar, Digital Health Algorithms USD 124K-150KAWS SageMaker | Amazon Redshift | Android | Artificial Intelligence | C++Entry-level Full Time665 Clyde Avenue, Mountain View, CA, …16h ago
-
Senior Software Engineer - Infrastructure Storage USD 266K-395KAPI Design | Block Storage | Ceph | Distributed Systems | Fibre Channel401k match | Commuter stipend | Flexible paid time off | Health, dental, vision coverage | Wellness stipendSenior-level Full TimeSan Francisco Office (Fremont St)16h ago
-
Senior-level Full TimeCosta Mesa, California, United States16h ago
-
Sr. Data Engineer (Remote) USD 163K-192KAccess Control | Amazon Web Services | Apache Iceberg | Apache Kafka | Apache Spark401k plan | Dental insurance | Disability insurance | Employee assistance program | FSA/HSASenior-level Full TimeRemote - United States R16h ago
-
Machine Learning Engineer - Simulation Framework USD 160K-234K3D Graphics | C++ | CUDA | Deep learning | Deterministic systemsEntry-level Full TimeFoster City, CA17h ago
-
AWS | Agent Orchestration | CI/CD | Cloud platform | Databricks401k match | Counseling membership | Employer subsidized medical dental and vision | Flexible time away program | Life insuranceMid-level Full Time-REMOTE, USA- R17h ago
-
Software Engineer III - Big Data & AWS USD 175K-186KAPI Gateway | AWS Glue | AWS Lambda | AWS Step Functions | Amazon APISenior-level Full TimePlano, TX, United States17h ago
-
Staff Analytics Engineer USD 159K-187KClaude | Claude Code | DBT | Data Contracts | Data Modeling401k company match | Accident insurance | Company funded HSA contributions | Critical illness insurance | Health, dental, vision coverageSenior-level Full TimeRemote (United States) R17h ago
-
AI Engineer, Product USD 171K-240KA/B | A/B Testing | API Design | B testing | Data ModelingHybrid work | Remote work up to four weeks per yearMid-level Full TimeSan Francisco, California, United States R18h ago
-
Lead Software Engineer - Big Data & AWS USD 175K-195KAPI Gateway | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimePlano, TX, United States18h ago
-
AI Engineer - Software Engineer III USD 175K-189KAPI Development | AWS | Agentic AI | Caching | ContainersSenior-level Full TimeJersey City, NJ, United States18h ago
-
C++ | Deep learning | Distributed Training | ETL | GoSenior-level Full TimeMountain View, CALIFORNIA, United States18h ago
-
C++ | ETL | Go | Hugging Face | MicroservicesFlexible work arrangements | Learning and development support | Remote work optionsSenior-level Full TimeMountain View, CALIFORNIA, United States18h ago
-
Abstractive summarization | Active Learning | DPO | Data Privacy | Deep learningIn-office work options | Professional development | Remote work flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States18h ago
-
Staff Machine Learning Engineer, Agentic App Platform USD 123K-216KAPI Design | Distributed Systems | Generative AI | Language Models | Language ProcessingFlexible work arrangements | In-office Flexibility | Remote work optionsSenior-level Full TimeMountain View, CALIFORNIA, United States18h ago
-
API Design | Debugging | Distributed Systems | Generative AI | Language ProcessingSenior-level Full TimeMountain View, CALIFORNIA, United States18h ago
-
Data Engineer USD 175K-225KAlertmanager | Amazon S3 | Apache Flink | Apache Iceberg | Apache KafkaInsurance | Paid leaveMid-level Full TimeChicago, United States18h ago
-
Consulting Technical Manager, AI Data Engineer USD 87K-187KAPI Gateway | AWS | CI/CD | Cloud platform | Containers401k match | Adoption Assistance | Commuter benefits | Employee stock purchase plan | Flexible spending accountsMid-level Full TimeReston, VA, United States18h ago
-
Senior Machine Learning Engineer, Shield USD 211K-263KAnomaly Detection | Apache Spark | Behavior analytics | BigQuery | Cloud DataflowSenior-level Full TimeRedwood City, CA, United States R18h ago