Prinicpal Software Engineer - Data Engineering & Streaming Primitives
Tasks
- Contribute to technical reputation via talks and publications
- Define streaming transformation primitives direction
- Design distributed data pipeline architecture
- Gather customer usage signal and prioritize work
- Lead multi quarter performance scalability correctness reliability investments
- Operate systems for real time data pipelines
- Partner with product research and engineering teams
- Represent technical trade offs to stakeholders
- Run architectural reviews and set technical bar
Perks/Benefits
- N/A
Skills/Tech-stack
Algorithms | Apache Airflow | Apache Flink | Apache Spark | C++ | CDC | Change Data Capture | Consistency models | DBT | Data Capture | Data Transformation | Declarative Query Execution | Delta Lake | Distributed Systems | Fault Tolerance | Flink | Iceberg | Incremental Computation | Java | Kafka | Latency optimization | Pipeline Orchestration | Query Execution | Resource efficiency | Spark Structured Streaming | Stream processing | Structured Streaming | Throughput Optimization
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …1h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA1h ago
-
Sr. Manager Data Engineering USD 125K-188KAutomated testing | Bitbucket | CI/CD | Cloud Functions | Cloud RunSenior-level Full TimeSouthlake, TX, United States8h ago
-
Data Analysis | Data Visualization | GenAI | Java | Jupyter NotebookSenior-level Full TimeCupertino11h ago
-
Machine Learning Engineer, Sensor Pipelines USD 175K-215KC++ | Computer Vision | JAX | Machine Learning | PyTorchHybrid work scheduleMid-level Full TimeMountain View, CA, USA12h ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R13h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States13h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States13h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States14h ago
-
Senior Data Engineer USD 180K-210KAirflow | Anomaly Detection | BigQuery | CI/CD | Cloud platform401k employer match | Annual Company Holidays | Catered lunches | Company retreat | Comprehensive health coverageSenior-level Full TimeNew York City14h ago
-
Senior Program Manager, AI & Data USD 157K-205KAgile | Amazon Web Services | Analytics | BI | BudgetingCoaching and mentoring | Ownership | Remote-firstSenior-level Full TimeUS - Remote R15h ago
-
Senior Robotics Software Engineer USD 113K-151K3D simulation | AI | API Development | Agile | C++In-person office work | Lab workSenior-level Full TimeAustin, Texas, United States15h ago
-
Sr. Engineer, Firmware & Embedded Software USD 79K-158KAgile | Azure DevOps | BDM | Bare Metal | BootloaderOccasional travel for onboarding | Remote work within the United StatesSenior-level Full TimeFlorida, United States R15h ago
-
Senior Firmware Engineer, Space Embedded Systems USD 191K-253KARM | Analog Sensors | Bare Metal | Best practices | Board Bring-upSenior-level Full TimeCosta Mesa, California, United States15h ago
-
Firmware Engineer, Space Embedded Systems USD 166K-220KARM | Analog Sensors | Bare Metal | C# | C++Mid-level Full TimeCosta Mesa, California, United States15h ago
-
Software Engineer, Optimized Checkout & Link USD 161K-213KAPI Development | Automated testing | End to End | End-to-End Testing | GraphQL401k plan | Company bonus | Equity | Medical, dental, and vision benefits | TelecommutingMid-level Full TimeUS Remote R15h ago
-
API Design | Data Modeling | Distributed Systems | Low Latency | Low-Latency SystemsHybrid workMid-level Full TimeHQ-San Francisco15h ago
-
Senior Software Engineer; Analytics Infrastructure USD 167K-230KAPI Design | Backend Engineering | Caching | Columnar Databases | Data ModelingBack up child care support | Employee stock purchase program ESPP | Flexible time off | Home office & equipment stipend | Learning and development stipendSenior-level Full TimeSan Francisco, CA15h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R15h ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R15h ago
-
Machine Learning Research Engineer, App Store Search USD 185K-313KA/B | A/B Testing | Apache Spark | B testing | Fine TuningMid-level Full TimeSeattle16h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA16h ago
-
Software Engineer (Data Engineer) USD 90K-135KAPI | AWS | Apache Airflow | Apache Spark | Azure401k plan | Employer health insurance | Employer life and disability insurance | Paid government holidays | Paid time offMid-level Full TimeHerndon, VA17h ago