Senior Data Engineer
Tasks
- Architect distributed stream and batch processing systems
- Build and maintain data processing frameworks for event ingestion and transformation
- Collaborate with data consumers product and infrastructure teams
- Contribute to long term platform architecture and engineering standards
- Define and enforce exactly once processing semantics
- Design and implement near real-time data pipelines
- Ensure production grade reliability observability and operability
- Handle event time vs processing time with watermarks
- Implement backpressure and fault tolerance strategies
- Manage stateful stream processing with checkpointing and recovery
Perks/Benefits
- Commute subsidy
- Competitive retirement pension plans
- Comprehensive health life and disability insurance
- Employee resource groups
- Employee stock ownership
- Generous vacation and personal days
- Global employee assistance program
- Mental Health and Wellbeing programs and support
- Office Food Snacks
- Support for new parents through leave and family care programs
- Training and development programs
- Volunteering and donation matching program
Skills/Tech-stack
Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Backpressure | Checkpointing | Cloud Native | Cloud Native Architecture | Containerization | Data Pipelines | Distributed Systems | Event time | Event-time processing | Exactly once | Fault Tolerance | Java | Kubernetes | Python | Recovery | Scala | Stateful stream processing | Stream processing | Time processing | Watermarking
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior Software Engineer, AI/ML GenAI USD 174K-252KC++ | Capacity Management | Cloud platform | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Staff Software Engineer, Data Center Resource Modeling USD 207K-300KAPI Design | C++ | Data Center Management | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeKirkland, WA, USA1h ago
-
C++ | Data Processing | Debugging | Generative AI | Language ModelsSenior-level Full TimeMountain View, CA, USA1h ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA1h ago
-
Staff Datacloud Blackbelt Engineer, Data and AI USD 183K-265KAI Engineering | AI/ML | AI/ML workflows | BigQuery | Cloud ArchitectureSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Staff Software Engineer, Generative AI, Core ML USD 207K-300KAI Feedback | Computer Vision | Data Processing | Deep learning | Digital TwinSenior-level Full TimeMountain View, CA, USA1h ago
-
APIs | Agent systems | CrewAI | Fine Tuning | Hugging FaceSenior-level Full TimeAddison, TX, USA; Austin, TX, USA1h ago
-
Software Engineer III, AI/ML GenAI, YouTube USD 147K-211KC++ | Computer Vision | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA1h ago
-
Senior Software Engineer, Generative AI, Search Health USD 174K-252KA/B | A/B Testing | B testing | Data Analysis | Data MiningSenior-level Full TimeMountain View, CA, USA1h ago
-
C++ | Data Architecture | Data Mining | Data Modeling | Data ProcessingEntry-level Full TimeSunnyvale, CA, USA1h ago
-
Cloud Computing | Cloud TPU | Cloud platform | Data Processing | DebuggingSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA1h ago
-
Machine Learning Engineer USD 111K-180KAutomation | Business Intelligence | Cloud Computing | Dashboard Development | Data PipelinesMid-level Full TimeAlexandria, VA, United States4h ago
-
Machine Learning Engineer USD 93K-149KAutomation | Business Intelligence | Cloud services | Data Modeling | Data Pipelines401k matching | Dental insurance | Flexible spending account | Health insurance | Paid HolidaysMid-level Full TimeAlexandria, VA, United States6h ago
-
Robotics Engineer, Sensor Integration USD 191K-253KAgent coordination | C++ | Communication Protocols | Computer Vision | Distributed SystemsCommuter benefits | Comprehensive medical, dental, and vision | Life and disability insurance | Mental health resources | Professional development reimbursementMid-level Full TimeCosta Mesa, California, United States11h ago
-
Cloud Software Engineer-Principal USD 150K-235KBigtable | CentOS | Cloud Computing | Configuration Management | Coordination frameworksSenior-level Full TimeAnnapolis Junction, Maryland, United States11h ago
-
Mid-level Full TimeAnnapolis Junction, Maryland, United States11h ago
-
AI Software Engineer-Senior USD 108K-195KAgile | Confluence | Continuous Delivery | Continuous Integration/Continuous Delivery | Continuous integrationCareer progression | World-class benefitsSenior-level Full TimeAnnapolis Junction, Maryland, United States11h ago
-
Principal Machine Learning Researcher (Physical AI) USD 200K-400KAnomaly Detection | C++ | Computational Geometry | Computer Vision | Deep learning401k | Casual dress | Company holidays | Employer paid Medical Dental Vision Insurance | Flexible work hoursSenior-level Full TimeLos Angeles, CA (On-site) R12h ago
-
Machine Learning Engineer, Assessments USD 220K-300KAudio Processing | Data labeling | Evaluation | Feature extraction | Machine LearningMid-level Full TimeSan Francisco12h ago
-
Senior-level Full Time1 Spartan Way, Merrimack NH, United …12h ago
-
Principal Data Engineer USD 149K-179KAWS S3 | Amazon Web Services | Analytics Cloud | Ansible | Apache AirflowSenior-level Full TimeOne Destiny Way, Westlake TX, United …12h ago
-
Senior Quantitative Developer USD 140K-150KAmazon Web Services | CI/CD | Continuous Deployment | Continuous Integration and Continuous Deployment | Continuous integrationHybrid work scheduleSenior-level Full Time245 Summer St, Boston MA, United …12h ago
-
C# | Combinatorics | Graph theory | Linear Algebra | MATLABFlexible hours | Part-time project-based workSenior-level FreelanceUnited States - Remote R12h ago
-
Manager, BI + Analytics Engineer USD 150K-180KApache Airflow | BigQuery | DBT | Dashboards | Data ModelingMid-level Full TimeSan Francisco, CA13h ago
-
API Security | AWS Lambda | Anthropic MCP) | Authentication | BigQuery100% remote | Annual leave | Company funded usage budget | Developer productivity budget | Equity RSUsSenior-level Full TimeUnited States (Remote) R14h ago