Senior Data Engineer
Tasks
- Architect batch processing systems
- Architect distributed stream processing systems
- Build reporting infrastructure
- Collaborate with data consumers and product teams
- Coordinate stream and batch workflows
- Define platform architecture standards
- Design near real-time data pipelines
- Ensure exactly-once processing
- Ensure production reliability and observability
- Handle event time vs processing time
- Implement backpressure and fault tolerance
- Implement checkpointing and recovery
- Implement event ingestion and transformation
- Manage stateful stream processing
- Operate data processing frameworks at scale
Perks/Benefits
- Commute subsidy
- Employee resource groups
- Employee stock ownership
- Generous vacation and personal days
- Global employee assistance program
- Mental health programs
- Office snacks
- Parental leave support
- Retirement pension plans
- Training and development programs
- Volunteering and donation matching program
Skills/Tech-stack
Airflow | Apache Flink | Apache Spark | Backpressure | Batch Processing | Checkpointing | Cloud Platforms | Containerization | Data Engineering | Distributed Systems | Event time | Event-time processing | Exactly once | Exactly-once processing | Fault Tolerance | Java | Kafka | Kubernetes | Python | Scala | Stateful stream processing | Stream processing | Time processing | Watermarking
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R17d ago
-
Snowflake (Data Engineer) USD 128K-154KAWS | Analysis Services | Data Modeling | Data Warehousing | Data integration401k plan | Accident insurance | Critical illness insurance | Daycare FSA | Dental insuranceMid-level Full TimeNashville, TN9h ago
-
Artificial Intelligence | Automated testing | C++ | Containers | Distributed Systems401k company match | Dental insurance | Flexible work schedule | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA; Mercer Island, USA10h ago
-
Machine Learning Engineer II - Unpublished R&D Product USD 143K-201KAI Planning | Agent systems | C++ | Data Science | Decision Making401k company match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceMid-level Full TimeLos Angeles, USA; Mercer Island, USA11h ago
-
Agentic AI | C# | C++ | Client-Server | Client-server systemsEntry-level InternshipSan Mateo, CA, United States11h ago
-
Senior Software Engineer - Data Lake & BI USD 162K-242KApache Iceberg | Apache Spark | Avro | C++ | CI/CD401k match | Disability insurance | Employee stock purchase program | Flexible PTO | Flexible spending accountSenior-level Full TimeSunnyvale, CA / Bellevue, WA11h ago
-
Machine Learning Engineer, Foundation Model USD 129K-247KAutonomous Driving | Autoregressive modeling | Behavior Prediction | C plus plus | Data PipelinesSenior-level Full TimeSan Jose11h ago
-
Software Engineer, Database Migration Service USD 143K-194KC++ | Data Structures | Distributed Systems | Hibernate | JavaCode review feedback | Knowledge sharing | Learning opportunities | Mentorship | Work-life balanceMid-level Full TimeBoston, Massachusetts, USA11h ago
-
Engineering Manager, Machine Learning (Caper) USD 201K-253KBigQuery | CI/CD | Computer Vision | Deep learning | DockerRemote workSenior-level Full TimeUnited States - Remote R12h ago
-
API | Data Modeling | Data Visualization | ETL | Power BIRemote workEntry-level Full Time InternshipRancho Cordova, CA, United States12h ago
-
Senior Generative AI Consultant USD 136K-136KAWS | Azure | CI/CD | Cloud platform | Deep learning401k matching | Dental insurance | Flexible spending account | Gym reimbursement | HealthcareSenior-level Full TimeSan Francisco, CA, United States13h ago
-
3D Embeddings | Adversarial ML | Apache Spark | Computer Vision | Data EngineeringEquity compensation | Onsite collaborationSenior-level Full TimeSan Mateo, CA, United States13h ago
-
Mid-level Full TimeMiami, Florida, United States13h ago
-
Senior Software Engineer (San Francisco, CA) USD 157K-222KAWS EC2 | AWS ECS | AWS EMR | AWS Fargate | AWS GlueSenior-level Full TimeSan Francisco, CA13h ago
-
Senior Data Engineer USD 160K-195KAWS Lambda | AWS Step Functions | Alerting | Amazon EMR | Amazon KinesisSenior-level Full TimeRemote - US R14h ago
-
Senior-level Full TimeTampa, FL14h ago
-
Corporate AI Engineer USD 75K-230KAnthropic | Data integration | Embeddings | Enterprise SaaS | Generative AI401k match | Business travel accident insurance | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimeAddison, TX (Hybrid); Bellevue, WA (Hybrid); … R14h ago
-
Senior Applied AI Engineer - Energy Industry USD 146K-183KAWS Bedrock | Access Management | Agent Orchestration | Azure AI | Data integrationCompany equity (RSUs) | Comprehensive benefits | Counseling | Gym subsidies | Hybrid workSenior-level Full TimeRaleigh, US, North Carolina15h ago
-
Senior Applied AI Engineer - Energy Industry USD 146K-183KAWS Bedrock | Agent Orchestration | Azure AI | Few-Shot Learning | Few-shotCompany equity | Counseling | Gym subsidies | Hybrid working | Paid time offSenior-level Full TimeRemote, US, Texas R15h ago
-
Senior Software Engineer II - Authoring Apps USD 196K-270KAWS | Kubernetes | Node.js | Python | React401k contribution | Healthcare | Home office stipend | Paid parental leave | Remote workMid-level Full TimeUS - Remote R15h ago
-
Systems Engineer, Algorithm Development USD 110K-240KAlgorithm Development | C++ | DSP | Data Analysis | Digital Signal Processing401k | Casual dress code | Dental insurance | FSA | Free daily lunchSenior-level Full TimeHawthorne, California, United States15h ago
-
Senior Systems Engineer, Algorithm Development USD 110K-240KAlgorithm Development | C plus plus | Clutter rejection | Data Analysis | Digital Signal Processing401k | Casual dress code | FSA | Free daily lunch | HSASenior-level Full TimeHawthorne, California, United States15h ago
-
Senior Principal Systems Engineer, Algorithm Development USD 110K-240KAlgorithm Development | C++ | Clutter rejection | DSP | Data Analysis401k | Casual dress code | Dental insurance | FSA | Free lunchSenior-level Full TimeHawthorne, California, United States15h ago
-
Principal Data Engineer USD 124K-206KAPI Architecture | AWS | AWS Step Functions | Access Control | Amazon Redshift401k plan | Commuter benefits | Life insurance | Medical, dental & vision coverage | Paid HolidaysSenior-level Full TimeUS - Remote R15h ago
-
Senior Software Engineer, ML Infrastructure USD 250K-330KCost Optimization | Distributed Training | Experimentation | Fault Tolerance | GPU clustersDental benefits | Flexible vacation | Free meals and snacks | Medical benefits | Vision benefitsSenior-level Full TimeSan Francisco15h ago