Senior Data Engineer
Tasks
- Architect distributed stream and batch processing systems
- Build and maintain data processing frameworks for event ingestion and transformation
- Collaborate with data consumers product and infrastructure teams
- Contribute to long term platform architecture and engineering standards
- Define and enforce exactly once processing semantics
- Design and implement near real-time data pipelines
- Ensure production grade reliability observability and operability
- Handle event time vs processing time with watermarks
- Implement backpressure and fault tolerance strategies
- Manage stateful stream processing with checkpointing and recovery
Perks/Benefits
- Commute subsidy
- Competitive retirement pension plans
- Comprehensive health life and disability insurance
- Employee resource groups
- Employee stock ownership
- Generous vacation and personal days
- Global employee assistance program
- Mental Health and Wellbeing programs and support
- Office Food Snacks
- Support for new parents through leave and family care programs
- Training and development programs
- Volunteering and donation matching program
Skills/Tech-stack
Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Backpressure | Checkpointing | Cloud Native | Cloud Native Architecture | Containerization | Data Pipelines | Distributed Systems | Event time | Event-time processing | Exactly once | Fault Tolerance | Java | Kubernetes | Python | Recovery | Scala | Stateful stream processing | Stream processing | Time processing | Watermarking
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior Machine Learning Engineer, Computer Vision USD 150K-200KAWS | Agile | Airflow | Azure | CI/CD401-k plan | Healthcare benefits | Life insurance | Long-term disability | On-site collaborationSenior-level Full TimeSeattle, Washington, United States7h ago
-
Senior Engineer, Developer Platforms - GenAI USD 140K-160KAWS | Agentic Workflows | Amazon Web Services | Datadog | DockerSenior-level Full TimeNew York, NY9h ago
-
Business Analytics Lead - Predictive Modeling USD 130K-140KA/B | A/B Testing | B testing | Business Intelligence | Dashboard Development401k retirement savings plan | Dental coverage | Equity participation | Flexible spending account | Health savings accountSenior-level Full TimeNew York, NY9h ago
-
Software Engineer II, Computational Platform USD 124K-154KAPIs | AWS | Cloud Networking | Data Modeling | Docker401k plan | Commuter support | Company-provided laptop | Flexible paid time off | Holiday payMid-level Full TimeRemote; Watertown, Massachusetts, United States R12h ago
-
Data Platform Engineer USD 130K-175KAccess Control | Alerting | CI/CD | Cloud services | Data LineageMid-level Full TimeMilwaukee, WI12h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Bonus | Equity | Friendly work environment | Remote-friendly cultureMid-level Full TimeNew York, NY, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Distributed team | Opportunity for product impact | Supportive management cultureMid-level Full TimeBoston, MA, USA15h ago
-
Computer Vision Engineer USD 166K-220K3D Reconstruction | C++ | Camera Calibration | Camera systems | Computer VisionSenior-level Full TimeSeattle, Washington, United States16h ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeAustin, TX, USA16h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Opportunity for high impact | Remote-friendlyMid-level Full TimeAtlanta, GA, USA16h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerFriendly atmosphere | Opportunities for high impact | Professional growth | Remote friendly asynchronous cultureMid-level Full TimeSan Diego, CA, USA16h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Bonus | Equity | Laid back environment | Remote-friendlyMid-level Full TimePhoenix, AZ, USA16h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeMenlo Park, CA, USA16h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeSanta Clara, CA, USA16h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Bonus | Competitive compensation | Equity | Friendly work environmentMid-level Full TimeBoulder, CO, USA16h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible management style | Portfolio and LinkedIn submissionMid-level Full TimeCharlotte, NC, USA16h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Competitive bonus | Equity compensation | Flexible remote distributionMid-level Full TimeAnn Arbor, MI, USA16h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Bonus | Equity | Flexible remote distributed setting | Friendly laid-back atmosphereMid-level Full TimeColumbus, OH, USA16h ago
-
Bash | Cloud infrastructure | Cloud infrastructure as code | Cloud platform | Data ProcessingAsynchronous culture | Distributed team | Portfolio support | Remote workMid-level Full TimeMiami, FL, USA16h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Remote workMid-level Full TimeFort Lauderdale, FL, USA16h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible team environment | Remote friendly organizationMid-level Full TimeStamford, CT, USA16h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Bonus | Equity | Flexible, hands-off management | Remote/distributed teamMid-level Full TimeEugene, OR, USA16h ago
-
Bash | Cloud platform | Data Processing | Data pipeline | DockerAsynchronous culture | Equity opportunity | Friendly laid-back atmosphere | Remote-friendlyMid-level Full TimeAlbuquerque, NM, USA16h ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Processing | DockerAsynchronous culture | Competitive compensation | Laid-back atmosphere | Opportunity to make impact | Supportive team environmentMid-level Full TimeAnchorage, AK, USA16h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Friendly team environment | Inclusive workplace | Laid-back atmosphere | Opportunity for impactMid-level Full TimeGrand Rapids, MI, USA16h ago