Senior Data Engineer — Data Platform
Tel Aviv-Yafo, Tel Aviv District, IL
ILS 420K-504K (estimate) Senior-level Full Time
Tasks
- Build Airflow orchestration DAGs
- Build Kafka event driven data flows
- Create developer frameworks and templates
- Define pipeline standards and testing
- Deploy Spark compute with autoscaling and tuning
- Design Spark on Kubernetes platform
- Design batch and streaming data pipelines
- Ensure data consistency and integrity
- Implement CI/CD for data workloads
- Implement cost visibility and attribution
- Implement monitoring, alerting, and incident response
- Lead backfills and migrations
- Manage Apache Iceberg lakehouse tables
- Operate AWS Glue catalog
- Optimize cost and performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Airflow | Alerting | Apache Iceberg | Apache Kafka | Apache Spark | Autoscaling | Backfills | CI/CD | Compaction | Data Modeling | Data Pipelines | Distributed Systems | GitOps | Incident Response | Kafka | Kubernetes | Monitoring | Partitioning | Python | Resource tuning | SQL | Schema evolution | Schema management | Testing
Education
N/A
Roles
Related jobs
-
Backend Team Leader-Data Platform ILS 338K-473KAmazon MSK | Amazon Web Services | Apache Flink | Apache Kafka | Data ModelingHybrid work modelSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel R2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeTel Aviv, Israel2d ago
-
Ansible | BMC | CI/CD | CRUSH | CephExecutive-level Full TimeKfar Saba, Center District, Israel2d ago
-
Senior Data Engineer ILS 338K-473KApache Airflow | Apache Beam | Apache Spark | BigQuery | Cloud ComputingHealth and wellness benefits | Hybrid work model | Inclusive work environmentSenior-level Full TimeRamat Gan, Tel Aviv District, IL R2d ago
-
3D Geometry | C++ | Computer Vision | Embedded Systems | Machine LearningTeamwork collaborationMid-level Full TimeRosh Ha'Ayin, Israel, IL2d ago
-
Backend Team Leader-Data Platform ILS 338K-473KAmazon MSK | Amazon Web Services | Apache Flink | Apache Kafka | Data ModelingHybrid workSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel R2d ago
-
Senior Algorithm Engineer ILS 362K-504KA/B | A/B Testing | B testing | Deep learning | High ThroughputComprehensive benefits | Fully stocked kitchen | Hybrid work schedule | Location-specific perks | Mentorship opportunitiesSenior-level Full TimeTel Aviv, Israel R3d ago
-
AI Governance | AI Security | API Development | Agent systems | Agentic AIContract engagement | Fully remote workSenior-level Full TimeIsrael R3d ago
-
Mid-level Full TimeTel Aviv, Israel R3d ago
-
M.Sc Student Deep Learning Algorithm Developer ILS 336K-504KAlgorithms | Computer Vision | Data Structures | Deep learning | Machine LearningNone Full TimeRamat Gan, Israel3d ago
-
Mid-level Full TimeJerusalem, Israel3d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R3d ago
-
Senior-level Full TimeRa'anana, Center District, IL R4d ago
-
Senior Software Engineer- Data Engineering ILS 360K-504KAWS | Apache Airflow | Apache Iceberg | Apache Kafka | Artificial IntelligenceSenior-level Full TimeTel Aviv, Israel4d ago
-
Machine Learning Engineer student for AI Solutions Group ILS 170K-230KArgo | Docker | Elastic | Generative AI | GitHybrid work model | Student internship arrangementNone Part TimeISR - Haifa, Israel R4d ago
-
Senior/Principal Backend AI Engineer (Cortex XSIAM) ILS 384K-504KAI | AWS | Cloud Computing | Cloud platform | ContainerizationSenior-level Full TimeTel Aviv, Tel Aviv4d ago
-
AI Engineer ILS 321K-400KAnthropic Claude | Asynchronous pipelines | Authentication | Credential Handling | Error HandlingDinners provided | Dog-friendly office | Fully stocked kitchen | Global teams | Happy hoursSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL4d ago
-
Senior-level Full TimeNetanya, Center District, IL R4d ago
-
Algorithms | CI/CD | Data Structures | Development Principles | LinuxMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL4d ago
-
Data Engineer (Agentic Search) ILS 174K-222KAWS | Airflow | BigQuery | DBT | Data Freshness MonitoringCareer growth and learning opportunities | Collaborative culture | Flexibility | International environment | Opportunity to work on impactful AI projectsMid-level Full TimeIsrael5d ago
-
Senior Software Engineer - Big Data Platform ILS 504K-630KAI machine learning | Angular | Distributed Systems | JavaScript | KubernetesSenior-level Full TimeTel Aviv5d ago
-
Senior Backend Software Engineer (AI Engineering) ILS 444K-528KEvaluation harnesses | GraphQL | Kafka | Monorepos | NestJSSenior-level Full TimeTel Aviv-Yafo, IL R5d ago
-
Data Ingestion | Data Modeling | Data Quality | Data Transformation | Data pipelineMid-level Full TimeTel Aviv, Israel5d ago
-
Principal Computer Vision Engineer ILS 420K-540KC++ | CUDA | Deep learning | Feature Matching | HomographyFlex first work arrangement | In-person eventsSenior-level Full TimeIsrael - Hybrid (3 days/week in … R5d ago
-
Mid-level Full TimeRamat Gan, Israel, IL R5d ago