Senior Data Engineer ( Data Collection)
Tasks
- Collaborate with product managers
- Conduct code reviews
- Design data ingestion pipelines
- Develop data infrastructure
- Ensure high scale ingestion reliability
- Lead technical design decisions
- Monitor system health and data quality
- Optimize performance and scalability
- Own ingestion services end to end
Perks/Benefits
Skills/Tech-stack
AWS | Amazon SQS | Apache Airflow | Apache Spark | Data Ingestion | Data Pipelines | Databricks | Performance optimization | Production Systems | Reliability Engineering | Scalability | System monitoring
Education
N/A
Roles
Related jobs
-
Airflow | Apache Spark | CI/CD | DBT | Data ObservabilityHybrid work | Mentorship | Work from office 3 days per weekSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R7d ago
-
API Integration | AWS | Azure | CI/CD | Data LakesConference opportunities | Fully remote work | High-impact projects | Modern work equipment | Professional development budgetMid-level Full TimeIsrael R7d ago
-
Sr. Data Engineer, Cloud Security (Hybrid, ISR) ILS 341K-443KAWS | Apache Iceberg | Apache Spark | Azure | CassandraCompetitive vacation and holidays | Comprehensive wellness programs | Employee volunteer opportunities | Paid adoption leave | Paid parental leaveSenior-level Full TimeTel Aviv (Sky Tower), Israel R10d ago
-
AWS | ClickHouse | Cloud Native | GCP | KafkaContinuous learning | Hybrid work | Innovation culture | Remote within EU time zoneMid-level Full TimeRamat Gan, IL R20d ago
-
API Integration | AWS | Access Control | Apache Airflow | AuthenticationFlexible work schedule | Hybrid work model | Remote work flexibilityMid-level Full TimeIsrael - Raanana R1mo ago
-
API Authentication | API pagination | API rate-limiting | AWS | Apache AirflowCareer growth opportunities | Collaborative work environment | Flexible schedule | Hybrid work model | Remote work optionMid-level Full TimeIsrael - Raanana R1mo ago
-
Senior AI Solution Engineer ILS 341K-443KAI Model Evaluation | AI model | Amazon Athena | Apache Airflow | CI/CDGym membership | Healthy Meals | Hybrid work model | Meal card | ParkingSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R1mo ago
-
AWS | Azure | Distributed Systems | Django | ELKFlexible working | Hybrid work | Work from home optionSenior-level Full TimeIsrael R1mo ago
-
AWS | Azure | Cloud deployment | Containerization | CrewAIRemote workMid-level Full TimeTel Aviv; Haifa R1mo ago
-
Amazon Web Services | Apache Beam | Apache Flink | Apache Kafka | Apache SparkAnnual company offsite | Global team collaboration | Hybrid work model | Professional growthSenior-level Full TimeRishon Lezion R1mo ago