Big Data Engineer
Tasks
- Build data pipelines
- Design data pipeline architecture
- Design scalable cloud data infrastructure
- Ensure high availability of data infrastructure
- Implement data governance practices
- Implement data validation and cleansing
- Integrate large volume data from multiple sources
- Monitor pipeline health and performance
- Optimize data processing performance
- Perform data enrichment
- Provide mentorship to junior data engineers
- Troubleshoot data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Spark | Azure | Cloud platform | Data Transformation | Data integration | Delta Lake | Distributed Computing | ETL | Google Cloud | Google Cloud Platform | Hadoop | Java | Parquet | PySpark | Python | SQL | Scala
Education
Roles
Related jobs
-
Bash | Cloud infrastructure | Data Ingestion | Data Ingestion Pipeline | Data ProcessingMid-level Full TimeHaifa, Israel1d ago
-
AWS | Agent Orchestration | Agentic Systems | Anthropic | Deep learningMid-level Full TimeTel Aviv, Israel, IL1d ago
-
AI Agents | API | CRM Integration | Customer Relationship Management | Customer relationshipMid-level Full TimeRehovot, Center District, IL1d ago
-
Mid-level ContractTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Mid-level Full TimeNetanya, Center District, IL1d ago
-
Senior-level Full TimeTel Aviv, Israel1d ago
-
Mid-level Full TimeTel Aviv, Israel1d ago
-
C++ | Camera Calibration | Computational Geometry | Computer Vision | Deep learningCommuting support | Hybrid work | Remote work optionsMid-level Full TimeNess Ziona, Center District, IL1d ago
-
AWS | Agent systems | Agentic AI | Azure | Conversational AIHybrid work model | Innovation support | Research-driven cultureSenior-level Full TimeHerzliya, Israel1d ago
-
Mid-level Full TimePetah Tikva, Israel1d ago
-
Senior-level Full TimeIsrael, Yokneam1d ago
-
Senior Software Engineer - Cloud Security ILS 420K-504KAmazon Web Services | Apache Kafka | Apache Spark | Azure | Cloud SecuritySenior-level Full TimeIsrael2d ago
-
C++ | Computer simulation | Digital Modem | Digital Signal | Digital Signal ProcessingMid-level Full TimeRosh Ha'ayin, Israel, IL2d ago
-
Amazon EKS | Amazon Web Services | ArgoCD | Composition analysis | Container OrchestrationMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Data Mining | Data Pipelines | Deep learning | Evaluation Pipelines | Generative AISenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Senior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL2d ago
-
Cloud platform | Data Integrity | Data Processing | Data Warehousing | Data pipelineSenior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL2d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Senior-level Full TimeTel Aviv, Israel2d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
3D Reconstruction | COLMAP | Clustering | Deep learning | Depth EstimationSenior-level Full TimeTel Aviv, Tel Aviv District, IL2d ago
-
Sr. Data Engineer, Cloud Security (Hybrid, ISR) ILS 341K-443KAWS | Apache Iceberg | Apache Spark | Cassandra | DockerMental wellness programs | Paid parental leave | Paid vacation and holidays | Physical wellness programs | Professional development opportunitiesSenior-level Full TimeTel Aviv (Sky Tower), Israel R2d ago
-
Data Analyst Engineer ILS 76K-76KData Analysis | Database | Functional testing | Python | SPCCareer growth | Company events | Holiday gifts | Meal plan | Team building eventsEntry-level Full TimeMigdal Ha-Emek, Israel2d ago
-
C# | C++ | Java | Object-Oriented | Object-oriented programmingOpen source contributionsEntry-level Full TimeRehovot, IL2d ago