Big Data Engineer
Tasks
- Build and optimize data pipelines
- Design data pipeline architecture
- Implement data governance
- Implement data validation, cleansing, enrichment
- Maintain high availability
- Manage scalable cloud data infrastructure
- Mentor junior data engineers
- Monitor data pipeline health
- Optimize data processing and storage performance
- Process transform and integrate large data volumes
- Troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Spark | Data Modeling | Data integration | Delta Lake | Distributed Systems | ETL | GCP | Hadoop | Parquet | PySpark | SQL | Scala
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeRamat Gan, Israel, IL R3h ago
-
Mid-level Full TimeTel Aviv, Israel R1d ago
-
Senior DevOps Engineer- Posture USD 130K-220KAWS | ArgoCD | Bash | Blue-Green Deployment | Blue/greenSenior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R1d ago
-
AWS Athena | AWS Glue | Amazon ECS | Amazon EMR | Amazon EMR ServerlessBenefits | Bonus incentives | Flexible hours | MentoringMid-level Full TimeRa'anana, Center District, IL R4d ago
-
Senior Backend Engineer- Data Platform ILS 362K-504KAPI Design | AWS | Asynchronous programming | Automated testing | Batch ProcessingCompetitive salary | Fully remote | Generative AI productivity assistanceSenior-level Full TimeRamat Gan, Israel R4d ago
-
Senior-level Full TimeRa'anana, Center District, IL R4d ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R4d ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R5d ago
-
Senior Applied AI Engineer ILS 336K-443KAgentic Workflows | Evaluation Frameworks | GenAI | Guardrails | JavaScriptFlexible work culture | Hybrid work | L D programs | RSU offeringsSenior-level Full TimeIsrael - Tel Aviv R5d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R6d ago
-
Senior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R7d ago
-
Mid-level Full TimeTel Aviv, IL R8d ago
-
Mid-level Full TimePetah Tikva, Center District, IL R8d ago
-
Senior DevOps Engineer Platform Engineering ILS 420K-504KAWS | Arc | BuildKit | CI/CD | Container signingSenior-level Full TimeTel Aviv, Israel R8d ago
-
API Integration | AWS | Asynchronous processing | Batch Processing | CI/CDSenior-level ContractKiryat Ono, Israel, IL R11d ago
-
AI Developer Builder USD 140K-180KAWS | Agentic Systems | Anthropic Bedrock | Context pipelines | DatadogDirect input on roadmap | High ownershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R11d ago
-
3D processing | AWS | CNN | Computer Vision | Convolutional Neural NetworksFlexible remote days | Hybrid work | Professional growth supportMid-level Full TimeHerzliya, Israel R12d ago
-
Backend Team Leader-Data Platform ILS 283K-366KAWS | Amazon MSK | Amazon S3 | Apache Flink | Apache KafkaHybrid work modelSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel R13d ago
-
Data Engineer - Attribute™ ILS 102K-122KApache Spark | CI/CD | Cloud platform | Data Pipelines | ETLEmployee stock option plan | Flexible working options | Health insurance | Home-office allowance | Parental leaveMid-level Full TimeOn-Site Israel. Attribute Office: Carlibach St … R14d ago
-
Senior Backend Engineer - Data Platform ILS 420K-510KAWS | Apache Kafka | Capacity Planning | Distributed Systems | Fault ToleranceHybrid work location | Professional development | Team knowledge sharingSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R14d ago
-
Data Engineer USD 125K-160KCloud Architecture | Cloud infrastructure | Data Modeling | Data Monitoring | Data QualitySenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R18d ago
-
Senior DevOps Engineer ILS 283K-366KAWS | Argo CD | BigQuery | CI/CD | ClearMLHybrid work environment | Inclusive workplaceSenior-level Full TimeRamat Gan, Tel Aviv District, IL R18d ago
-
AWS | Apache Kafka | Capacity Planning | Distributed Systems | Fault ToleranceSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1mo ago
-
Senior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1mo ago
-
AWS | Apache Kafka | Capacity Planning | Distributed Systems | JavaHybrid work | Learning and development | Modern technology stackSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1mo ago