Senior Data Engineer - Big Data
Tasks
- Architect cloud data infrastructure
- Build data pipelines
- Collaborate with cross-functional teams
- Debug production Spark code
- Design data pipelines
- Ensure data quality and consistency
- Implement data logging
- Implement data monitoring and alerting
- Maintain data pipelines
- Maintain real time streaming pipelines
- Manage data lake
- Manage data warehouse
- Optimize ETL/ELT pipelines
- Troubleshoot production data pipelines
Perks/Benefits
- Fully stocked kitchen
- Happy hours
- Hybrid work model
- Internal learning tools
- Mentorship program
- Nearby parking
- Pet-friendly office
Skills/Tech-stack
Airflow | Amazon EMR | Amazon Redshift | Amazon S3 | Apache Iceberg | Apache Spark | BigQuery | Bronze Silver Gold | Cloud Dataproc | Cloud Storage | Data Lake | Data Warehouse | Delta Lake | ELT | ETL | Flink | Google Cloud | Google Cloud Dataproc | Google Cloud Storage | Hive | Java | Kafka | Lakehouse | Medallion Architecture | Python | Scala | Trino
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior-level Full TimeHerzliya, Tel Aviv District, IL13h ago
-
Senior-level Full TimeRosh Ha'ayin, Israel, IL14h ago
-
Senior-level Full TimeTel Aviv, Israel, IL14h ago
-
AWS | Agentic Workflows | CI/CD | Cloud platform | Data PipelinesAir Gapped Deployment Experience | On premise deployments | On site customer collaborationMid-level Full TimePetah Tikva, Center District, IL17h ago
-
Applied AI Engineer ILS 227K-311KAgentic Systems | Anomaly Detection | Artificial Intelligence | Classification | Data EnrichmentEnglish proficiency required | Onsite workMid-level Full TimeTel Aviv, Israel1d ago
-
Agent Frameworks | Agent Protocol | Agent to Agent | Agent-to-Agent protocol | Asynchronous programmingSenior-level Full TimeIsrael, Yokneam1d ago
-
Apache Spark | Data Quality | Data Validation | Data pipeline | Distributed ComputingSenior-level Full TimeRamat Gan, Israel1d ago
-
API Integration | Data Pipelines | LLM Evaluation | Machine Learning | Prompt engineeringFast-learning environment | Opportunity to build new products | Real ownershipMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel1d ago
-
Entry-level Full TimeTel Aviv1d ago
-
Senior-level Full TimeJerusalem, Israel1d ago
-
Mid-level Full TimePetah Tikva, Central District2d ago
-
Staff Data Engineer (Data & AI solutions) ILS 338K-473KAWS Athena | AWS Glue | Amazon EMR | Amazon SageMaker | Amazon Web ServicesSenior-level Full TimePetah Tikva, Central District2d ago
-
Principal Data Engineer (Cortex) ILS 402K-504KAmazon Redshift | Apache Beam | Azure Data | Azure Data Explorer | Azure SQLSenior-level Full TimeTel Aviv, Tel Aviv2d ago
-
Senior-level Full TimeTel Aviv, Israel3d ago
-
Mid-level Full TimeTel Aviv, Israel3d ago
-
Attention Mechanisms | Batching | CUDA | Compute Graphs | Distributed SystemsFlexible remote workSenior-level Full TimeIsrael3d ago
-
Assembly Language | C# | C++ | CPU Benchmarking | Embedded LinuxSenior-level Full TimeJerusalem, Israel3d ago
-
API Design | AWS | Agentic patterns | Amazon S3 | CachingMentorship | Professional growth | Technical leadershipSenior-level Full TimeTel-Aviv, Israel4d ago
-
Forward Deployed Engineer ILS 402K-504KAPI Development | AWS | Agentic AI | Azure | CI/CDClient-facing work | Cross-functional team collaboration | Hybrid workSenior-level Full TimeTel Aviv, Tel Aviv District, IL4d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL4d ago
-
Benchmarking | Data parallelism | Deep learning | Distributed Computing | JAXSenior-level Full TimeTel Aviv, Israel4d ago
-
A/B | A/B Testing | B testing | Calibration | Deep learningComprehensive benefits | Fully stocked kitchen | Hybrid work schedule | Location-specific perks | Well-being programsMid-level Full TimeTel Aviv, Israel4d ago
-
Software Engineer - Data Pipelines ILS 200K-240KAWS Lambda | AWS S3 | Amazon EMR | Amazon SNS | Amazon SQSOn-call supportMid-level Full TimeIsrael - Office - Tel Aviv4d ago
-
APIs | Data Ingestion | Data Modeling | Data Quality | Data TransformationEnglish proficiency required | On-site work environmentMid-level Full TimeTel Aviv, Israel5d ago
-
API Gateway | AWS Bedrock | AWS Lambda | Amazon API | Amazon API GatewayFlexible working hours | Mentoring | Professional developmentSenior-level Full TimeRa'anana, Center District, IL5d ago