Software Engineer - Data Pipelines
Israel - Office - Tel Aviv
ILS 200K-240K (estimate) Mid-level Full Time
Tasks
- Author Airflow DAGs
- Build data pipelines end-to-end
- Build pipelines for access layer data
- Design Snowflake schemas
- Develop automated tests
- Implement CI CD deployments
- Implement data health frameworks
- Implement distributed tracing
- Maintain observability
- Optimize PySpark jobs
- Run conditional data quality checks
- Set up AWS data services integration
- Write distributed data processing jobs
Perks/Benefits
Skills/Tech-stack
AWS | AWS Lambda | AWS MWAA | Amazon EMR | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Databricks | Distributed tracing | Great Expectations | PySpark | Pydantic | Pytest | Python | Snowflake
Education
N/A
Roles
Related jobs
-
Senior Backend Engineer — GenAI Group ILS 362K-504KAPI Design | AWS | Agent Frameworks | Agile Development | AlertingSenior-level Full TimeRamat Gan, Tel Aviv District, IL23h ago
-
Mid-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL1d ago
-
Adversarial Networks | Computer Vision | Dataset curation | Deep learning | Diffusion ModelsMid-level Full TimeTel Aviv, Israel1d ago
-
Senior-level Full TimeTel Aviv, Tel Aviv District, IL1d ago
-
Mid-level Full TimeYizre'el, North District, IL1d ago
-
AWS | Azure | Cloud Computing | Data Preprocessing | Deep learningContinuous learning | Flexible work environment | Fully remote | Professional growth | Work-life balanceMid-level Full TimeIsrael R1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Flexible, hands-off management | Remote-friendly environmentMid-level Full TimeTel Aviv, Israel1d ago
-
Software Engineer (DS Team) ILS 120K-144KAWS | CI/CD | Clean Code | Continuous Deployment | Continuous integrationWork-life balanceMid-level Full TimeTel Aviv-Yafo, Gush Dan, Israel1d ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel2d ago
-
Amazon Athena | Apache Spark | Data Pipelines | Debugging | ETLMid-level TemporaryJerusalem, Israel2d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel2d ago
-
Entry-level Full TimeHaifa, Israel2d ago
-
Mid-level Full TimeJerusalem, Israel2d ago
-
AI Data | AI data analysis | Big Data | Data Analysis | Decision supportSenior-level Full TimeIsrael, Yokneam2d ago
-
MLOps Engineer ILS 420K-504KAWS | Amazon SQS | Apache Airflow | Apache Kafka | CI/CDContinuous learning | Flexible work environment | Professional growthSenior-level Full TimeRamat Gan (Hybrid) R3d ago
-
Senior-level Full TimeHerzliya, Tel Aviv District, IL3d ago
-
Senior-level Full TimeRosh Ha'ayin, Israel, IL3d ago
-
Senior-level Full TimeTel Aviv, Israel, IL3d ago
-
AWS | Agentic Workflows | CI/CD | Cloud platform | Data PipelinesAir Gapped Deployment Experience | On premise deployments | On site customer collaborationMid-level Full TimePetah Tikva, Center District, IL3d ago
-
Automation | Data Analysis | Data Monitoring | Machine Learning | PythonMid-level Full TimeRamat Gan, Israel3d ago
-
Applied AI Engineer ILS 227K-311KAgentic Systems | Anomaly Detection | Artificial Intelligence | Classification | Data EnrichmentEnglish proficiency required | Onsite workMid-level Full TimeTel Aviv, Israel3d ago
-
Agent Frameworks | Agent Protocol | Agent to Agent | Agent-to-Agent protocol | Asynchronous programmingSenior-level Full TimeIsrael, Yokneam3d ago
-
Principal Data Engineer ILS 338K-473KAWS | Airflow | Automation | Azure | CI/CDCareer Development Programs | Health and wellbeing benefits | Hybrid work schedule | Work-life flexibilitySenior-level Full TimeTel Aviv, Israel3d ago
-
Senior-level Full TimeTel Aviv, Israel3d ago
-
Principal Data Engineer ILS 338K-473KAWS | Amazon Kinesis | Apache Airflow | Automation | AzureCareer Development Programs | Health and wellbeing benefits | Hybrid work schedule | Work-life flexibilitySenior-level Full TimeTel Aviv, Israel3d ago