Senior Data Engineer, Telemetry and Infrastructure
Tasks
- Build monitoring and alerting
- Build streaming pipelines
- Define data technical roadmap
- Deliver cluster performance insights
- Design ETL/ELT frameworks
- Develop notebooks and APIs
- Ensure security and operational excellence
- Implement data observability and data quality
- Ingest telemetry and performance data
- Manage metadata
- Optimize pipeline throughput and reliability
- Promote data modeling and code quality best practices
- Support end to end test coverage
- Support self-service analytics
- Track lineage
- Transform and classify data
- Validate schemas
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Alation | Apache Iceberg | Apache Kafka | Apache Spark | Azure | CI/CD | Collibra | Dagster | Data Catalog | Data Governance | Data Validation | Data Versioning | Databricks | Databricks Notebooks | Datadog | Datahub | Delta Lake | ELT | ETL | Flink | GCP | GitHub Actions | Grafana | Great Expectations | Infrastructure as Code | Kafka Streams | Prefect | Prometheus | PySpark | Python | SQL | Scala | Schema Registry | Schema evolution | Spark Structured Streaming | Streaming | Structured Streaming | Terraform | “as-code”
Education
Roles
Related jobs
-
Azure Synapse | Azure Synapse Analytics | BigQuery | ClickHouse | Data ModelingMid-level Full TimeHolon, Center District, IL8h ago
-
Senior Machine Learning Engineer - Syte ILS 420K-504KAirflow | CI/CD | Docker | Elasticsearch | GitHub ActionsSenior-level Full TimeHerzliya, Israel, IL8h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL11h ago
-
Benchmarking | Data Quality | Dataset development | Deep learning | LLM APIsSenior-level Full TimeTel-Aviv, Israel, IL14h ago
-
Senior-level Full TimeTel Aviv, IL22h ago
-
Sr. Data Engineer - Cloud Security (Hybrid, ISR) ILS 380K-473KAWS | Apache Iceberg | Apache Spark | Cassandra | DockerCompetitive vacation and holidays | Employee networks | Paid adoption leave | Paid parental leave | Professional development opportunitiesSenior-level Full TimeTel Aviv (Sky Tower), Israel R22h ago
-
AWS | Azure | Azure Functions | CWE | Cloud RunMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Senior-level Full TimeKfar Saba1d ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Senior-level Full TimeIL - Petah Tikva, Israel1d ago
-
Senior-level Full TimeTel-Aviv, Israel2d ago
-
API Integration | Computer Vision | Data Preprocessing | Deep learning | Document UnderstandingSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
APIs | AWS | Amazon Athena | Amazon Redshift | Apache AirflowSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Data Analysis | Go-to-Market Strategy | Go-to-market | KPI Management | Language ProcessingSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Mid-level Full TimeTel-Aviv, Israel, IL2d ago
-
API Orchestration | AWS | Apache Kafka | Apache Spark | BigQuerySenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Mid-level Full TimeHerzliya, Tel Aviv District, IL2d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Senior-level Full TimeIsrael, Tel Aviv2d ago
-
API Gateway | AWS | AWS CodeBuild | AWS CodePipeline | AWS FargateEmployee stock option plan | Flexible working options | Health insurance | Home-office allowance | Parental leaveSenior-level Full TimeRemote Israel R3d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL3d ago
-
Mid-level Full TimeJerusalem, Israel3d ago
-
Senior-level Full TimeTel-Aviv, Israel4d ago
-
Senior-level Full TimeHolon5d ago