Data Engineer
Tasks
- Automate data validation
- Build ETL pipelines batch incremental real time
- Domain expert in connected vehicle data
- Ensure data quality and reliability
- Follow security and privacy policies
- Manage and evolve data schemas
- Monitor tune and optimize Spark jobs
- Perform security-focused code reviews
- Report security incidents
- Standardize ingestion validation and cleaning processes
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Amazon S3 | Apache Hudi | Apache Kafka | Apache Spark | Argo | C++ | Delta Lake | ETL | HDFS | Java | Kafka Streams | Kubernetes | Prefect | Python | SQL | Scala | Spark Streaming
Education
N/A
Roles
Related jobs
-
Anthropic Claude | Async Programming | ChatGPT | Claude Code | CodexDirect user impact | Flexible work schedule | Occasional international travel | Work from home optionMid-level Full TimeSlovenia / Remote R8d ago
-
Amazon S3 | Apache Airbyte | Apache Airflow | Apache Hudi | Apache KafkaFlexible work options | International travel | Work from homeSenior-level Full TimeSlovenia / Remote R8d ago