Data Engineer - Search Department (SED)
Tasks
- Collaborate with data scientists and analysts
- Design data pipelines
- Develop ETL processes
- Document data workflows and systems
- Ensure data quality, integrity, and security
- Improve search quality and relevance
- Maintain data warehouses and databases
- Monitor and troubleshoot pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache NiFi | Apache Spark | BigQuery | Cloud platform | Data Architecture | Data Governance | Data Modeling | Data Visualization | Docker | Google Cloud | Google Cloud Platform | Hadoop | Image search | Java | Kubernetes | Machine Learning | Microsoft Azure | Power BI | Python | SQL | Scala | Semantic Search | Snowflake | Tableau | Talend | Web Services
Roles
Related jobs
-
AI productivity | AI productivity tools | Apache Spark | Batch Processing | BigQueryMid-level Full TimeFutakotamagawa Rise Office, Japan22h ago
-
R&D-032 Electrical Engineer (Robotics) JPY 4100K-6200KActuator integration | Battery systems | Brushless DC | C# | C++Mid-level Full TimeHeiwajima, Tokyo, Japan22h ago
-
Data Engineer JPY 8000K-15000KAuth0 | Azure | Datadog | Docker | GitHub CopilotConference participation support | Learning Support | OSS supportMid-level Full TimeTokyo1d ago
-
Senior Technical Solutions Engineer (Platform) JPY 8281K-9700KAWS | Azure | Big Data | Distributed Computing | GCPOn-call rotationSenior-level Full TimeTokyo, Japan1d ago
-
Senior Backend Engineer - Full Cycle Retail Robotics Engineering JPY 8000K-12500K.NET | ARM64 | Ansible | Azure | BlazorSenior-level Contract Full TimeTokyo1d ago
-
A/B | A/B Testing | B testing | Batch inference | CI/CDMid-level Full TimeRakuten Crimson House, Japan1d ago
-
Agile | Bash | Bazel | C# | C++Annual paid leave | Childcare leave | Commuting allowance | Employee gym access | Flex holidaySenior-level Full TimeTokyo, Japan (MJHQ)3d ago
-
R&D-031 Firmware / Embedded Software Engineer (Robotics) JPY 6500K-8750KAnomaly Detection | C# | C++ | CAN | CANopenMid-level Full TimeHeiwajima, Tokyo, Japan3d ago
-
Backend Software Engineer, Robot Platform Software JPY 3600K-6000KAMQP | CI/CD | Debugging | DevOps | DockerMid-level Full TimeTokyo4d ago
-
Sr. Forward Deployed Engineer JPY 8000K-9700KAWS | Apache Spark | Azure | CI/CD | Cloud platformCustomer-facing role | Travel opportunitiesSenior-level Full TimeTokyo, Japan7d ago
-
Senior Machine Learning Engineer, Credit ML - Merpay JPY 8600K-9700KAlerting | Data Drift | Data Drift Detection | Drift Detection | Experiment ManagementSenior-level Full TimeMinato City, Tokyo, Japan7d ago
-
Next Frontier Quantum Associate JPY 4800K-7200KAWS Braket | Azure Quantum | CI/CD | Certificate management | CirqFlexible global teamworkMid-level Full TimeKochi, KL, IN, 6823137d ago
-
Forward-Deployed Data Scientist JPY 4800K-7200KAirflow | CI/CD | CatBoost | Cloud platform | Code reviewComprehensive health benefits | Dental insurance | Disability insurance | Employee stock purchase plans | Equal Paid Parental LeaveMid-level Full TimeTokyo8d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipeline | Data ProcessingFlexible asynchronous culture | Friendly work environment | Inclusive workplace | Remote work opportunityMid-level Full TimeTokyo, Japan8d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible management approach | Remote-friendly work cultureMid-level Full TimeYokohama, Japan8d ago
-
AI tools | API Integration | Analog circuit | Analog circuit design | Circuit designSenior-level Full TimeHashimoto, Japan8d ago
-
Agile | Analytics architecture | Artificial Intelligence | Data Engineering | Data GovernanceMid-level Full TimeOsaka, Japan9d ago
-
Agile | Analytics architecture | Data Engineering | Data Governance | Data PipelinesMid-level Full TimeTokyo, Kantō, Japan9d ago
-
Senior Data Engineer - Databricks JPY 8000K-9700KAirflow | Amazon Web Services | Apache Kafka | Apache Spark | CI/CDContinuous learning resources | Hybrid work options | International collaboration | Knowledge sharing culture | Professional development resourcesSenior-level Full TimeTokyo, Chiyoda, Japan10d ago
-
シニアデータエンジニア ‐ データブリックス JPY 7000K-9700KAWS | Airflow | Ansible | Apache Kafka | Apache NiFiCareer development support | Global collaboration | Hybrid work | Professional development support | Qualification supportSenior-level Full TimeTokyo, Chiyoda, Japan R10d ago
-
Quantum Integration Engineer JPY 6634K-9014KCalibration | Cloud Computing | Cryogenics | Data Analysis | Experimental dataFlexible hours | Hybrid setup | Travel opportunitiesMid-level Full TimeTokyo, Japan R10d ago
-
Senior Machine Learning Engineer, Behavior JPY 7000K-10000KAblation Studies | Agile Development | C++ | Camera Calibration | Computer VisionHybrid workspace | On site office daysSenior-level Full TimeTokyo10d ago
-
Applied AI Architect JPY 8600K-9700KClaude API | Cloud Architecture | Data Science | Enterprise Integration | LLM EvaluationFlexible working hours | Generous vacation | Parental leave | Visa sponsorshipSenior-level Full TimeTokyo, Japan10d ago
-
Computer Vision | Convolutional Neural Networks | Data Preprocessing | Deep learning | Language ProcessingBilingual environment | Flex Time | Full remote | Opportunities for career advancement | Pre IPO phaseSenior-level Full TimeShinjuku, Japan R11d ago
-
Amazon Redshift | BigQuery | CI/CD | Data Catalog | Data GovernanceFlextime | Fully remoteMid-level Full TimeNishishinjuku (Tsuginobiruonozoku), Japan R11d ago