Data Engineer - Search Department (SED)
Tasks
- Collaborate with data scientists and analysts
- Design data pipelines
- Develop ETL processes
- Document data workflows and systems
- Ensure data quality, integrity, and security
- Improve search quality and relevance
- Maintain data warehouses and databases
- Monitor and troubleshoot pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache NiFi | Apache Spark | BigQuery | Cloud platform | Data Architecture | Data Governance | Data Modeling | Data Visualization | Docker | Google Cloud | Google Cloud Platform | Hadoop | Image search | Java | Kubernetes | Machine Learning | Microsoft Azure | Power BI | Python | SQL | Scala | Semantic Search | Snowflake | Tableau | Talend | Web Services
Roles
Related jobs
-
Data Engineer AUD 60K-60KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeKochi, India20h ago
-
AI Engineer JPY 7500K-12000KChatGPT | Cloud PubSub | Cloud Storage | Datadog | Deep learningBook purchase support | Conference participation support | Full remote | Learning SupportMid-level Full TimeTokyo R1d ago
-
Automation | Cause analysis | Data Modeling | Data Quality | Data modelsPlatinum customer supportSenior-level Full TimeTokyo3d ago
-
Software Engineer - Experimentation System - Mercari JPY 8600K-9700KA/B | A/B Testing | API Design | Allocation Optimization | B testingFlexible work hours | No core timeSenior-level Full TimeMinato City, Tokyo, Japan3d ago
-
Senior Data Scientist - AI Agent Development Section, Business Support Development Department (BSD) JPY 8000K-12500KAWS | Cloud Computing | Cloud platform | Data Analysis | Deep learningBusiness-level language support | Mentoring opportunitiesSenior-level Full TimeRakuten Crimson House, Japan4d ago
-
Senior-level Full TimeKochi, India7d ago
-
Quality Assurance Engineer (Embedded Systems, Manufacturing Process) JPY 7200K-11800KAutomated testing | Bash | C++ | Cause analysis | Computer VisionCommuting allowance | Flexible dress code | Flight ticket support | Free drinks | Free lunchSenior-level Full TimeTokyo, Japan (MJHQ)7d ago
-
R&D-038 Data Engineer JPY 8500K-9700KAirflow | Amazon Athena | Apache Flink | Apache Hudi | Apache IcebergAcademic engagement | Career growth opportunities | Opportunity to publish research papersSenior-level Full TimeHeiwajima, Tokyo, Japan7d ago
-
Senior Data Engineer JPY 8600K-9700KData Architecture | Data Cleansing | Data Engineering | Data Modeling | Data PipelinesFinancial wellbeing support programs | Flexible work schedule | Healthcare coverage | Mental health resources | Paid time offSenior-level Full TimeJPN - Tokyo Prefecture - Tokyo … R7d ago
-
Senior Data Engineer JPY 8600K-9700KData Cleansing | Data Engineering | Data Governance | Data Modeling | Data PipelinesFinancial security support | Flexible work culture | Healthcare coverage | Mental health resources | Paid time offSenior-level Full TimeJPN - Tokyo Prefecture - Tokyo … R7d ago
-
Senior Embedded Software Systems Engineer - Robotics JPY 8600K-9700KARM Cortex | ARM Cortex-M | C# | C++ | CANCommuting allowance | Flexible working hours | Global workplace | Relocation support | Visa sponsorshipSenior-level Full TimeKoto City, Tokyo, Japan8d ago
-
Robotics Systems Engineer JPY 8000K-11800KC++ | CI Pipelines | Continuous integration | Diagnostics | DockerAccess to state-of-the-art technology | Collaborate with talented engineers | International working environmentSenior-level Full TimeKoto City, Tokyo, Japan8d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Remote-friendly culture | Supportive team environmentMid-level Full TimeTokyo, Japan9d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Hands-off management | Portfolio links submission via application | Remote distributed settingMid-level Full TimeYokohama, Japan9d ago
-
Robotics Engineer, Foundation Model JPY 7000K-12000KComputer Vision | Data Pipelines | Deep learning | Distributed Training | Edge ComputingMid-level Full TimeTokyo10d ago
-
Senior Machine Learning Engineer, Energy Products JPY 6800K-10000KAWS | CI/CD | Control Theory | Data Science | DockerSenior-level Full TimeTokyo10d ago
-
Senior Infra Engineer - Full Cycle Retail Robotics Engineering JPY 7000K-12500K.NET | ARM64 | Ansible | Azure | Azure ContainerOccasional travel for on site supportSenior-level Contract Full TimeTokyo10d ago
-
Executive-level Full TimeJapan - Tokyo10d ago
-
AI Solution | AI solution design | AI system architecture | Agile | CUDAInternational team collaboration | On site work Japan | Relocation support | Visa sponsorshipMid-level Full TimeOsaka, Japan11d ago
-
Agile | CUDA | Computer Vision | Deep learning | Fine TuningInternational collaboration | Onsite work support | Relocation support | Visa sponsorshipMid-level Full TimeSaitama, Japan11d ago
-
Senior-level Full TimeKochi, IN11d ago
-
Lead Data Engineer - Data Migration JPY 7350K-13500KAWS Glue | Agentforce | Azure Data | Azure Data Factory | Azure SQLSenior-level Full TimeKochi, IN12d ago
-
[XC-AS] DataOps Engineer - ADAS Data Platform JPY 2760K-5268KApache Airflow | Argo Workflows | Azure Monitor | Azure Resource | Azure Resource ManagerMid-level Full TimeYokohama, Kanagawa, Japan12d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn site work in Tokyo | Relocation support | Visa sponsorshipSenior-level Full TimeTokyo, Kantō, Japan12d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn site work Tokyo Japan | Relocation assistance | Visa sponsorshipSenior-level Full TimeYokohama, Kanagawa, Japan12d ago