R&D-038 Data Engineer
Heiwajima, Tokyo, Japan
JPY 8500K-9700K (estimate) Senior-level Full Time
Tasks
- Build distributed data-processing pipelines
- Collaborate with VLA researchers to refine requirements
- Design data pipelines for robotics datasets
- Design data schemas storage and query interfaces
- Monitor and improve data quality
- Process curate publish datasets
Perks/Benefits
Skills/Tech-stack
Airflow | Amazon Athena | Apache Flink | Apache Hudi | Apache Iceberg | Apache Spark | Dagster | Data Engineering | Data Lineage | Data Quality | Data Versioning | Delta Lake | Distributed Systems | ELT | ETL | Faiss | Full-text search | Hadoop Ecosystem | Kafka | Kubernetes | Kubernetes EKS | Kubernetes GKE | OpenSearch | PGVector | Parquet | Ray | Text search | Trino | Vector Search | WebDataset
Education
N/A
Roles
Related jobs
-
AWS | Cloud platform | Data Lake | Data Warehouse | Database Management SystemsOn site work location Japan | Relocation support | Visa sponsorshipEntry-level Full TimeSaitama, Japan2d ago
-
ML Operations Engineer (AI/LLM) - Mercari JPY 8600K-9700KBigQuery | Bigtable | CI/CD | Docker | Drift DetectionFlexible work hoursSenior-level Full TimeMinato City, Tokyo, Japan2d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn site Tokyo Japan | Relocation support | Visa sponsorshipSenior-level Full TimeYokohama, Kanagawa, Japan3d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOnsite work in Tokyo Japan | Relocation support | Visa sponsorshipSenior-level Full TimeChiba, Japan3d ago
-
AI Pipelines | AWS | Amazon EKS | Apache Airflow | Azure AKSOnsite Tokyo Japan | Relocation support | Visa sponsorshipMid-level Full TimeChiba, Japan3d ago
-
AI Pipelines | AWS | Amazon EKS | Amazon SageMaker | Amazon SageMaker PipelinesOn site work Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeKawasaki, Miyagi, Japan3d ago
-
Amazon Web Services | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn-site work | Relocation assistance | Visa sponsorshipSenior-level Full TimeOsaka, Japan4d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceSenior-level Full TimeKawasaki, Miyagi, Japan4d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOnsite work | Relocation support | Visa sponsorshipSenior-level Full TimeSaitama, Japan4d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceRelocation assistance | Visa sponsorshipSenior-level Full TimeNagoya, Aichi, Japan4d ago
-
AIOps | Artificial Intelligence | Big Data | Big data analytics | CUDASenior-level Full TimeOsaka, Japan4d ago
-
AIOps | Big Data | Big data analytics | Cloud Computing | Computer VisionOnsite Tokyo Japan | Relocation assistance | Visa sponsorshipSenior-level Full TimeChiba, Japan4d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Azure AKSJapanese language proficiency support | On site work Tokyo Japan | Relocation support | Visa sponsorshipMid-level Full TimeSaitama, Japan4d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Azure AKSOn site Tokyo work | Visa sponsorshipMid-level Full TimeYokohama, Kanagawa, Japan4d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Amazon SageMakerOn site Tokyo Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeTokyo, Kantō, Japan4d ago
-
AKS | AWS | Airflow | CI/CD | Cloud platformBusiness level Japanese proficiency | Onsite work in Tokyo Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeNagoya, Aichi, Japan4d ago
-
AI Pipelines | AWS | Amazon EKS | Amazon SageMaker | Apache AirflowOn site work Japan | Relocation support | Visa sponsorshipMid-level Full TimeOsaka, Japan4d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data WarehouseOn site in Tokyo Japan | Relocation assistance | Visa sponsorshipEntry-level Full TimeNagoya, Aichi, Japan4d ago
-
AWS | Cloud platform | Data Lake | Data Warehouse | DatabricksOn site work Tokyo Japan | Relocation support | Visa sponsorshipEntry-level Full TimeKawasaki, Miyagi, Japan4d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data TransformationOn-site work | Relocation support | Visa sponsorshipEntry-level Full TimeOsaka, Japan4d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data TransformationOn site work in Tokyo Japan | Relocation support | Visa sponsorshipEntry-level Full TimeYokohama, Kanagawa, Japan4d ago
-
AWS | Cloud platform | Data Lakes | Data Pipeline Monitoring | Data TransformationOn site work opportunity | Professional growth | Relocation assistance | Visa sponsorshipEntry-level Full TimeTokyo, Kantō, Japan4d ago
-
AWS | Cloud platform | Data Lakes | Data Warehousing | Database Management SystemsOn site work Tokyo Japan | Relocation assistance | Visa sponsorshipEntry-level Full TimeChiba, Japan4d ago
-
デリバリーソリューションアーキテクト JPY 8500K-14000KData Architecture | Data analytics | Distributed Systems | Program Management | Project ManagementSenior-level Full TimeTokyo, Japan4d ago
-
AI Engineer JPY 8000K-15000KAlloyDB | Anthropic | Cloud Monitoring | Cloud SQL | DatadogConference support | Flexible schedule | Learning SupportExecutive-level Full TimeTokyo R4d ago