Software Engineer - Data Infrastructure
Tasks
- Build batch and streaming data pipelines
- Contribute production code and solve distributed systems problems
- Define technical direction and align cross functional partners
- Design GCP data platforms
- Design scalable data infrastructure and experimentation systems
- Develop AI assisted engineering methodologies and guardrails
- Evaluate and adopt new technologies
- Implement AI native workflows across the engineering lifecycle
- Lead technical design of experiment assignment and player segmentation
- Maintain correctness security performance and maintainability of outputs
- Mentor engineers and drive multi team initiatives
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Beam | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Batch data | Batch data pipelines | BigQuery | Cloud Storage | Cloud platform | Data Lakehouse | Data Pipelines | Data orchestration | Distributed Computing | Experimentation | Go | Google Cloud | Google Cloud Platform | Google Cloud Storage | Java | Kubernetes | Metric computation | Python | Ray | Rust | Statistical Analysis | Streaming Data | Telemetry Processing | Terraform
Education
N/A
Roles
Related jobs
-
AWS | AWS CDK | AWS CodeBuild | AWS Lambda | Amazon CognitoAnnual bonus | Bereavement leave | Childcare leave | Corporate defined contribution pension plan | Five-day workweekMid-level Full TimeWakamatsu Ku, Japan1d ago
-
AWS | AWS CDK | AWS CodeBuild | Anomaly Detection | Attack methodsBereavement leave | Childcare leave | Five-day workweek | Maternity leave | National holidaysMid-level Full TimeChuo Ku, Japan1d ago
-
AWS | AWS CDK | AWS CodeBuild | Anomaly Detection | ChromaticAnnual bonus | Five-day workweek | Health insurance | Paid time off | Pension planMid-level Full TimeAoba Ku, Japan1d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data ArchitectureOn site work in Tokyo | Relocation assistance | Visa sponsorshipSenior-level Full TimeTokyo, Kantō, Japan1d ago
-
AI Agents | AI platforms | API Integration | BigQuery | Cloud AIBusiness level Japanese proficiency requirement | On site work in Tokyo JapanEntry-level Full TimeSaitama, Japan1d ago
-
AI Agents | API Integration | BigQuery | Cloud LLM | Cloud LLM APIsBusiness level Japanese required | On site work in Tokyo JapanEntry-level Full TimeChiba, Japan1d ago
-
AI Agents | API Integration | BigQuery | Databricks | Generative AIOn site work in Tokyo JapanEntry-level Full TimeNagoya, Aichi, Japan1d ago
-
AI Agents | API Integration | BigQuery | Cloud APIs | Data platformsJapanese work visa support | Onsite work in TokyoEntry-level Full TimeKawasaki, Miyagi, Japan1d ago
-
AI Agents | AI platforms | API Integration | BigQuery | Cloud AIJapanese language proficiency requirement | Onsite Tokyo JapanEntry-level Full TimeYokohama, Kanagawa, Japan1d ago
-
AI Agents | AI platforms | API Integration | BigQuery | Cloud AIJapanese language requirement | On site work Tokyo Japan | Visa supportEntry-level Full TimeOsaka, Japan1d ago
-
AI Agents | AI platforms | API Integration | BigQuery | Cloud AIBusiness level Japanese requirement | On site work in Tokyo JapanEntry-level Full TimeTokyo, Kantō, Japan1d ago
-
AWS | C++ | Cloud platform | Computer Vision | Deep learningOnsite workMid-level Full TimeSaitama, Japan1d ago
-
AWS | C++ | Cloud platform | Computer Vision | Data PipelinesOn-site workMid-level Full TimeTokyo, Kantō, Japan1d ago
-
AI Pipelines | AWS | C plus plus | Cloud platform | Computer VisionOn site work locationMid-level Full TimeNagoya, Aichi, Japan1d ago
-
AI Pipelines | AWS | C++ | Cloud platform | Computer VisionOnsite work assignmentMid-level Full TimeOsaka, Japan1d ago
-
Partner Forward Deployed Engineer, Generative AI, Google Cloud (Japanese, English) JPY 10000K-15000KAgent Development | Agent Development Kit | Agent Development Kit ADK | Agent Orchestration | Agent systemsSenior-level Full TimeTokyo, Japan1d ago
-
3D Geometry | 3D Reconstruction | Activity Recognition | Camera Calibration | Computer VisionSenior-level Full TimeTokyo1d ago
-
A/B | A/B Testing | B testing | CI/CD | ContainerizationHybrid remote workSenior-level Full TimeShibuya, Japan R2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly laid-back atmosphere | Opportunity for impact | Remote/distributed workMid-level Full TimeTokyo, Japan2d ago
-
Sales Engineer - Enterprise JPY 9815K-12000KAI | AWS | Application Performance Monitoring | Application performance | Cloud platformCareer pathing | Community guilds and inclusion talks | Employee stock purchase plan | Hybrid work | Mentor and buddy programMid-level Full TimeTokyo, Japan R2d ago
-
ソフトウェアエンジニア・In-Cabin Perception JPY 2760K-5268KAWS | Agile | C++ | CAN | CI/CDAnnual paid leave | Flexible working hours | Housing allowance | Language learning | Rental car supportMid-level Full Time東京都中央区2d ago
-
Software Engineer, In-Cabin Perception JPY 3876K-5880KAWS | Agile | C++ | CAN | CI/CDHybrid work policy Google Meet interviewsMid-level Full TimeTokyo R2d ago
-
Backend Engineer, Agent Development - AI Lab (AILAB) JPY 8000K-14000KA/B | A/B Testing | Async architecture | B testing | CI/CDSenior-level Full TimeRakuten Crimson House, Japan2d ago
-
CT-NITRO-Experimental AI Engineer JPY 8600K-10000KAutoencoders | Deep learning | Docker | Fine Tuning | GitSenior-level Full TimeKochi, KL, IN, 6823132d ago
-
MTS1, Software Engineer JPY 9382K-12500KApache Airflow | Apache Atlas | Apache Flink | Apache NiFi | Apache SparkMid-level Full TimeTokyo, Japan2d ago