Senior Data Engineer - Databricks
Tokyo, Chiyoda, Japan
JPY 8000K-9700K (estimate) Senior-level Full Time
Tasks
- Collaborate with teams on requirements
- Design scalable data pipelines
- Develop batch and streaming workflows
- Ensure data quality, governance, and security
- Implement and maintain data platforms
- Implement production ready data solutions
- Optimize data processing cost efficiency
- Optimize data processing performance
- Share knowledge and support junior engineers
- Support CI CD and version control processes
- Use orchestration for data workflows
Perks/Benefits
- Continuous learning resources
- Hybrid work options
- International collaboration
- Knowledge sharing culture
- Professional development resources
- Remote work option
- Team events
Skills/Tech-stack
Airflow | Amazon Web Services | Apache Kafka | Apache Spark | CI/CD | Cloud platform | Data Governance | Data Modeling | Data Processing | Data Quality | Data Security | Databricks | Databricks Workflows | Delta Lake | Distributed data | Distributed data processing | Git | Google Cloud | Google Cloud Platform | Microsoft Azure | PySpark | SQL | Scala | Web Services
Education
N/A
Roles
Related jobs
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous work culture | Flexible work environment | Remote workMid-level Full TimeNagoya, Japan1d ago
-
Mid-level Full TimeTokyo, Japan4d ago
-
Senior Software Engineer- Tokyo JPY 8600K-9700KAIOps | Artificial Intelligence | Dspy | Java | LangchainSenior-level Full TimeTokyo, Japan4d ago
-
Associate Manager, AI Full Stack Developer (Data & AI) JPY 6000K-10000KAI Agents | AI architecture | AI guardrails | Agentic AI | Backend DevelopmentMid-level Full TimeTokyo, Izumi Garden Tower, Japan5d ago
-
Consultant, AI Full-Stack Developer (Data & AI) JPY 4000K-5268KAWS | Agentic AI | Azure | C# | DatabricksEntry-level Full TimeTokyo, Izumi Garden Tower, Japan5d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Inclusive workplace | Remote-friendly cultureMid-level Full TimeTokyo, Japan6d ago
-
Business Intelligence Engineer, Search Capacity JPY 3600K-3600KAWS | Capacity Planning | Data Modeling | Data Visualization | Data WarehousingSenior-level Full TimeTokyo, JPN6d ago
-
Software Engineer, Generative AI Engineering JPY 3600K-6000KAI gateway | API Gateway | Access Management | Amazon Bedrock | AnthropicCross-functional collaboration | Hybrid work environment | Onsite at least 3 days per week | Professional documentationMid-level Full TimeTokyo7d ago
-
HPC Test Data Analysis Technology Development Engineer JPY 3600K-5268KAdaptive testing | Anomaly Detection | Data Analysis | Defect prediction | DockerFlexible working environment | Hybrid work | Inclusive workplace | Remote work 2 days per weekEntry-level Full TimeKodaira, Japan R7d ago
-
R&D-033 Robotics Simulation Engineer JPY 6500K-10000KAutomated testing | CI/CD | Containerization | Distributed Computing | DockerAcademic activities | Career development support | Publication opportunitiesMid-level Full TimeHeiwajima, Tokyo, Japan8d ago
-
API Integration | Agent systems | Data Pipelines | Evaluation | Google CloudMid-level Full TimeTokyo, Japan10d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible management approach | Inclusive workplace | Portfolio and LinkedIn application | Remote workMid-level Full TimeOsaka, Japan11d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Entrepreneurial team | Friendly laid-back atmosphere | Opportunity to make impactMid-level Full TimeFukuoka, Japan11d ago
-
Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache KafkaMid-level Full TimeRakuten Crimson House, Japan11d ago
-
AI productivity | AI productivity tools | Apache Spark | Batch Processing | BigQueryMid-level Full TimeFutakotamagawa Rise Office, Japan11d ago
-
Senior Technical Solutions Engineer (Platform) JPY 8281K-9700KAWS | Azure | Big Data | Distributed Computing | GCPOn-call rotationSenior-level Full TimeTokyo, Japan12d ago
-
Senior Backend Engineer - Full Cycle Retail Robotics Engineering JPY 8000K-12500K.NET | ARM64 | Ansible | Azure | BlazorSenior-level Contract Full TimeTokyo12d ago
-
A/B | A/B Testing | B testing | Batch inference | CI/CDMid-level Full TimeRakuten Crimson House, Japan12d ago
-
Agile | Bash | Bazel | C# | C++Annual paid leave | Childcare leave | Commuting allowance | Employee gym access | Flex holidaySenior-level Full TimeTokyo, Japan (MJHQ)14d ago
-
Backend Software Engineer, Robot Platform Software JPY 3600K-6000KAMQP | CI/CD | Debugging | DevOps | DockerMid-level Full TimeTokyo15d ago
-
Sr. Forward Deployed Engineer JPY 8000K-9700KAWS | Apache Spark | Azure | CI/CD | Cloud platformCustomer-facing role | Travel opportunitiesSenior-level Full TimeTokyo, Japan18d ago
-
Senior Machine Learning Engineer, Credit ML - Merpay JPY 8600K-9700KAlerting | Data Drift | Data Drift Detection | Drift Detection | Experiment ManagementSenior-level Full TimeMinato City, Tokyo, Japan18d ago
-
Next Frontier Quantum Associate JPY 4800K-7200KAWS Braket | Azure Quantum | CI/CD | Certificate management | CirqFlexible global teamworkMid-level Full TimeKochi, KL, IN, 68231318d ago
-
Forward-Deployed Data Scientist JPY 4800K-7200KAirflow | CI/CD | CatBoost | Cloud platform | Code reviewComprehensive health benefits | Dental insurance | Disability insurance | Employee stock purchase plans | Equal Paid Parental LeaveMid-level Full TimeTokyo19d ago
-
シニアデータエンジニア ‐ データブリックス JPY 7000K-9700KAWS | Airflow | Ansible | Apache Kafka | Apache NiFiCareer development support | Global collaboration | Hybrid work | Professional development support | Qualification supportSenior-level Full TimeTokyo, Chiyoda, Japan R21d ago