Senior Data Engineer - Databricks
Tokyo, Chiyoda, Japan
JPY 8000K-9700K (estimate) Senior-level Full Time
Tasks
- Collaborate with teams on requirements
- Design scalable data pipelines
- Develop batch and streaming workflows
- Ensure data quality, governance, and security
- Implement and maintain data platforms
- Implement production ready data solutions
- Optimize data processing cost efficiency
- Optimize data processing performance
- Share knowledge and support junior engineers
- Support CI CD and version control processes
- Use orchestration for data workflows
Perks/Benefits
- Continuous learning resources
- Hybrid work options
- International collaboration
- Knowledge sharing culture
- Professional development resources
- Remote work option
- Team events
Skills/Tech-stack
Airflow | Amazon Web Services | Apache Kafka | Apache Spark | CI/CD | Cloud platform | Data Governance | Data Modeling | Data Processing | Data Quality | Data Security | Databricks | Databricks Workflows | Delta Lake | Distributed data | Distributed data processing | Git | Google Cloud | Google Cloud Platform | Microsoft Azure | PySpark | SQL | Scala | Web Services
Education
N/A
Roles
Related jobs
-
Software Engineer - Robotics Control Systems JPY 8500K-9700KAlgorithm Design | Behavior Tree | C++ | CI/CD | Complexity analysisCareer growth and development | Collaborative work environment | Visa application supportSenior-level Full TimeKoto City, Tokyo, Japan2d ago
-
データエンジニア・City Data Platform Development（障がい者雇用） JPY 6000K-8500KAWS | Batch Processing | C# | C++ | Data AnalysisFlexible working hours | Google Meet interviews | Housing allowance | Loaner car support | Paid time offMid-level Full Time東京都中央区 R2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Remote/distributed workMid-level Full TimeOsaka, Japan2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Career growth opportunities | Friendly work environment | Remote workMid-level Full TimeFukuoka, Japan2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Friendly work environment | Remote-friendlyMid-level Full TimeKochi, India2d ago
-
Senior Software Engineer, Search AI/ML JPY 8000K-15000KBackend Development | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeTokyo, Japan3d ago
-
AWS | Algorithms | Apache Airflow | Apache Pinot | Apache SparkSenior-level Full TimeTaipei, Taiwan; Tokyo, Japan4d ago
-
Senior Databricks Consulting Engineer JPY 8600K-9700KAnsible | Apache Kafka | Apache Spark | Data Governance | Data ModelingCertification support | Collaborative international culture | Continuous learning support | Flexible working hours | Remote-friendly work environmentSenior-level Full TimeTokyo, Chiyoda, Japan4d ago
-
AIエンジニア AI Engineer (Japan) JPY 6000K-10000KAWS | Azure | Constraint Satisfaction | Data Deduplication | Data ModelingMid-level Full TimeTokyo6d ago
-
Amazon Web Services | ArgoCD | Bash | CI/CD | CloudFrontRemote workMid-level Full TimeChuo City, Japan7d ago
-
Senior Data Engineer, Behavior ML Planning & Prediction JPY 8600K-9700KAlerting | Amazon Redshift | Apache Airflow | Apache Iceberg | BigQueryEnglish interview via Google Meet scheduling | Hybrid workspace | Three days per week office workSenior-level Full TimeTokyo7d ago
-
Data Marketing/Data Analytics - Store AI Solution Section, Incubation Office (INCO) JPY 6634K-10000KBusiness Intelligence | Data Aggregation | Data Processing | Data Visualization | DomoMid-level Full TimeRakuten Crimson House, Japan7d ago
-
Senior Systems Engineer – AI Data Platform JPY 7000K-13000KAirflow | Apache Kafka | Apache Spark | Batch Processing | CCPASenior-level Full TimeTokyo, Japan8d ago
-
Senior Infra Engineer - Full Cycle Retail Robotics Engineering JPY 7000K-12000K.NET | ARM64 | Ansible | Azure | Azure ContainerOccasional travel for on site supportSenior-level Contract Full TimeTokyo8d ago
-
AI Engineer - FDE (Forward Deployed Engineer) JPY 8281K-9700KAWS | Agent systems | Apache Spark | Azure | Cloud platformTravel for customer engagementsSenior-level Full TimeTokyo, Japan8d ago
-
Anomaly Detection | CRO Management | Clinical Trial Data | Clinical trial | Data CaptureSenior-level Full TimeShinagawa, Japan, Tokyo9d ago
-
Operations Performance & Analytics Engineer JPY 5750K-8000KArtificial Intelligence | Automation | Capacity Planning | Dashboard Development | Data AnalysisMid-level Full TimeHiroshima - Fab 15, Japan9d ago
-
Sr. Solutions Engineer (Pre-sales) - Kansai Region JPY 8000K-10473KAWS | Apache Spark | Big Data | Big data analytics | CassandraSenior-level Full TimeJapan10d ago
-
Anomaly Detection | Clinical Practice | Clinical Trial Data | Clinical trial | Data CaptureSenior-level Full TimeShinagawa, Japan, Tokyo10d ago
-
Senior Customer Engineer, Data Analytics (Japanese, English) JPY 8000K-12500KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceSenior-level Full TimeTokyo, Japan11d ago
-
Senior-level Full TimeHeiwajima, Tokyo, Japan11d ago
-
AI Platform | BigQuery | CI/CD | Cloud platform | Data CatalogAnnual bonuses | Company Housing Allowance | Equipment provided | Flexible work hours | Fully remoteMid-level Full TimeTsukiji, Japan R12d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Career growth opportunities | Friendly laid-back atmosphere | Remote-friendly, distributed teamMid-level Full TimeTokyo, Japan12d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive salary | Friendly laid-back atmosphereMid-level Full TimeYokohama, Japan12d ago
-
AI Systems Engineer JPY 8600K-11000KAI Agents | Agent Orchestration | Artificial Intelligence | Automated testing | CI/CDCareer growth and development | Collaborative work environment | Opportunity to work on cutting edge robotics technologies | Visa application supportMid-level Full TimeKoto City, Tokyo, Japan12d ago