Senior Data Engineer - Databricks
Tokyo, Chiyoda, Japan
JPY 8000K-9700K (estimate) Senior-level Full Time
Tasks
- Collaborate with teams on requirements
- Design scalable data pipelines
- Develop batch and streaming workflows
- Ensure data quality, governance, and security
- Implement and maintain data platforms
- Implement production ready data solutions
- Optimize data processing cost efficiency
- Optimize data processing performance
- Share knowledge and support junior engineers
- Support CI CD and version control processes
- Use orchestration for data workflows
Perks/Benefits
- Continuous learning resources
- Hybrid work options
- International collaboration
- Knowledge sharing culture
- Professional development resources
- Remote work option
- Team events
Skills/Tech-stack
Airflow | Amazon Web Services | Apache Kafka | Apache Spark | CI/CD | Cloud platform | Data Governance | Data Modeling | Data Processing | Data Quality | Data Security | Databricks | Databricks Workflows | Delta Lake | Distributed data | Distributed data processing | Git | Google Cloud | Google Cloud Platform | Microsoft Azure | PySpark | SQL | Scala | Web Services
Education
N/A
Roles
Related jobs
-
シニアデータエンジニア ‐ データブリックス JPY 7000K-9700KAWS | Airflow | Ansible | Apache Kafka | Apache NiFiCareer development support | Global collaboration | Hybrid work | Professional development support | Qualification supportSenior-level Full TimeTokyo, Chiyoda, Japan R20h ago
-
Senior Customer Engineer, Data Analytics (Japanese, English) JPY 8000K-12500KApache Spark | Batch Processing | Big Data | Cloud Computing | Data GovernanceSenior-level Full TimeTokyo, Japan2d ago
-
Senior Frontend Engineer - Retail Robotics System JPY 8000K-15000KAnsible | Azure | Blazor | C# | CypressSenior-level Contract Full TimeTokyo2d ago
-
Ansible | Bash | BigQuery | Blue-Green Deployment | Blue/greenMid-level Full TimeFutakotamagawa Rise Office, Japan4d ago
-
Senior Data Management Professional - Data Engineering - Sustainable Fixed Income Data, Tokyo JPY 8500K-9700KAlerting | CSV | Cause analysis | Data Architecture | Data ModelingSenior-level Full TimeTokyo4d ago
-
Data Engineer, Hydrogen Ecosystem Solutions JPY 4163K-6000KAPI Integration | AWS | Azure | Cloud Storage | Data ArchitectureMid-level Full TimeTokyo5d ago
-
Senior AI Solutions Engineer JPY 8600K-9700KAI Governance | API Integration | AWS | Agentic AI | Agents SDKEmployee Assistance Program (EAP) | Flexible time off | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leaveSenior-level Full TimeRemote Japan R5d ago
-
Senior Scientific Data Engineer JPY 8600K-9700KAI Agents | Dashboarding | Data Modeling | Data Parsing | Data PipelinesContinuous improvement culture | Flexible working arrangements | Paid time off | Remote workSenior-level Full TimeShonan, Kanagawa, Japan6d ago
-
AI Engineer JPY 31K-46KAI Agent | AWS | Azure | FastAPI | GCPCareer consulting | Flexible schedule | Health checkups | On-the-job training | Qualification supportEntry-level Full TimeYokohama, Kanagawa, Japan R7d ago
-
データ取得エンジニアリング・Data Infrastructure, AD/ADAS JPY 3876K-5268KAWS | Batch Processing | Data Governance | Data Privacy | Data WarehouseFlexible working hours | Housing allowance | Paid time off | Rental car support | Retirement planMid-level Full Time東京都中央区8d ago
-
Data Acquisition Engineering - Data Infrastructure, AD/ADAS JPY 2796K-4500KAWS | Algorithms | Batch Processing | Concurrent programming | Data IngestionMid-level Full TimeTokyo8d ago
-
Mid-level Full TimeICT - Innovation Campus Tokyo - …8d ago
-
AWS Lambda | AWS S3 | Apache Airflow | Data Governance | Data ModelingSenior-level Full TimeTokyo8d ago
-
Ad Tech Engineer, Machine Learning Engineer- Marketplace JPY 8600K-9700KAd Classification | ELT | ETL | Embeddings | GoFull flextimeSenior-level Full TimeMinato City, Tokyo, Japan9d ago
-
CI/CD | Data Preprocessing | Docker | GIS | GitMid-level Full TimeTokyo10d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Entrepreneurial team | Friendly atmosphereMid-level Full TimeNagoya, Japan10d ago
-
IT, Digital Human Health, Data and Analytics, Sr. Data Engineer JPY 7000K-9000KAccess Control | Cloud Platforms | Cost Optimization | Data Catalog | Data DocumentationFlexible work arrangements | Hybrid work arrangementsSenior-level Full TimeJPN - Tokyo - Chiyoda, Japan13d ago
-
Data Scientist SMART Manufacturing & AI JPY 5000K-5800KApache Hadoop | Apache Spark | ETL | Feature Engineering | HBaseEntry-level Full TimeHiroshima - Fab 15, Japan13d ago
-
Gen AI Lead Developer - Senior Consultant JPY 8600K-9700K.Net Core | AWS | Agent systems | Angular | AutomlSenior-level Full TimeKochi, KL, IN, 68231313d ago
-
EY-GDS Consulting-AI And DATA-Databricks-Senior JPY 8500K-9700KAPIs | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeCareer development | Global scale | Inclusive cultureSenior-level Full TimeKochi, KL, IN, 68231314d ago
-
Forward Deployed Lead Engineer – Robotics Operation System JPY 7000K-10000K.NET | ARM64 | Ansible | Authentication | AzureOccasional travel for on site supportSenior-level Contract Full TimeTokyo15d ago
-
Data Management Lead - Manager JPY 7500K-9700KAPI | AWS | Azure | Change Data Capture | Cloud platformInternational travelSenior-level Full TimeKochi, KL, IN, 68231315d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Career impact | Friendly atmosphere | Remote/distributed workMid-level Full TimeTokyo, Japan16d ago
-
ETL Engineer(Assistant Manager)/ Data & Analytics Division JPY 4500K-6000KAWS | Agile | Azure | Batch Processing | C#Mid-level Full TimeTokyo Head Office, Japan16d ago
-
Staff Designated Support Engineer JPY 8600K-9700KAWS | Amazon Redshift | Apache Spark | Azure | CI/CDSenior-level Full TimeJapan16d ago