シニアデータエンジニア ‐ データブリックス
Tokyo Prefecture, Japan
R
JPY 4800K-8400K (estimate) Mid-level Full Time
Tasks
- Collaborate with engineers and data scientists
- Design data pipelines
- Develop batch data workflows
- Develop streaming data workflows
- Implement data governance best practices
- Implement data pipelines
- Implement data quality best practices
- Implement data security best practices
- Improve Databricks workload performance
- Maintain data pipelines
- Mentor junior engineers
- Optimize data processing cost
- Optimize data processing performance
- Share knowledge with team
- Translate business and data requirements to production solutions
Perks/Benefits
- Career feedback
- Continuous learning resources
- Hybrid work
- Professional development support
- Remote work option
- Team events
- Training support
- Work-life balance
Skills/Tech-stack
AWS | Airflow | Ansible | Apache Kafka | Apache Spark | Azure | CI/CD | Cloud platform | Cost Optimization | Data Governance | Data Modeling | Data Processing | Data Quality | Data Security | Databricks | Databricks Workflows | Delta Lake | Distributed data | Distributed data processing | Git | Google Cloud | Google Cloud Platform | Nifi | Performance Tuning | PySpark | Scala | Terraform
Education
N/A
Roles
Related jobs
-
Platform Engineer, Gen AI JPY 8000K-10560KAmazon Web Services | As-a-Service | CI/CD | Code extension | Distributed SystemsFlexible work hours | International team collaboration | Professional development | Remote-firstMid-level Full TimeJapan - Remote R7d ago
-
AI Support Engineer II JPY 8000K-8000KAI Platform | AI and ML | AI platform support | AWS | Agentic WorkflowsDental insurance | Flexible time off program | Global Employee Assistance Program EAP | Medical insurance | Paid HolidaysMid-level Full TimeRemote Japan R16d ago
-
データエンジニア・City Data Platform Development（障がい者雇用） JPY 6000K-8500KAWS | C# | C++ | Data Governance | Data SecurityCar rental support | English learning support | Flexible working hours | Housing allowance | Internal trainingMid-level Full Time東京都中央区 R24d ago
-
AI ガバナンスリード(アシスタントマネージャー～マネージャー)／ データ＆アナリティクス部 AI Governance Lead(Assistant Manager~Manager)/ Data & Analytics Division JPY 4848K-5440KAI Foundry | AI Governance | Automl | Azure | Azure AIExternal training opportunities | Flexible remote work | Internal trainingSenior-level Full TimeTokyo Head Office, Japan R28d ago
-
Test Data Analysis Technology Development Engineer JPY 3120K-5268KAI | Adaptive testing | Anomaly Detection | Data Analysis | Defect predictionHybrid work model | Inclusive workplace | Remote work 2 days per weekEntry-level Full TimeKodaira, Japan R1mo ago
-
Forward Deployed Engineer - Applied AI JPY 8600K-9700KAWS Lambda | CI/CD | Cloud Functions | Containers | Data MappingCustomer-facing work | Technical workshops | Travel opportunitiesMid-level Full TimeJapan Remote R1mo ago