シニアデータエンジニア ‐ データブリックス
Tokyo, Chiyoda, Japan
R
JPY 7000K-9700K (estimate) Senior-level Full Time
Tasks
- Design data pipelines
- Develop batch data workflows
- Develop streaming data workflows
- Implement data governance best practices
- Implement data pipelines
- Implement data quality best practices
- Implement data security best practices
- Improve data processing cost efficiency
- Improve data processing performance
- Maintain data pipelines
- Mentor junior engineers
- Optimize batch processing
- Optimize streaming processing
- Share team knowledge
- Translate business requirements to data solutions
Perks/Benefits
- Career development support
- Global collaboration
- Hybrid work
- Professional development support
- Qualification support
- Regular feedback
- Team events
- Udemy Business
Skills/Tech-stack
AWS | Airflow | Ansible | Apache Kafka | Apache NiFi | Apache Spark | Azure | CI/CD | Cloud platform | Data Governance | Data Modeling | Data Processing | Data Quality | Data Security | Data pipeline | Databricks | Databricks Workflows | Delta Lake | Distributed data | Distributed data processing | Git | Google Cloud | Google Cloud Platform | PySpark | Scala | Terraform
Education
N/A
Roles
Related jobs
-
HPC Test Data Analysis Technology Development Engineer JPY 3600K-5268KAdaptive testing | Anomaly Detection | Data Analysis | Defect prediction | DockerFlexible working environment | Hybrid work | Inclusive workplace | Remote work 2 days per weekEntry-level Full TimeKodaira, Japan R7d ago
-
Amazon Redshift | BigQuery | CI/CD | Data Catalog | Data GovernanceFlextime | Fully remoteMid-level Full TimeNishishinjuku (Tsuginobiruonozoku), Japan R22d ago
-
Senior AI Solutions Engineer JPY 8600K-9700KAI Governance | API Integration | AWS | Agentic AI | Agents SDKEmployee Assistance Program (EAP) | Flexible time off | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leaveSenior-level Full TimeRemote Japan R25d ago
-
AI Engineer JPY 31K-46KAI Agent | AWS | Azure | FastAPI | GCPCareer consulting | Flexible schedule | Health checkups | On-the-job training | Qualification supportEntry-level Full TimeYokohama, Kanagawa, Japan R27d ago
-
AI Engineer JPY 31K-46KAI Agent | AWS | Azure | FastAPI | GCP1 on 1 support | Flexible working hours | Hybrid work | Remote work | Self-improvement supportEntry-level Full TimeYokohama, Kanagawa, Japan R27d ago
-
Customer Success Engineer JPY 8600K-9700KAWS | Application Lifecycle Management | Application lifecycle | Cloud infrastructure | Cloud platformEmployee assistance program | Flexible time off | Paid Holidays | Paid parental leaveSenior-level Full TimeRemote Japan R1mo ago
-
Platform Engineer, Gen AI JPY 8000K-10560KAmazon Web Services | As-a-Service | CI/CD | Code extension | Distributed SystemsFlexible work hours | International team collaboration | Professional development | Remote-firstMid-level Full TimeJapan - Remote R1mo ago