シニアデータエンジニア ‐ データブリックス
Tokyo, Chiyoda, Japan
R
JPY 7000K-9700K (estimate) Senior-level Full Time
Tasks
- Design data pipelines
- Develop batch data workflows
- Develop streaming data workflows
- Implement data governance best practices
- Implement data pipelines
- Implement data quality best practices
- Implement data security best practices
- Improve data processing cost efficiency
- Improve data processing performance
- Maintain data pipelines
- Mentor junior engineers
- Optimize batch processing
- Optimize streaming processing
- Share team knowledge
- Translate business requirements to data solutions
Perks/Benefits
- Career development support
- Global collaboration
- Hybrid work
- Professional development support
- Qualification support
- Regular feedback
- Team events
- Udemy Business
Skills/Tech-stack
AWS | Airflow | Ansible | Apache Kafka | Apache NiFi | Apache Spark | Azure | CI/CD | Cloud platform | Data Governance | Data Modeling | Data Processing | Data Quality | Data Security | Data pipeline | Databricks | Databricks Workflows | Delta Lake | Distributed data | Distributed data processing | Git | Google Cloud | Google Cloud Platform | PySpark | Scala | Terraform
Education
N/A
Roles
Related jobs
-
データエンジニア・City Data Platform Development（障がい者雇用） JPY 6000K-8500KAWS | Batch Processing | C# | C++ | Data AnalysisFlexible working hours | Google Meet interviews | Housing allowance | Loaner car support | Paid time offMid-level Full Time東京都中央区 R2d ago
-
AI Platform | BigQuery | CI/CD | Cloud platform | Data CatalogAnnual bonuses | Company Housing Allowance | Equipment provided | Flexible work hours | Fully remoteMid-level Full TimeTsukiji, Japan R11d ago
-
Test Data Analysis Technology Development Engineer JPY 3600K-5268KAdaptive testing | Anomaly Detection | Defect prediction | Docker | FastAPICollaborative work environment | Continuous learning opportunities | Flexible work schedule | Hybrid work model | Remote work flexibilityEntry-level Full TimeKodaira, Japan R13d ago
-
AI | AWS | Agile | Angular | AzureEntry-level Full TimeTokyo, JP R19d ago
-
Amazon Redshift | BigQuery | CI/CD | Data Catalog | Data GovernanceFlextime | Fully remoteMid-level Full TimeNishishinjuku (Tsuginobiruonozoku), Japan R1mo ago
-
Senior AI Solutions Engineer JPY 8600K-9700KAI Governance | API Integration | AWS | Agentic AI | Agents SDKEmployee Assistance Program (EAP) | Flexible time off | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leaveSenior-level Full TimeRemote Japan R1mo ago
-
AI Engineer JPY 31K-46KAI Agent | AWS | Azure | FastAPI | GCPCareer consulting | Flexible schedule | Health checkups | On-the-job training | Qualification supportEntry-level Full TimeYokohama, Kanagawa, Japan R1mo ago
-
AI Engineer JPY 31K-46KAI Agent | AWS | Azure | FastAPI | GCP1 on 1 support | Flexible working hours | Hybrid work | Remote work | Self-improvement supportEntry-level Full TimeYokohama, Kanagawa, Japan R1mo ago