Senior Data Engineer (Cloud Data Platform & Data Architecture)
Tasks
- Build and optimize ETL pipelines
- Design scalable cloud data platforms
- Develop data models for analytics and AI
- Develop distributed data processing pipelines
- Ensure data quality/security/governance
- Evaluate emerging technologies and run PoCs
- Implement Data Warehouse and Data Lake
- Lead Data platform architecture
- Lead cloud migration to cloud native platforms
- Mentor engineers and provide technical leadership
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Cloud Security | Cloud platform | Data Governance | Data Lake | Data Modeling | Data Processing | Data Quality | Data Warehousing | Databricks | Distributed data | Distributed data processing | ETL | Google Cloud | Google Cloud Platform | Metadata Management | Microsoft Azure | Python | Snowflake
Education
Roles
Related jobs
-
AWS | Cloud platform | Data Lake | Data Warehouse | Database Management SystemsOn site work location Japan | Relocation support | Visa sponsorshipEntry-level Full TimeSaitama, Japan1d ago
-
Software Engineer, Data Infrastructure & Acquisition - Nagoya, Japan JPY 8000K-10400KBash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote-friendlyMid-level Full TimeNagoya, Japan1d ago
-
ML Operations Engineer (AI/LLM) - Mercari JPY 8600K-9700KBigQuery | Bigtable | CI/CD | Docker | Drift DetectionFlexible work hoursSenior-level Full TimeMinato City, Tokyo, Japan1d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn site Tokyo Japan | Relocation support | Visa sponsorshipSenior-level Full TimeYokohama, Kanagawa, Japan2d ago
-
AI Pipelines | AWS | Amazon EKS | Apache Airflow | Azure AKSOnsite Tokyo Japan | Relocation support | Visa sponsorshipMid-level Full TimeChiba, Japan2d ago
-
AI Pipelines | AWS | Amazon EKS | Amazon SageMaker | Amazon SageMaker PipelinesOn site work Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeKawasaki, Miyagi, Japan2d ago
-
Amazon Web Services | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn-site work | Relocation assistance | Visa sponsorshipSenior-level Full TimeOsaka, Japan3d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceSenior-level Full TimeKawasaki, Miyagi, Japan3d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOnsite work | Relocation support | Visa sponsorshipSenior-level Full TimeSaitama, Japan3d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceRelocation assistance | Visa sponsorshipSenior-level Full TimeNagoya, Aichi, Japan3d ago
-
AIOps | Big Data | Big data analytics | CUDA | Computer VisionOnsite work Japan | Relocation support | Visa sponsorshipSenior-level Full TimeSaitama, Japan3d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Azure AKSJapanese language proficiency support | On site work Tokyo Japan | Relocation support | Visa sponsorshipMid-level Full TimeSaitama, Japan3d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Azure AKSOn site Tokyo work | Visa sponsorshipMid-level Full TimeYokohama, Kanagawa, Japan3d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Amazon SageMakerOn site Tokyo Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeTokyo, Kantō, Japan3d ago
-
AKS | AWS | Airflow | CI/CD | Cloud platformBusiness level Japanese proficiency | Onsite work in Tokyo Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeNagoya, Aichi, Japan3d ago
-
AI Pipelines | AWS | Amazon EKS | Amazon SageMaker | Apache AirflowOn site work Japan | Relocation support | Visa sponsorshipMid-level Full TimeOsaka, Japan3d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data WarehouseOn site in Tokyo Japan | Relocation assistance | Visa sponsorshipEntry-level Full TimeNagoya, Aichi, Japan3d ago
-
AWS | Cloud platform | Data Lake | Data Warehouse | DatabricksOn site work Tokyo Japan | Relocation support | Visa sponsorshipEntry-level Full TimeKawasaki, Miyagi, Japan3d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data TransformationOn-site work | Relocation support | Visa sponsorshipEntry-level Full TimeOsaka, Japan3d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data TransformationOn site work in Tokyo Japan | Relocation support | Visa sponsorshipEntry-level Full TimeYokohama, Kanagawa, Japan3d ago
-
AWS | Cloud platform | Data Lakes | Data Pipeline Monitoring | Data TransformationOn site work opportunity | Professional growth | Relocation assistance | Visa sponsorshipEntry-level Full TimeTokyo, Kantō, Japan3d ago
-
AWS | Cloud platform | Data Lakes | Data Warehousing | Database Management SystemsOn site work Tokyo Japan | Relocation assistance | Visa sponsorshipEntry-level Full TimeChiba, Japan3d ago
-
AWS | C++ | Cloud platform | Computer Vision | Deep learningEnglish communication support | Multicultural team collaboration | Onsite work Tokyo JapanMid-level Full TimeKawasaki, Kanagawa, Japan3d ago
-
AI Pipelines | AWS | C++ | Cloud platform | Computer VisionOnsite workMid-level Full TimeYokohama, Kanagawa, Japan3d ago
-
AI Pipelines | AWS | C# | C++ | Cloud ComputingMulticultural team environment | On site work in Tokyo JapanMid-level Full TimeChiba, Japan3d ago