Senior Manager, Data Engineer
Tasks
- Collaborate with offshore vendors and engineering teams
- Coordinate with business analysts and marketing analytics
- Define data engineering best practices
- Design cloud data platforms
- Develop automated data pipelines
- Ensure data quality and usability for data products
- Implement infrastructure-as-code
- Investigate root cause for data issues
- Lead CI CD for data services
- Manage source control and deployments
- Model data for analytics ready datasets
- Operate data pipelines in production
- Own data architecture standards
- Support stable operations of data platforms
Perks/Benefits
- N/A
Skills/Tech-stack
ANSI SQL | AWS | AWS CloudFormation | Airflow | Amazon Athena | Amazon EMR | Amazon Glue | Apache HBase | Apache Hadoop | Apache Hive | Apache Phoenix | Apache Spark | Azure | Bash | CI/CD | Cassandra | Cloud platform | Data Modeling | Data Security | DynamoDB | Git | Google Cloud | Google Cloud Platform | Gradle | Infrastructure as Code | Java | Jenkins | Linux | Maven | Microservices | MongoDB | NoSQL | Presto | Python | REST | Snowflake | Spring | Terraform | “as-code”
Education
N/A
Related jobs
-
Senior Robotics Algorithm Engineer (C++ / Optimization) JPY 8600K-10000K3D Geometry | C++ | Collision Checking | Computer Vision | Concurrent programmingAnnual paid leave | Childcare leave | Commuting allowance | Employee gym access | Flexible dress codeSenior-level Full TimeTokyo, Japan (MJHQ)1d ago
-
AWS | Cloud platform | Data Lake | Data Warehouse | Database Management SystemsOn site work location Japan | Relocation support | Visa sponsorshipEntry-level Full TimeSaitama, Japan3d ago
-
Software Engineer, Data Infrastructure & Acquisition - Nagoya, Japan JPY 8000K-10400KBash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote-friendlyMid-level Full TimeNagoya, Japan3d ago
-
ML Operations Engineer (AI/LLM) - Mercari JPY 8600K-9700KBigQuery | Bigtable | CI/CD | Docker | Drift DetectionFlexible work hoursSenior-level Full TimeMinato City, Tokyo, Japan3d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn site Tokyo Japan | Relocation support | Visa sponsorshipSenior-level Full TimeYokohama, Kanagawa, Japan4d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOnsite work in Tokyo Japan | Relocation support | Visa sponsorshipSenior-level Full TimeChiba, Japan4d ago
-
AI Pipelines | AWS | Amazon EKS | Apache Airflow | Azure AKSOnsite Tokyo Japan | Relocation support | Visa sponsorshipMid-level Full TimeChiba, Japan4d ago
-
AI Pipelines | AWS | Amazon EKS | Amazon SageMaker | Amazon SageMaker PipelinesOn site work Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeKawasaki, Miyagi, Japan4d ago
-
Data Scientist Manager JPY 8000K-10400KAI Agents | Agent systems | Cloud Computing | Cloud platform | Computer ModelingMid-level Full TimeHiroshima - Fab 15, Japan4d ago
-
Amazon Web Services | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn-site work | Relocation assistance | Visa sponsorshipSenior-level Full TimeOsaka, Japan5d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceSenior-level Full TimeKawasaki, Miyagi, Japan5d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOnsite work | Relocation support | Visa sponsorshipSenior-level Full TimeSaitama, Japan5d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceRelocation assistance | Visa sponsorshipSenior-level Full TimeNagoya, Aichi, Japan5d ago
-
AIOps | Big Data | Big data analytics | CUDA | Computer VisionOnsite work Japan | Relocation support | Visa sponsorshipSenior-level Full TimeSaitama, Japan5d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Azure AKSJapanese language proficiency support | On site work Tokyo Japan | Relocation support | Visa sponsorshipMid-level Full TimeSaitama, Japan5d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Azure AKSOn site Tokyo work | Visa sponsorshipMid-level Full TimeYokohama, Kanagawa, Japan5d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Amazon SageMakerOn site Tokyo Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeTokyo, Kantō, Japan5d ago
-
AKS | AWS | Airflow | CI/CD | Cloud platformBusiness level Japanese proficiency | Onsite work in Tokyo Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeNagoya, Aichi, Japan5d ago
-
AI Pipelines | AWS | Amazon EKS | Amazon SageMaker | Apache AirflowOn site work Japan | Relocation support | Visa sponsorshipMid-level Full TimeOsaka, Japan5d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data WarehouseOn site in Tokyo Japan | Relocation assistance | Visa sponsorshipEntry-level Full TimeNagoya, Aichi, Japan5d ago
-
AWS | Cloud platform | Data Lake | Data Warehouse | DatabricksOn site work Tokyo Japan | Relocation support | Visa sponsorshipEntry-level Full TimeKawasaki, Miyagi, Japan5d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data TransformationOn-site work | Relocation support | Visa sponsorshipEntry-level Full TimeOsaka, Japan5d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data TransformationOn site work in Tokyo Japan | Relocation support | Visa sponsorshipEntry-level Full TimeYokohama, Kanagawa, Japan5d ago
-
AWS | Cloud platform | Data Lakes | Data Pipeline Monitoring | Data TransformationOn site work opportunity | Professional growth | Relocation assistance | Visa sponsorshipEntry-level Full TimeTokyo, Kantō, Japan5d ago
-
AWS | Cloud platform | Data Lakes | Data Warehousing | Database Management SystemsOn site work Tokyo Japan | Relocation assistance | Visa sponsorshipEntry-level Full TimeChiba, Japan5d ago