IT Data Engineer
Tasks
- Automate and test solutions
- Build and run data processes
- Collaborate on data system operations
- Design data systems
- Develop data pipelines
- Implement data discovery and data modeling
- Optimize solution cost
- Perform data loading and data cleanup
- Review data architecture and design
Perks/Benefits
Skills/Tech-stack
AWS Athena | AWS Lambda | Airflow | Alteryx | Authentication | Azure Data | Azure Data Factory | Cron | Data Factory | Data encryption | DynamoDB | HDFS | Hadoop | Hive | Impala | KNIME | Kerberos | Linux | Oozie | PySpark | Python | R | SQL | Shell Scripting | Spark | Windows
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Software Engineer- Tokyo JPY 8600K-9700KAIOps | Apache Spark | Artificial Intelligence | Delta Lake | DspySenior-level Full TimeTokyo, Japan9h ago
-
Mid-level Full TimeTokyo, Japan9h ago
-
Senior Associate-AI and ML-EDS JPY 8000K-12000KAsync Programming | Autogen | Azure | CI/CD | Copilot StudioSenior-level Full TimeKochi, KL, IN, 68231313h ago
-
R&D Data Scientist JPY 4100K-6000KAI | Apache Hadoop | Apache Spark | Bayesian statistics | Computer VisionEntry-level Full TimeKobe, Hyogo, Japan1d ago
-
Amazon SageMaker | Amazon Web Services | Data Pipelines | Docker | GitHubMid-level Full TimeOsaka, Osaka, Japan1d ago
-
Robotics Software Engineer - Localization & Perception JPY 7000K-9700KC++ | CI/CD | CUDA | Code review | Data FusionCollaborative team | Relocation support | Visa supportSenior-level Full TimeKoto City, Tokyo, Japan1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Competitive salary | Laid-back atmosphereMid-level Full TimeTokyo, Japan2d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Friendly work environment | Remote distributed settingMid-level Full TimeYokohama, Japan2d ago
-
Software Engineer, Tracking and Reporting - Global Ad Technology Supervisory Department (GATD) JPY 5000K-6000KApache Hive | Apache Kafka | Apache Spark | GCP | LinuxMid-level Full TimeFutakotamagawa Rise Office, Japan2d ago
-
A/B | A/B Testing | B testing | Data Ingestion | Deep learningAnnual health check | Overseas relocation support | Visa sponsorshipSenior-level Full TimeShibuya, Tokyo, Japan3d ago
-
Platform Engineer, Gen AI JPY 8000K-10560KAmazon Web Services | As-a-Service | CI/CD | Code extension | Distributed SystemsFlexible work hours | International team collaboration | Professional development | Remote-firstMid-level Full TimeJapan - Remote R6d ago
-
機械学習開発エンジニアインターン｜Machine Learning Development Engineer Intern JPY 2760K-3000KAlgorithms | Data Structures | MLOps | Machine Learning | Operating SystemsEmployee Assistance Program (EAP) | Flexible working hours | Free drinks corner | Health insurance | Paid leaveEntry-level Internship Part TimeJapan-Tokyo-Business Tower6d ago
-
Embedded Software Requirements Engineer_組込みソフトウェア要求エンジニア JPY 2760K-5268KC# | C++ | Embedded Software | FPGA | HardwareMid-level Full TimeYokohama, Japan7d ago
-
Software Engineer, Generative AI Engineering JPY 8600K-10000KAPI Design | Access Control | Access Security | Agent systems | As-a-ServiceFlexible work hours | Professional development | Remote-firstMid-level Full TimeJapan - Remote R7d ago
-
Senior Associate-AI And ML-EDS JPY 8500K-12000KAsync Programming | Autogen | Azure | CI/CD | Copilot StudioSenior-level Full TimeKochi, KL, IN, 6823138d ago
-
Robotics Software Engineer - Motion Planning JPY 6850K-8500KActive Compliance Control | Actuator Driver | C++ | Collision Avoidance | Compliance controlMid-level Full TimeTokyo14d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Remote-friendly environmentMid-level Full TimeNagoya, Japan14d ago
-
Senior Analytics Engineer - Mercari JPY 7500K-9700KAI | BI | BigQuery | Data Governance | Data MartsFlexible work hoursSenior-level Full TimeMinato City, Tokyo, Japan14d ago
-
AI Support Engineer II JPY 8000K-8000KAI Platform | AI and ML | AI platform support | AWS | Agentic WorkflowsDental insurance | Flexible time off program | Global Employee Assistance Program EAP | Medical insurance | Paid HolidaysMid-level Full TimeRemote Japan R15d ago
-
Sr. AI Engineer- Agentic AI Platform JPY 8600K-9700KAI-assisted workflows | APIs | Agentic AI | Automation workflows | Cloud ComputingSenior-level Full TimeTokyo, Japan15d ago
-
Apache Flink | Apache Spark | Argo Workflows | ClickHouse | Distributed SystemsSenior-level Full TimeTokyo, Japan16d ago
-
Forward Deployment Engineer JPY 8000K-9700KAWS | Amazon Bedrock | Arize | Autogen | Automation AnywhereSenior-level Full TimeJP Tokyo, Japan16d ago
-
Advisory Solution Consultant - Data & Analytics JPY 8600K-9700KBigQuery | Capacity Planning | Data Engineering | Data Modeling | Data integrationSenior-level Full TimeTokyo, Japan17d ago
-
Field Application Engineer (Machine Learning) JPY 7000K-11000KC# | C++ | CUDA | Computer Vision | DockerFamily leave | Health insurance | Paid time off | Stock options | Training and developmentSenior-level Full TimeTokyo, Tokyo, Japan18d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Career growth | Flexible management | Remote-firstMid-level Full TimeTokyo, Japan19d ago