Senior Data Engineer
Tasks
- Apply data modelling for relational and dimensional data
- Create and manage source to target ETL ELT mappings
- Design and implement Lakehouse architecture
- Design and implement complex data system architecture
- Design data warehouses using established principles
- Develop and manage cloud data architecture and reporting solutions
- Mentor junior engineers and support architecture decisions
- Translate business requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | Data Architecture | Data Factory | Data Lake | Data Modelling | Data Warehousing | Databricks | Databricks Notebooks | Databricks SQL | Databricks Workflows | Delta Sharing | ELT | ETL | Indexing | Lakehouse Architecture | Microsoft Azure | Performance Tuning | Power BI | Python | Query Optimization | SQL Performance | SQL Performance Tuning | SQL Server | Stream Analytics | Synapse Analytics | T-SQL | Unity Catalog
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
APIs | Agent systems | Cloud platform | CrewAI | EvaluationMid-level Full TimeTokyo, Japan7h ago
-
Agent systems | Cloud APIs | Cloud platform | Fine Tuning | Google CloudSenior-level Full TimeTokyo, Japan7h ago
-
Business Intelligence Engineer, Supply Chain Optimization JPY 3672K-3672KAnalytics | Apache Spark | Chain management | Data Accessibility | Data GovernanceSenior-level Full TimeTokyo, JPN18h ago
-
AWS | CLIP | Computer Vision | ControlNet | Detectron2Hybrid work | Remote possibleMid-level Full TimeTokyo, Japan1d ago
-
Senior Analytics Solutions Architect JPY 3600K-3672KAI integration | AWS | Big Data | Cloud Native | Cost OptimizationSenior-level Full TimeTokyo, JPN3d ago
-
Senior Security Engineer - (NPW) JPY 7000K-12000KAI Act | AI Governance | AI Security | AWS | Amazon BedrockSenior-level Full TimeKochi, IN4d ago
-
Senior Software Engineer- Tokyo JPY 8600K-9700KAIOps | Apache Spark | Artificial Intelligence | Delta Lake | DspySenior-level Full TimeTokyo, Japan4d ago
-
Mid-level Full TimeTokyo, Japan4d ago
-
シニアデータエンジニア ‐ データブリックス JPY 4800K-8400KAWS | Airflow | Ansible | Apache Kafka | Apache SparkCareer feedback | Continuous learning resources | Hybrid work | Professional development support | Remote work optionMid-level Full TimeTokyo Prefecture, Japan R5d ago
-
R&D Data Scientist JPY 4100K-6000KAI | Apache Hadoop | Apache Spark | Bayesian statistics | Computer VisionEntry-level Full TimeKobe, Hyogo, Japan5d ago
-
IT Data Engineer JPY 6000K-8000KAWS Athena | AWS Lambda | Airflow | Alteryx | AuthenticationGlobal collaborationMid-level Full TimeKobe, Hyogo, Japan5d ago
-
Amazon SageMaker | Amazon Web Services | Data Pipelines | Docker | GitHubMid-level Full TimeOsaka, Osaka, Japan5d ago
-
Robotics Software Engineer - Localization & Perception JPY 7000K-9700KC++ | CI/CD | CUDA | Code review | Data FusionCollaborative team | Relocation support | Visa supportSenior-level Full TimeKoto City, Tokyo, Japan5d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Competitive salary | Laid-back atmosphereMid-level Full TimeTokyo, Japan6d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Friendly work environment | Remote distributed settingMid-level Full TimeYokohama, Japan6d ago
-
Platform Engineer, Gen AI JPY 8000K-10560KAmazon Web Services | As-a-Service | CI/CD | Code extension | Distributed SystemsFlexible work hours | International team collaboration | Professional development | Remote-firstMid-level Full TimeJapan - Remote R10d ago
-
Embedded Software Requirements Engineer_組込みソフトウェア要求エンジニア JPY 2760K-5268KC# | C++ | Embedded Software | FPGA | HardwareMid-level Full TimeYokohama, Japan11d ago
-
Software Engineer, Generative AI Engineering JPY 8600K-10000KAPI Design | Access Control | Access Security | Agent systems | As-a-ServiceFlexible work hours | Professional development | Remote-firstMid-level Full TimeJapan - Remote R11d ago
-
Senior Associate-AI And ML-EDS JPY 8500K-12000KAsync Programming | Autogen | Azure | CI/CD | Copilot StudioSenior-level Full TimeKochi, KL, IN, 68231312d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Remote-friendly environmentMid-level Full TimeNagoya, Japan18d ago
-
AI Support Engineer II JPY 8000K-8000KAI Platform | AI and ML | AI platform support | AWS | Agentic WorkflowsDental insurance | Flexible time off program | Global Employee Assistance Program EAP | Medical insurance | Paid HolidaysMid-level Full TimeRemote Japan R19d ago
-
Sr. AI Engineer- Agentic AI Platform JPY 8600K-9700KAI-assisted workflows | APIs | Agentic AI | Automation workflows | Cloud ComputingSenior-level Full TimeTokyo, Japan19d ago
-
Apache Flink | Apache Spark | Argo Workflows | ClickHouse | Distributed SystemsSenior-level Full TimeTokyo, Japan20d ago
-
Forward Deployment Engineer JPY 8000K-9700KAWS | Amazon Bedrock | Arize | Autogen | Automation AnywhereSenior-level Full TimeJP Tokyo, Japan20d ago
-
Advisory Solution Consultant - Data & Analytics JPY 8600K-9700KBigQuery | Capacity Planning | Data Engineering | Data Modeling | Data integrationSenior-level Full TimeTokyo, Japan21d ago