Senior Data Engineer
Tasks
- Apply data modelling for relational and dimensional data
- Create and manage source to target mappings for ETL and ELT
- Design and implement Lakehouse architecture
- Design and implement data system architecture
- Design data warehouses using Kimball or Inmon principles
- Develop and manage cloud data architecture and reporting solutions
- Mentor engineers and contribute to code reviews
- Translate business requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake | Data Modelling | Data Warehousing | Databricks | Databricks Notebooks | Databricks SQL | Databricks Workflows | Delta Sharing | Dimensional Modelling | ELT | ETL | Inmon | Kimball | Lakehouse Architecture | Performance Tuning | Power BI | Python | Query Optimization | Relational Data | Relational Data Modelling | SQL Performance | SQL Performance Tuning | SQL Query Optimization | SQL Server | SQL query | Stream Analytics | Synapse Analytics | T-SQL | Unity Catalog
Education
Roles
Related jobs
-
Senior Software Engineer (Robotics OS Validation & Simulation) JPY 7000K-12000K3D Rendering | 3D programming | C++ | Distributed Systems | E2E TestingAnnual paid leave | Childcare leave | Commuting allowance | Employee gym access | Flex holidaySenior-level Full TimeTokyo, Japan (MJHQ)20h ago
-
Azure Data | Azure Data Factory | Data Factory | Data Modeling | Data QualityMid-level Full TimeKochi, KL, IN, 68231321h ago
-
Airflow | Ansible | BGP | CI/CD | DWDM24 7 network support | Weekend coverage scheduleMid-level Full TimeTokyo1d ago
-
Test Data Analysis Technology Development Engineer JPY 3120K-5268KAI | Adaptive testing | Anomaly Detection | Data Analysis | Defect predictionHybrid work model | Inclusive workplace | Remote work 2 days per weekEntry-level Full TimeKodaira, Japan R1d ago
-
機械学習エンジニア・Enterprise AI Solutions JPY 6000K-8800KAWS | Artifact management | Azure | CI/CD | Computer VisionAnnual paid leave | Car rental support | Employment insurance | Flexible working hours | Health insuranceMid-level Full Time東京都中央区1d ago
-
Machine Learning Engineer, Enterprise AI Solutions JPY 6000K-9000KAWS | Artifact management | Azure | CI/CD | Cloud PlatformsEntry-level Full TimeTokyo1d ago
-
Software Engineer, Tracking and Reporting - Global Ad Technology Supervisory Department (GATD) JPY 4500K-5000KApache Hive | Apache Kafka | Apache Spark | GCP | LinuxMid-level Full TimeFutakotamagawa Rise Office, Japan1d ago
-
Data Engineer, City Data Platform Development (Employment for People with Disabilities) JPY 3500K-4500KAWS | Apache Kafka | Apache Spark | Big Data | C plus plusHybrid workMid-level Full TimeTokyo2d ago
-
Head of Robotics System Engineering, Humanoid Team JPY 6000K-10000KBLDC FOC | C++ | CAN-FD | Cybersecurity | DDSExecutive-level Contract Full TimeTokyo4d ago
-
(R&D-029) AI Engineer (VLAs) JPY 4500K-6500KAWS | Action Generation | Actuator control | C++ | CI/CDWork location Tokyo JapanEntry-level Full TimeOta-ku, Tokyo, Japan4d ago
-
Ai/Mlクオリティーエンジニア JPY 2796K-5268KArtificial Intelligence | C++ | CNN | DBT | Data IntegrityAnnual paid leave | Car rental support | Company training programs | Flexible working hours | Housing allowanceSenior-level Full Time東京都中央区5d ago
-
AI/ML Quality Engineer JPY 6850K-10280KC plus plus | Convolutional Neural Network | DBT | Data Integrity | Data PipelinesMentorship | Training programsSenior-level Full TimeTokyo5d ago
-
AI Data Specialist JPY 7000K-10000KAccess Control | Auditability | Data Catalog | Data Compliance | Data EngineeringSenior-level Full TimeTokyo, Japan5d ago
-
EY-GDS Consulting-NF-AI And DATA-Databricks-Senior JPY 7500K-9700KAWS | Agile | Apache Spark | Azure | CI/CDSenior-level Full TimeKochi, KL, IN, 6823135d ago
-
Machine Learning Engineer, App SW JPY 8600K-9700KAgent simulation | Behavior Modeling | C++ | CUDA | Closed LoopHybrid work | Work from homeSenior-level Full TimeJapan7d ago
-
Mid-level Full TimeTokyo, Japan7d ago
-
Senior Software Engineer- Tokyo JPY 8600K-9700KAIOps | Apache Spark | Artificial Intelligence | Dspy | GenAISenior-level Full TimeTokyo, Japan7d ago
-
BigQuery | C plus plus | C# | Data analytics | Database DesignGlobal team collaboration | Non-standard work hoursMid-level Full TimeTokyo, Japan11d ago
-
機械学習エンジニア（Machine Learning Engineer） JPY 7000K-10000KA/B | A/B Testing | Amazon Aurora | Amazon Aurora MySQL | Aurora MySQLEnglish learning support | Self hosted LLM observability toolingSenior-level Full TimeTokyo11d ago
-
Mid-level Full TimeFuji Complex, Japan12d ago
-
Senior Technical Solutions Engineer (Platform) JPY 8000K-9700KAWS | Apache Spark | Azure | Delta Lake | Distributed ComputingInternal training programs | On-call rotationSenior-level Full TimeTokyo, Japan13d ago
-
Forward Deployed Engineer - Applied AI JPY 8600K-9700KAWS Lambda | CI/CD | Cloud Functions | Containers | Data MappingCustomer-facing work | Technical workshops | Travel opportunitiesMid-level Full TimeJapan Remote R14d ago
-
Senior Data Management Professional - Data Engineering - Listed Derivatives Data, Tokyo JPY 8000K-9000KAmazon S3 | Business Rules | Data Governance | Data Modeling | Data PipelinesSenior-level Full TimeTokyo15d ago
-
Senior Software Engineer JPY 8000K-13000KCI/CD | Celery | Django | Docker | ElasticsearchCollaborative work environment | Inclusive work environment | Personal growth opportunities | Relocation assistanceSenior-level Full TimeTokyo16d ago
-
Mid-level Full TimeTokyo, Tokyo, Japan18d ago