Senior Data Engineer
Tasks
- Apply data modeling for relational and dimensional data
- Create and manage source to target mappings for ETL ELT
- Design and implement Lakehouse architecture
- Design and implement data system architecture
- Design data warehouses
- Develop and manage cloud data architecture and reporting
- Mentor junior engineers and perform code reviews
- Translate business requirements into specifications
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake | Data Modeling | Data Warehousing | Databricks | Databricks SQL | Databricks Workflows | Delta Sharing | Dimensional Modeling | ELT | ETL | Indexing | Infrastructure as Code | Lakehouse | Microsoft Azure | Performance Tuning | Power BI | Python | Query Optimization | SQL Performance | SQL Performance Tuning | SQL Server | Source to Target | Source-to-Target Mapping | Stream Analytics | Synapse Analytics | T-SQL | Target Mapping | Terraform | Unity Catalog | “as-code”
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
AI Engineer - FDE (Forward Deployed Engineer) JPY 8281K-9700KAWS | Agent systems | Apache Spark | Azure | Cloud platformTravel for customer engagementsSenior-level Full TimeTokyo, Japan11h ago
-
R&D-002 Research Scientist (Robotics) JPY 3000K-3000KAR/VR | Admittance control | C++ | Contact-rich manipulation | Force TorqueOpen data access | Publication supportEntry-level Full TimeHeiwajima, Tokyo, Japan1d ago
-
R&D-004 Intern Research Scientist (Robotics) JPY 3000K-3000KC++ | Computer Vision | Force Torque | Force control | Force/torque sensingEntry-level InternshipHeiwajima, Tokyo, Japan1d ago
-
R&D-001 Senior Research Scientist (Robotics) JPY 7000K-10000KAR/VR | Admittance control | C plus plus | Computer Vision | Contact-rich manipulationBroad project ownership | Collaborative Research Team | Open data access | Research publicationsSenior-level Full TimeHeiwajima, Tokyo, Japan1d ago
-
Sr. Solutions Engineer (Pre-sales) - Kansai Region JPY 8000K-10473KAWS | Apache Spark | Big Data | Big data analytics | CassandraSenior-level Full TimeJapan2d ago
-
Senior Customer Engineer, Data Analytics (Japanese, English) JPY 8000K-12500KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceSenior-level Full TimeTokyo, Japan3d ago
-
Senior-level Full TimeHeiwajima, Tokyo, Japan3d ago
-
Applied AI Engineer JPY 6500K-7500KAutomation | CRM | Cost Optimization | Evaluation | Fraud DetectionHybrid work | Work from Japan office at least 3 days per weekMid-level Full TimeTokyo, Japan3d ago
-
AI Platform | BigQuery | CI/CD | Cloud platform | Data CatalogAnnual bonuses | Company Housing Allowance | Equipment provided | Flexible work hours | Fully remoteMid-level Full TimeTsukiji, Japan R3d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Career growth opportunities | Friendly laid-back atmosphere | Remote-friendly, distributed teamMid-level Full TimeTokyo, Japan4d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive salary | Friendly laid-back atmosphereMid-level Full TimeYokohama, Japan4d ago
-
AI Systems Engineer JPY 8600K-11000KAI Agents | Agent Orchestration | Artificial Intelligence | Automated testing | CI/CDCareer growth and development | Collaborative work environment | Opportunity to work on cutting edge robotics technologies | Visa application supportMid-level Full TimeKoto City, Tokyo, Japan4d ago
-
AWS SageMaker | Apache Airflow | Azure Machine Learning | Data Pipelines | DockerDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeJPN, Uruma City (Bldg 4225 Brown …4d ago
-
Test Data Analysis Technology Development Engineer JPY 3600K-5268KAdaptive testing | Anomaly Detection | Defect prediction | Docker | FastAPICollaborative work environment | Continuous learning opportunities | Flexible work schedule | Hybrid work model | Remote work flexibilityEntry-level Full TimeKodaira, Japan R5d ago
-
Principal Compiler Engineer – Quantum Software - 880 JPY 8000K-10473KCircuit compilation | Code generation | Compiler design | Correctness | Distributed SystemsSenior-level Full TimeJapan Tokyo5d ago
-
Autonomy Data Analysis Engineer JPY 6850K-8500KAutomated testing | Bash | Bias Free Problem Solving | Bitbucket | CI/CDHybrid work policy | Inclusive work environmentMid-level Full TimeJapan6d ago
-
AI Engineer JPY 8500K-12000KAI Services | Agent coordination | Amazon Bedrock | Autogen | Automation AnywhereSenior-level Full TimeJP Osaka, Japan6d ago
-
Automotive AI Software Support Engineer JPY 2796K-5268KAI Model Deployment | AI Model Optimization | AI model | Android | C#Mid-level Full TimeTokyo, Tokyo, Japan6d ago
-
Account Solution Engineer, Tableau JPY 8281K-9700KArtificial Intelligence | Business Process | Business process transformation | Data Lake | Data ManagementSenior-level Full TimeJapan - Tokyo6d ago
-
R&D-034 Robotics Controls & Teleoperation Engineer JPY 4500K-6500KAdmittance control | C++ | Communication | Data collection | Dexterous ManipulationAcademic activity support | Career growth support | Research paper publication supportEntry-level Full TimeHeiwajima, Tokyo, Japan6d ago
-
R&D-026 Robotics Engineer JPY 7000K-11000KActuators | C++ | CI/CD | Control Systems | DebuggingCareer growth | Open source contributions | Ownership | Technical autonomySenior-level Full TimeHeiwajima, Tokyo, Japan6d ago
-
IBM Quantum Algorithm Researcher — Japan JPY 5000K-7000KAgile | CI/CD | Debugging | Error mitigation | Error suppressionMid-level Full TimeTokyo, JP7d ago
-
Applied AI Engineer - Finance Super App (Japan) JPY 6500K-7500KAPI Integration | Agent systems | Cost Optimization | Domain Knowledge | EvaluationEnglish communication support | Hybrid workMid-level Full TimeTokyo, Japan7d ago
-
APIs | Agent Development | Agent Development Kit | Agent Frameworks | Agent systemsSenior-level Full TimeTokyo, Japan9d ago
-
APIs | Cloud platform | Data integration | Fine Tuning | Google CloudMid-level Full TimeTokyo, Japan10d ago