Senior Data Engineer
Tasks
- Apply data modeling for relational and dimensional data
- Create and manage source to target mappings for ETL ELT
- Design and implement Lakehouse architecture
- Design and implement data system architecture
- Design data warehouses
- Develop and manage cloud data architecture and reporting
- Mentor junior engineers and perform code reviews
- Translate business requirements into specifications
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake | Data Modeling | Data Warehousing | Databricks | Databricks SQL | Databricks Workflows | Delta Sharing | Dimensional Modeling | ELT | ETL | Indexing | Infrastructure as Code | Lakehouse | Microsoft Azure | Performance Tuning | Power BI | Python | Query Optimization | SQL Performance | SQL Performance Tuning | SQL Server | Source to Target | Source-to-Target Mapping | Stream Analytics | Synapse Analytics | T-SQL | Target Mapping | Terraform | Unity Catalog | “as-code”
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
Staff Designated Support Engineer JPY 8600K-9700KAWS | Amazon Redshift | Apache Spark | Azure | CI/CDSenior-level Full TimeJapan16h ago
-
Head of Robotics System Engineering, Humanoid Team JPY 6000K-9653KBLDC FOC | C++ | CAN-FD | Cybersecurity | DDSExecutive-level Contract Full TimeTokyo3d ago
-
機械学習エンジニア（Machine Learning Engineer） JPY 7000K-10000KA/B | A/B Testing | AWS | Amazon Aurora | Amazon Aurora MySQLAdopt latest technologies | English learning support | Service oriented team | Social impact through product developmentSenior-level Full TimeTokyo3d ago
-
GCP Data Engineer - Senior Consultant JPY 7500K-9700KAirflow | Apache Beam | BigQuery | Bigtable | CI/CDSenior-level Full TimeKochi, KL, IN, 6823133d ago
-
Senior-level Full TimeTokyo3d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Processing | DockerAsynchronous work culture | Career impact | Collaborative team environment | Remote work | Supportive managementMid-level Full TimeOsaka, Japan4d ago
-
Bash | Cloud platform | Data Processing | Data Processing Pipelines | DockerAsynchronous culture | Laid-back atmosphere | Portfolio review and feedback | Remote-friendly environmentMid-level Full TimeFukuoka, Japan4d ago
-
Apache Beam | BigQuery | C++ | Cloud Architecture | Data WarehousingTravel up to 30 percent | Workshops and technical training opportunitiesSenior-level Full TimeTokyo, Japan4d ago
-
Perception Engineer, Mobility Vision, Mobility BU JPY 4800K-8400KAWS | CI/CD | Computer Vision | Docker | Edge ComputingHybrid workstyle | Work assignments in Woven CityMid-level Full TimeTokyo6d ago
-
APIs | Agent systems | Cloud platform | CrewAI | EvaluationMid-level Full TimeTokyo, Japan6d ago
-
Agent systems | Cloud APIs | Cloud platform | Fine Tuning | Google CloudSenior-level Full TimeTokyo, Japan6d ago
-
Customer Success Engineer JPY 8600K-9700KAWS | Application Lifecycle Management | Application lifecycle | Cloud infrastructure | Cloud platformEmployee assistance program | Flexible time off | Paid Holidays | Paid parental leaveSenior-level Full TimeRemote Japan R7d ago
-
機械学習エンジニア・Enterprise AI Solutions JPY 6000K-8800KAWS | Artifact management | Azure | CI/CD | Computer VisionAnnual paid time off | Car rental support | Company training | Flexible working hours | Health insuranceMid-level Full Time東京都中央区7d ago
-
AWS | CLIP | Computer Vision | ControlNet | Detectron2Hybrid work | Remote possibleMid-level Full TimeTokyo, Japan7d ago
-
Senior-level Full TimeKochi, IN9d ago
-
Senior Analytics Solutions Architect JPY 3600K-3672KAI integration | AWS | Big Data | Cloud Native | Cost OptimizationSenior-level Full TimeTokyo, JPN10d ago
-
Senior Security Engineer - (NPW) JPY 7000K-12000KAI Act | AI Governance | AI Security | AWS | Amazon BedrockSenior-level Full TimeKochi, IN11d ago
-
シニアデータエンジニア ‐ データブリックス JPY 4800K-8400KAWS | Airflow | Ansible | Apache Kafka | Apache SparkCareer feedback | Continuous learning resources | Hybrid work | Professional development support | Remote work optionMid-level Full TimeTokyo Prefecture, Japan R11d ago
-
R&D Data Scientist JPY 4100K-6000KAI | Apache Hadoop | Apache Spark | Bayesian statistics | Computer VisionEntry-level Full TimeKobe, Hyogo, Japan11d ago
-
IT Data Engineer JPY 6000K-8000KAWS Athena | AWS Lambda | Airflow | Alteryx | AuthenticationGlobal collaborationMid-level Full TimeKobe, Hyogo, Japan11d ago
-
Amazon SageMaker | Amazon Web Services | Data Pipelines | Docker | GitHubMid-level Full TimeOsaka, Osaka, Japan11d ago
-
Robotics Software Engineer - Localization & Perception JPY 7000K-9700KC++ | CI/CD | CUDA | Code review | Data FusionCollaborative team | Relocation support | Visa supportSenior-level Full TimeKoto City, Tokyo, Japan12d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Competitive salary | Laid-back atmosphereMid-level Full TimeTokyo, Japan13d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Friendly work environment | Remote distributed settingMid-level Full TimeYokohama, Japan13d ago
-
Platform Engineer, Gen AI JPY 8000K-10560KAmazon Web Services | As-a-Service | CI/CD | Code extension | Distributed SystemsFlexible work hours | International team collaboration | Professional development | Remote-firstMid-level Full TimeJapan - Remote R17d ago