GCP Data Engineer - Senior Consultant
Kochi, KL, IN, 682313
JPY 7500K-9700K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT workflows
- Create CI CD deployment automation
- Design data models
- Design data warehouses
- Develop data pipelines
- Ensure cost optimization
- Ensure data quality
- Implement batch processing
- Implement streaming processing
- Ingest, transform, load data
- Optimize BigQuery performance
- Participate in solution architecture
- Troubleshoot pipeline performance
- Work in agile sprints
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Beam | BigQuery | Bigtable | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | Data Warehousing | Dataflow | Dataproc | Dimensional Modeling | ELT | ETL | Google Cloud | Google Cloud Platform | Looker | Normalized modeling | Power BI | PubSub | Terraform
Education
N/A
Roles
Related jobs
-
Data Engineer JPY 8600K-11800KAzure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryContinuous learning | Diverse and inclusive culture | Transformative leadershipEntry-level Full TimeKochi, KL, IN, 6823031d ago
-
R&D-033 Robotics Simulation Engineer JPY 6500K-10000KAutomated testing | CI/CD | Containerization | Distributed Computing | DockerAcademic activities | Career development support | Publication opportunitiesMid-level Full TimeHeiwajima, Tokyo, Japan1d ago
-
API Integration | Agent systems | Data Pipelines | Evaluation | Google CloudMid-level Full TimeTokyo, Japan2d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible management approach | Inclusive workplace | Portfolio and LinkedIn application | Remote workMid-level Full TimeOsaka, Japan4d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Entrepreneurial team | Friendly laid-back atmosphere | Opportunity to make impactMid-level Full TimeFukuoka, Japan4d ago
-
Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache KafkaMid-level Full TimeRakuten Crimson House, Japan4d ago
-
AI productivity | AI productivity tools | Apache Spark | Batch Processing | BigQueryMid-level Full TimeFutakotamagawa Rise Office, Japan4d ago
-
Data Engineer JPY 8000K-15000KAuth0 | Azure | Datadog | Docker | GitHub CopilotConference participation support | Learning Support | OSS supportMid-level Full TimeTokyo4d ago
-
Senior Backend Engineer - Full Cycle Retail Robotics Engineering JPY 8000K-12500K.NET | ARM64 | Ansible | Azure | BlazorSenior-level Contract Full TimeTokyo5d ago
-
A/B | A/B Testing | B testing | Batch inference | CI/CDMid-level Full TimeRakuten Crimson House, Japan5d ago
-
Agile | Bash | Bazel | C# | C++Annual paid leave | Childcare leave | Commuting allowance | Employee gym access | Flex holidaySenior-level Full TimeTokyo, Japan (MJHQ)7d ago
-
Backend Software Engineer, Robot Platform Software JPY 3600K-6000KAMQP | CI/CD | Debugging | DevOps | DockerMid-level Full TimeTokyo8d ago
-
Sr. Forward Deployed Engineer JPY 8000K-9700KAWS | Apache Spark | Azure | CI/CD | Cloud platformCustomer-facing role | Travel opportunitiesSenior-level Full TimeTokyo, Japan10d ago
-
Next Frontier Quantum Associate JPY 4800K-7200KAWS Braket | Azure Quantum | CI/CD | Certificate management | CirqFlexible global teamworkMid-level Full TimeKochi, KL, IN, 68231311d ago
-
Forward-Deployed Data Scientist JPY 4800K-7200KAirflow | CI/CD | CatBoost | Cloud platform | Code reviewComprehensive health benefits | Dental insurance | Disability insurance | Employee stock purchase plans | Equal Paid Parental LeaveMid-level Full TimeTokyo11d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipeline | Data ProcessingFlexible asynchronous culture | Friendly work environment | Inclusive workplace | Remote work opportunityMid-level Full TimeTokyo, Japan12d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible management approach | Remote-friendly work cultureMid-level Full TimeYokohama, Japan12d ago
-
Agile | Analytics architecture | Artificial Intelligence | Data Engineering | Data GovernanceMid-level Full TimeOsaka, Japan12d ago
-
Agile | Analytics architecture | Data Engineering | Data Governance | Data PipelinesMid-level Full TimeTokyo, Kantō, Japan12d ago
-
Senior Data Engineer - Databricks JPY 8000K-9700KAirflow | Amazon Web Services | Apache Kafka | Apache Spark | CI/CDContinuous learning resources | Hybrid work options | International collaboration | Knowledge sharing culture | Professional development resourcesSenior-level Full TimeTokyo, Chiyoda, Japan13d ago
-
シニアデータエンジニア ‐ データブリックス JPY 7000K-9700KAWS | Airflow | Ansible | Apache Kafka | Apache NiFiCareer development support | Global collaboration | Hybrid work | Professional development support | Qualification supportSenior-level Full TimeTokyo, Chiyoda, Japan R13d ago
-
Amazon Redshift | BigQuery | CI/CD | Data Catalog | Data GovernanceFlextime | Fully remoteMid-level Full TimeNishishinjuku (Tsuginobiruonozoku), Japan R14d ago
-
CI/CD | ChatGPT API | Data Science | Docker | KubernetesMid-level Full TimeAkasaka (Tsuginobiruonozoku), Japan14d ago
-
AWS | Batch inference | CI/CD | Data Cleansing | Deep learningBook purchase subsidy | Certification support | Flexible work hours | Housing allowance | Paid time offMid-level Full TimeAkasaka, Japan14d ago
-
Senior Customer Engineer, Data Analytics (Japanese, English) JPY 8000K-12500KApache Spark | Batch Processing | Big Data | Cloud Computing | Data GovernanceSenior-level Full TimeTokyo, Japan14d ago