Senior Associate-EDS-DataEngineer
Kochi, KL, IN, 682313
JPY 8600K-9700K (estimate) Senior-level Full Time
Tasks
- Build complex SQL queries
- Collaborate with cross-functional stakeholders
- Create reports and analysis for stakeholders
- Design data models and transformations
- Develop ETL/ELT pipelines
- Implement data validation monitoring and governance
- Ingest and transform batch and streaming data
- Manage end to end data engineering deliverables
- Optimize Spark ingestion and transformation pipelines
- Present insights and variances to end users
- Write production quality Python data processing code
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | CI/CD | Data Governance | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | ELT | ETL | Git | PySpark | Python | SQL | Scala | Streaming Data
Education
N/A
Roles
Related jobs
-
Autonomy Data Analysis Engineer JPY 6850K-8500KAutomated testing | Bash | Bias Free Problem Solving | Bitbucket | CI/CDHybrid work policy | Inclusive work environmentMid-level Full TimeJapan18h ago
-
AI Engineer JPY 8500K-12000KAI Services | Agent coordination | Amazon Bedrock | Autogen | Automation AnywhereSenior-level Full TimeJP Osaka, Japan23h ago
-
Automotive AI Software Support Engineer JPY 2796K-5268KAI Model Deployment | AI Model Optimization | AI model | Android | C#Mid-level Full TimeTokyo, Tokyo, Japan23h ago
-
Account Solution Engineer, Tableau JPY 8281K-9700KArtificial Intelligence | Business Process | Business process transformation | Data Lake | Data ManagementSenior-level Full TimeJapan - Tokyo23h ago
-
Applied AI Engineer - Finance Super App (Japan) JPY 6500K-7500KAPI Integration | Agent systems | Cost Optimization | Domain Knowledge | EvaluationEnglish communication support | Hybrid workMid-level Full TimeTokyo, Japan2d ago
-
APIs | Agent Development | Agent Development Kit | Agent Frameworks | Agent systemsSenior-level Full TimeTokyo, Japan3d ago
-
APIs | Cloud platform | Data integration | Fine Tuning | Google CloudMid-level Full TimeTokyo, Japan4d ago
-
Data Engineer - FMCG Customer Strategy Section, FMCG Customer Strategy Department (C&M) JPY 6000K-10000KA/B | A/B Testing | B testing | BI Dashboards | BigQueryEntry-level Full TimeRakuten Crimson House, Japan4d ago
-
Data Engineer / Data Analyst - Ad & Media Solutions Section, Data Solutions Department, Marketing Solutions Business (A&M) JPY 6000K-10000KAI | Big Data | Business Intelligence | Data Aggregation | Data AnalysisMid-level Full TimeFutakotamagawa Rise Office, Japan4d ago
-
Lead Perception Engineer JPY 8500K-9700KC++ | Code review | Computer Vision | Continuous integration | Data ValidationSenior-level Full TimeTokyo5d ago
-
AWS | Apache Airflow | Broadway | DBT | ElixirAgile team culture | Automation focus | Remote workMid-level Full TimeChiyoda City, Japan5d ago
-
AI | AWS | Agile | Angular | AzureEntry-level Full TimeTokyo, JP R5d ago
-
ADLS | AI Foundry | AI Search | AI Services | Access ControlSenior-level Full TimeKochi, KL, IN, 6823035d ago
-
AI SDK | AWS | BigQuery | Databricks | DatadogCommunication allowance | Company events | Contractor education support | Employee training and development | Full remote workMid-level Full TimeTsukiji, Japan6d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous work culture | Flexible work environment | Remote workMid-level Full TimeNagoya, Japan8d ago
-
Mid-level Full TimeTokyo, Japan11d ago
-
Senior Software Engineer- Tokyo JPY 8600K-9700KAIOps | Artificial Intelligence | Dspy | Java | LangchainSenior-level Full TimeTokyo, Japan11d ago
-
Associate Manager, AI Full Stack Developer (Data & AI) JPY 6000K-10000KAI Agents | AI architecture | AI guardrails | Agentic AI | Backend DevelopmentMid-level Full TimeTokyo, Izumi Garden Tower, Japan12d ago
-
Consultant, AI Full-Stack Developer (Data & AI) JPY 4000K-5268KAWS | Agentic AI | Azure | C# | DatabricksEntry-level Full TimeTokyo, Izumi Garden Tower, Japan12d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Inclusive workplace | Remote-friendly cultureMid-level Full TimeTokyo, Japan13d ago
-
Business Intelligence Engineer, Search Capacity JPY 3600K-3600KAWS | Capacity Planning | Data Modeling | Data Visualization | Data WarehousingSenior-level Full TimeTokyo, JPN13d ago
-
Software Engineer, Generative AI Engineering JPY 3600K-6000KAI gateway | API Gateway | Access Management | Amazon Bedrock | AnthropicCross-functional collaboration | Hybrid work environment | Onsite at least 3 days per week | Professional documentationMid-level Full TimeTokyo14d ago
-
HPC Test Data Analysis Technology Development Engineer JPY 3600K-5268KAdaptive testing | Anomaly Detection | Data Analysis | Defect prediction | DockerFlexible working environment | Hybrid work | Inclusive workplace | Remote work 2 days per weekEntry-level Full TimeKodaira, Japan R14d ago
-
R&D-033 Robotics Simulation Engineer JPY 6500K-10000KAutomated testing | CI/CD | Containerization | Distributed Computing | DockerAcademic activities | Career development support | Publication opportunitiesMid-level Full TimeHeiwajima, Tokyo, Japan15d ago
-
API Integration | Agent systems | Data Pipelines | Evaluation | Google CloudMid-level Full TimeTokyo, Japan17d ago