Senior AI Data Pipeline Engineer
Pangyo (Software Dream Center), South Korea
KRW 31000K-31000K (estimate) Senior-level Full Time
Tasks
- Architect and implement multi region data infrastructure
- Collaborate with AI researchers and platform teams to deliver training and evaluation data
- Design and build high performance scalable data pipelines
- Develop flexible pipeline architectures for branching and logic isolation
- Maintain and evolve containerized data environment on Kubernetes
- Optimize distributed data processing workloads with Databricks and Spark
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Cloud Native | Containerization | Databricks | Distributed messaging | Infrastructure as Code | Kubernetes | MLOps | Python | Ray | Spark Streaming | Terraform | “as-code”
Education
N/A
Related jobs
-
Staff Data Engineer (Coupang Pay) KRW 30880K-30880KAmazon Redshift | Apache Doris | Apache Flink | Apache Hive | Apache HudiSenior-level Full TimeSeoul, South Korea9h ago
-
Senior Data Engineer KRW 65000K-90000KAPI Gateway | AWS | AWS CDK | AWS CloudFormation | AWS LambdaSenior-level Full TimeSeongnam, Korea, Republic of16h ago
-
Physical AI Engineer (Model) KRW 31000K-31000KC++ | CUDA | Deep learning | Imitation Learning | JAXSenior-level Full TimePangyo (Software Dream Center), South Korea1d ago
-
Senior Physical AI Engineer (Simulation) KRW 31000K-31000K3D Gaussian Splatting | C++ | CARLA | CUDA | Closed LoopSenior-level Full TimePangyo (Software Dream Center), South Korea1d ago
-
ML Platform Engineer (Autonomous Driving) KRW 50000K-67271KApache Airflow | Apache Spark | Data Lakehouse | Databricks Workflows | Delta LakeMid-level Full TimePangyo (Software Dream Center), South Korea1d ago
-
Apache Airflow | Apache Hive | Apache Spark | Data Lakehouse | Data pipelineSenior-level Full TimePangyo (Software Dream Center), South Korea1d ago
-
Senior Computer Vision Engineer (Autonomous Driving) KRW 31000K-31000K3D Reconstruction | 3D shape modeling | C++ | CUDA | CameraSenior-level Full TimePangyo (Software Dream Center), South Korea1d ago
-
Senior Data Visualization Developer (Autonomous Driving) KRW 31000K-31000KAWS | Argo CD | CI/CD | Docker | FastAPISenior-level Full TimePangyo (Software Dream Center), South Korea1d ago
-
ML Performance Optimization Engineer KRW 31000K-31000KC plus plus | C# | CUDA | Computer Vision | Deep learningSenior-level Full TimePangyo (Software Dream Center), South Korea1d ago
-
Senior AI Engineer (Closed-loop Simulation & RL) KRW 30000K-30000K3DGS | Agent simulation | Autonomous Driving | CARLA | Counterfactual SimulationSenior-level Full TimePangyo (Software Dream Center), South Korea1d ago
-
[MS/PhD Intern] AI Engineer (정규직 전환형) KRW 25284K-25754KAblation Studies | Auto-labeling | Autonomous Driving | Benchmarking | Critical SystemsEntry-level InternshipPangyo (Software Dream Center), South Korea1d ago
-
Senior Embedded Linux Build Engineer KRW 30000K-30000KArtifact management | Bash | Bazel | Build caching | CI/CDSenior-level Full TimePangyo (Software Dream Center), South Korea1d ago
-
Intern - GenAI Benchmarking (MLE) / On-Device Model Deployment (SWE) KRW 45000K-55000KAIMet | Automated testing | Cache Management | Code review | Context modelingEntry-level InternshipSeoul, Korea, Republic of1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible remote work | Laid-back atmosphereMid-level Full TimeSeongnam, South Korea2d ago
-
Senior Databricks Consulting Engineer KRW 65000K-90000KAWS | Ansible | Apache Kafka | Apache Spark | AzureCollaborative international culture | Continuous learning and certification support | Flexible work arrangement | Knowledge sharing | Remote friendly working environmentSenior-level Full TimeSeoul, South Korea4d ago
-
AI Outcome Customer Engineer, Google Cloud KRW 65000K-90000KAI/ML | AI/ML Model Deployment | API | Architecture | Cloud infrastructureSenior-level Full TimeSeoul, South Korea4d ago
-
Applied AI Engineer (Korea) KRW 44000K-44000KAutomation | Customer Relationship Management | Customer relationship | Document processing | Fraud DetectionEnglish working environment | Remote workMid-level Full TimeSeoul, Korea6d ago
-
Applied AI Engineer - AI Neobank App (Korea) KRW 44000K-44000KAPI Integration | CRM automation | Cost Optimization | Data integration | Document processingFlexible work culture | Remote workMid-level Full TimeSeoul, Korea6d ago
-
R&D Engineer - Agentic AI KRW 65000K-90000KAgent systems | Agentic AI | Air-gapped | Air-gapped systems | C++Senior-level Full TimeSeongnam-si, Korea, Republic of7d ago
-
APIs | Agent systems | Cloud platform | Cost Per | Cost Per RequestMid-level Full TimeSeoul, South Korea7d ago
-
Data Contamination | Deep learning | Distributed Computing | Evaluation & benchmarking | LLM EvaluationEntry-level Full TimeSeoul7d ago
-
Senior-level Full TimeKorea Seoul, Korea, Republic of8d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataCompetitive salary | Impact on consumer and enterprise products | Laid-back atmosphere | Remote friendly asynchronous cultureMid-level Full TimeIncheon, South Korea12d ago
-
AWS AgentCore | AWS Bedrock | Agentic Workflows | Amazon SageMaker | Artificial IntelligenceInclusive culture | Workplace accommodationsSenior-level Full TimeSeoul, KOR12d ago
-
AIOps | AWS | Ansible | Argo CD | Auto ScalingSenior-level Full TimeSeoul13d ago