Senior AI Data Pipeline Engineer
Pangyo (Software Dream Center), South Korea
KRW 31000K-31000K (estimate) Senior-level Full Time
Tasks
- Architect and implement multi region data infrastructure
- Collaborate with AI researchers and platform teams to deliver training and evaluation data
- Design and build high performance scalable data pipelines
- Develop flexible pipeline architectures for branching and logic isolation
- Maintain and evolve containerized data environment on Kubernetes
- Optimize distributed data processing workloads with Databricks and Spark
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Cloud Native | Containerization | Databricks | Distributed messaging | Infrastructure as Code | Kubernetes | MLOps | Python | Ray | Spark Streaming | Terraform | “as-code”
Education
N/A
Related jobs
-
Senior/Staff Applied Scientist (시니어/스태프 응용 과학자) KRW 65000K-90000KApache Spark | Attribution Modeling | Causal Inference | Causal reasoning | Experiment designSenior-level Full TimeSeoul, Korea15h ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Flexible management style | Inclusive workplace | Remote distributed environmentMid-level Full TimeIncheon, South Korea2d ago
-
Staff Software Engineer, Machine Learning KRW 65000K-90000KBig Data | Causal Inference | Deep Neural Networks | Deep learning | JavaHybrid work | In office collaboration three times per weekSenior-level Full TimeSeoul, South Korea2d ago
-
Staff Software Engineer, Machine Learning KRW 65000K-90000KCausal Inference | Deep learning | Java | Keras | Machine LearningHybrid work model | In office collaboration three times per weekSenior-level Full TimeSeoul, South Korea3d ago
-
[AI Research Div.] AI Agent Engineer (2년 이상) KRW 31000K-31000KAgentic AI | Benchmarking | Deep learning | Evaluation | LLM AgentsSenior-level Full TimeSeoul4d ago
-
Customer Success Physicist- Korea KRW 44000K-44000KControl Systems | Python | Quantum Computing | Quantum Control | Quantum PhysicsTravel for customer engagementMid-level Full TimeSOUTH KOREA, SOUTH KOREA, KR5d ago
-
Machine Learning Engineer (Match Group AI) KRW 31000K-31000KA/B | A/B Testing | B testing | Causal Inference | Causal analysisSenior-level Full TimeSeoul, South Korea6d ago
-
Software Engineer II - Moloco Commerce Media KRW 50000K-67271KAPIs | Algorithms | Apache Beam | Apache Spark | BigQueryMid-level Full TimeSeoul, Korea6d ago
-
Machine Learning Engineer (Match Group AI) KRW 30000K-30000KA/B | A/B Testing | AWS | B testing | Causal InferenceMid-level Full TimeSeoul, South Korea6d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible, hands-off management | Friendly work environment | Industry impact | Remote-friendlyMid-level Full TimeBusan, South Korea7d ago
-
Anomaly Detection | Artificial Intelligence | Data Architecture | Edge Computing | Ethernet/IPMid-level Full TimeNonsan-si, Korea, Korea, Republic of7d ago
-
Intern- Deep Learning R&D for Automated Driving KRW 48000K-67000KC# | C++ | Deep learning | Machine Learning | PyTorchEntry-level InternshipSeoul, Korea, Republic of7d ago
-
Platform Engineer KRW 44000K-50000KAgent Orchestration | Agentic Workflows | Cloud infrastructure | Code repair | Context engineeringMid-level Full TimeSeoul, KR, 0657810d ago
-
Sr. Lead Engineer (Full Stack Developer) KRW 65000K-90000KAWS | Azure | Client-Server | Client-Server Architecture | Data ModelingSenior-level Full TimeSeoul, Korea, republic of12d ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeSeoul, South Korea12d ago
-
Senior-level Full TimeSeoul HQ13d ago
-
Machine Learning Software Engineer (Match Group AI) KRW 44000K-44000KApache Flink | Apache Kafka | Apache Spark | Batch Processing | C#Mid-level Full TimeSeoul, South Korea14d ago
-
Algorithms | Batch Processing | C# | Data Structures | Distributed SystemsMid-level Full TimeSeoul, South Korea15d ago
-
AI Engineer (On-device Agent Orchestration 개발) KRW 31000K-31000KAndroid | C# | Generative AI | Java | KotlinSenior-level Full TimePangyo (Software Dream Center), South Korea19d ago
-
[집중채용] LLM Engineer (LLM Training) KRW 26800K-26800KDDP | Deep learning | Distributed Training | Docker | Efficient Fine TuningSenior-level Full TimePangyo (Software Dream Center), South Korea19d ago
-
LLM Engineer (Reinforcement Learning) KRW 26800K-26800KDDP | DPO | Deep learning | Distributed Training | DockerSenior-level Full TimePangyo (Software Dream Center), South Korea19d ago
-
[집중채용] Deep Learning Engineer (음성 인식 및 wake word detection 개발) KRW 30880K-30880KAndroid | Audio Processing | C# | C++ | CI/CDSenior-level Full TimePangyo (Software Dream Center), South Korea19d ago
-
Senior-level Full TimePangyo (Software Dream Center), South Korea19d ago
-
Senior Backend Engineer (Intelligence Data Platform) KRW 30880K-30880KAPI Development | AWS | Backend Services | Data Pipelines | Data QualitySenior-level Full TimePangyo (Software Dream Center), South Korea19d ago
-
Intern - GenAI Benchmarking (MLE) / On-Device Model Deployment (SWE) KRW 45000K-67000KAIMet | Automated testing | Executorch | Git | Hugging FaceEntry-level InternshipSeoul, Korea, Republic of19d ago