LLM Pre-training & Distributed Engineer (AI Infrastructure)
Tasks
- Automate checkpointing
- Implement failure recovery
- Manage GPU clusters
- Optimize memory management
- Optimize network performance
- Orchestrate distributed training runs
- Prevent out of memory errors
Perks/Benefits
- N/A
Skills/Tech-stack
3D Parallelism | C++ | CUDA | Data parallelism | DeepSpeed | Infiniband | Kubernetes | Megatron-LM | Pipeline parallelism | PyTorch | Python | RDMA | Slurm | Tensor Parallelism
Education
N/A
Related jobs
-
BLDC motors | C# | C++ | CAN bus | Electromechanical SystemsMid-level Full TimeHong Kong21h ago
-
C++ | Compliant Control | Contact mechanics | Force/torque sensing | GraspingMid-level Full TimeHong Kong21h ago
-
Docker | Kubernetes | Langsmith | MLflow | MicroservicesMid-level Full TimeHong Kong21h ago
-
Apache Airflow | Apache Spark | Bias Mitigation | Dataset Distillation | Prompt engineeringMid-level Full TimeHong Kong22h ago
-
Mid-level Full TimeHong Kong22h ago
-
Quantitative Developer - Production SGD 132K-143KAlerting | Automation | Code Quality | Distributed tracing | Exchange protocolsEqual opportunity employer programs | Healthy work-life balance programsMid-level Full TimeHong Kong, Singapore1d ago
-
Senior / Lead Data Engineer HKD 119K-175KApache Airflow | BigQuery | Cloud Storage | DBT | Data GovernanceSenior-level Full TimeHong Kong1d ago
-
AI-powered development | AI-powered development tools | Agile | Algorithmic trading | Automated testingSenior-level Full Time83 HOI BUN ROAD KOWLOON, Hong …1d ago
-
Senior / Lead Data Engineer HKD 152K-220KApache Airflow | Apache Flink | BigQuery | Change Data Capture | DBTSenior-level Full TimeHong Kong1d ago
-
Mid-level Full TimeChina - Hong Kong2d ago
-
AI Models | Blockchain | Data Analysis | Decentralized applications | JavaSenior-level Full TimeHong Kong3d ago
-
(Senior) AML Manager, AI development HKD 600K-750KAML Monitoring | Data Analysis | Data Dictionary | Data Governance | Data PreprocessingSenior-level Full TimeHong Kong3d ago
-
Digital & Intelligent Specialist (Risk Management) HKD 312K-586KAPI Orchestration | Agent Frameworks | Algorithms | Chain-of-Thought | Chain-of-Thought promptingMid-level Full TimeHong Kong3d ago
-
Data Scientist | Capital Markets HKD 425K-586KActive Learning | Agentic Workflows | Data Governance | Data Modeling | Fine TuningMid-level Full TimeChina - Hong Kong4d ago
-
Machine Learning Engineer, Asia (Global Marketing AI) HKD 312K-550KAI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI SearchFlexible work environment | InclusionMid-level Full TimeHong Kong, Manulife Tower4d ago
-
Excel | Machine Learning | Power Automate | Power BI | PythonOnsite workEntry-level InternshipNew Territories, Hong Kong4d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous work culture | Career growth opportunities | Friendly work atmosphere | Impactful product work | Remote work environmentMid-level Full TimeHong Kong, Hong Kong5d ago
-
C++ | Data Versioning | Distributed Training | Docker | Experiment trackingMid-level Full TimeHong Kong7d ago
-
APIs | Agent systems | Cloud platform | Cost Per Request | CrewAIMid-level Full TimeTaipei, Taiwan; Hong Kong9d ago
-
Apache HBase | Apache Hadoop | Apache Hive | Apache Kafka | Apache SparkRemote work | Work from homeSenior-level Full TimeHong Kong R9d ago
-
Async Programming | Data Ingestion | Data Validation | Data Warehouse | ELTEntry-level Full TimeHong Kong9d ago
-
Access Control | Audit compliance | Automation | Backup and Recovery | Capacity PlanningMid-level Full TimeSun Life Hong Kong - Two …9d ago
-
Mid-level Full TimeSun Life Hong Kong - Two …9d ago
-
Consultant - AI Engineer HKD 300K-300KAI Foundry | AWS Bedrock | AWS SageMaker | Anthropic API | Azure AICareer growth | Performance-driven culture | Training programsMid-level Full TimeWan Chai, Hong Kong Island, Hong …11d ago
-
AI Engineer HKD 312K-480KAI Governance | API Design | Agentic AI | Agile | Backend FrameworksAnnual leave | Medical benefits | Retirement benefits schemeMid-level Full TimeHong Kong12d ago