Ai 评测平台开发工程师（全栈）
Tasks
- Build benchmark registry and evaluation dataset versioning
- Build evaluation result parsing and archival
- Create visualization dashboards
- Design AI evaluation platform architecture
- Develop evaluation analytics and metric aggregation
- Enable batch evaluation with retries and idempotency
- Generate evaluation reports and leaderboards
- Implement asynchronous evaluation task system
- Implement model promotion gatekeeping
- Integrate model checkpoint and inference services
- Integrate training inference and data platforms
- Manage judge model evaluation
- Orchestrate evaluation jobs
- Support version comparison and anomaly tracking
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Asynchronous programming | Benchmark Registry | Cost Tracking | Data Modeling | Data Visualization | Database Design | Dataset versioning | Evaluation Dataset | Evaluation Dataset Versioning | Experiment Management | Failure diagnosis | Go | Idempotency | Java | LLM-as-a-Judge | Leaderboard | Logging | MLOps | Molecular Pipeline N/A | N A | Python | REST API | React | Result Analysis | Retry Mechanisms | Role-Based Access | Role-Based Access Control | Task Orchestration | Vue
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Backend | Backend Engineer | Developer | Engineer | Full Stack | Full Stack Developer | MLOps Engineer | Stack Developer
Related jobs
-
Entry-level Full Time上海 R6h ago
-
多模态交互算法工程师-X-Lab CNY 240K-480KAttention | Checkpointing | Hard Negative Mining | KV cache | Knowledge DistillationSenior-level Full Time上海、深圳6h ago
-
Senior Consultant Specialist CNY 120K-180KApache Airflow | Apache Beam | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeXi'an, Shaanxi, China14h ago
-
Jr. Digital Product Architect CNY 38K-50KAWS | AWS Glue | Agile | Alteryx | AzureMentoring support | Remote collaboration | Training opportunitiesEntry-level Full TimePudong New Area, SH, CN, 2012101d ago
-
ASIC | Agent systems | Agentic AI | BF16 | Bandwidth OptimizationSenior-level Full TimeShanghai, China1d ago
-
R&D – IoT Robotics Engineer CNY 360K-540KC++ | CI/CD | Computer Vision | Control Systems | Domain RandomizationSenior-level Full TimeGuangdong, China1d ago
-
Mid-level Full Time深圳1d ago
-
Entry-level Full Time北京1d ago
-
Robot Learning 模型全栈工程师 / 研究员 CNY 180K-300KAblation Study | Data Visualization | Data cleaning | Distributed Training | Hyperparameter TuningNone Full Time深圳、北京1d ago
-
Ai应用开发工程师（Pc方向） CNY 144K-240KCost Optimization | Data cleaning | Embedding | Engineering Automation | EvaluationEntry-level Full Time上海1d ago
-
Apache Flink | Apache Kafka | Apache Spark | Apache Superset | JavaMid-level Full TimeShanghai1d ago
-
Apache Flink | Apache Kafka | Apache Spark | CI/CD | Data PipelinesMid-level Full TimeShanghai1d ago
-
Algorithms | Concurrency | Containerization | Data Structures | DebuggingSenior-level Full TimeShanghai1d ago
-
AI RMF | AI Safety | Adversarial Testing | Artificial Intelligence | Automated EvaluationMid-level Full TimeGuangzhou, Guangdong, China1d ago
-
CI/CD | Cassandra | Concurrency | Distributed Systems | ElasticsearchSenior-level Full TimeShanghai1d ago
-
AWS | Access Control | Authentication | Azure | CI/CDEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysMid-level Full TimeHangzhou, China2d ago
-
AI RMF | APIs | Adversarial Attacks | Adversarial Testing | Automated testingMid-level Full TimeGuangzhou, GD, CN, 5106202d ago
-
Senior Software Engineer (GenAI Agent platform) CNY 510K-510KBest practices | Engineering Best Practices | Go | Integration Patterns | JavaSenior-level Full TimeGuangzhou, GD, CN, 5106203d ago
-
【2026届春招】AI Infra工程师-算法研发方向 CNY 144K-240KC++ | CUDA | Data parallelism | Distributed Training | HuggingfaceEntry-level Full Time北京、上海 R4d ago
-
Mid-level Full Time北京4d ago
-
Entry-level Internship北京、上海4d ago
-
【校招实习生】AI Infra 工程师-算法研究方向 CNY 25K-37KC++ | CI/CD | CUDA | NCCL | OpenMPIFull-time internship | Open source project opportunitiesEntry-level Internship北京、上海 R4d ago
-
【校招实习生】感知算法工程师 CNY 25K-37KBEV | C plus plus | CenterNet | Computer Vision | DETRInternship opportunityEntry-level Internship北京、上海4d ago
-
【27届校招】Omni模型算法工程师/研究员 CNY 500K-500KData Engineering | Distributed Training | Inference acceleration | Instruction Tuning | Knowledge DistillationEntry-level Full Time深圳、上海、北京4d ago
-
Mid-level Full Time深圳、北京4d ago