搜索与数据工程实习生(Ai大模型方向)
Tasks
- Analyze anti scraping mechanisms
- Build RAG data pipelines
- Build distributed crawler systems
- Build proxy pool and task scheduling
- Build search indexing and retrieval
- Build training datasets
- Clean and parse data
- Collect data from public internet sources
- Control access frequency
- Improve scalability and runtime efficiency
- Monitor crawl exceptions
- Optimize RAG retrieval results
- Optimize crawl pipeline stability
- Optimize crawl strategies and request patterns
- Optimize search retrieval performance
- Parse dynamic web pages
- Scrape web and document data sources
- Structure and process data for knowledge base
- Support data annotation and effect analysis
- Support search quality evaluation
- Update search data
Perks/Benefits
- N/A
Skills/Tech-stack
AJAX | Anti-scraping | CSS selector | Cookie | Distributed crawling | Dynamic Web | Dynamic Web Page Parsing | Elasticsearch | Embedding | Faiss | Feature analysis | HTML | HTTP | HTTPS | Kafka | Knowledge Base | Linux | Milvus | MongoDB | MySQL | OpenSearch | Playwright | Proxy Pool | Python | RAG | REST API | Rate Limiting | Redis | Regular Expression | Request Feature Analysis | Scrapy | Selenium | Session | Task Scheduling | Vector Search | Web Scraping | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Intern Data Engineer CNY 38K-50KAmazon Redshift | Apache Hive | Apache Kafka | Apache Spark | DevOpsFeedback | Mentoring | Team collaborationEntry-level InternshipThe Roof, Room 201, Building D, …1d ago
-
AI tools | Bash | C# | C++ | CUDAEntry-level InternshipChina, Shanghai1d ago
-
C# | C++ | CUDA | Cause analysis | Deep learningEntry-level InternshipChina, Shanghai1d ago
-
Entry-level Internship上海2d ago
-
APIs | Agentic AI | CI/CD | Data Pipelines | Distributed SystemsMid-level Full TimeGuangzhou, Guangdong, China R2d ago
-
Entry-level InternshipShanghai2d ago
-
CI/CD | Data Pipelines | Distributed Systems | Docker | Entity ResolutionMid-level Full TimeGuangzhou, GD, CN, 5106202d ago
-
C++ | CUDA | Deep learning | Linux | Model InferenceComprehensive benefits packageEntry-level InternshipChina, Shanghai2d ago
-
Entry-level Internship北京、上海3d ago
-
Entry-level Full Time Internship北京、深圳、上海3d ago
-
Artificial Intelligence Intern CNY 38K-50KClassification | Clustering | Data Analysis | Data Preprocessing | Data VisualizationClub activities | Community volunteer opportunities | No Travel | On-site mealsEntry-level InternshipWuxi, CN3d ago
-
Amazon Web Services | Anomaly Detection | Apache Airflow | Apache Flink | Apache KafkaMid-level Full TimeShanghai3d ago
-
机器人 Vln 大模型导航-实习生 CNY 25K-37KAI-assisted programming | C++ | CUDA | Data pipeline | Deep learningOnsite workEntry-level Internship北京4d ago
-
多模态大模型算法实习生-2027届 CNY 25K-37KAutonomous Driving | DeepSpeed | Language Model | LoRA | Machine LearningEntry-level Internship北京4d ago
-
自动驾驶数据挖掘算法开发实习生(Llm/Vlm方向)-2027届 CNY 25K-37KAlgorithm Evaluation | Computer Vision | Coverage | Data Mining | Data PreprocessingEntry-level Internship武汉4d ago
-
AI Ops | Agile | Automated testing | Autoscaling | CI/CDSenior-level Full TimeGuangzhou, GD, CN, 5106204d ago
-
AI Agent Development Intern CNY 120K-120KAPI Integration | Database Integration | Generative AI | Knowledge Retrieval | Language ProcessingEntry-level InternshipChengdu,Sichuan,China5d ago
-
Entry-level InternshipBeijing,Beijing,China5d ago
-
Sr. Associate Director, Data and Analytics CNY 480K-510KAmazon Web Services | Angular | Azure | CI/CD | Cloud platformMid-level Full TimeGuangzhou, Guangdong, China5d ago
-
Architecture | Audit Logging | Automated testing | CI/CD | Capacity PlanningMid-level Full TimeGuangzhou, Guangdong, China5d ago
-
Sr. Associate Director, Data and Analytics CNY 480K-510KAmazon Web Services | CI/CD | Java | Jenkins | KubernetesMid-level Full TimeGuangzhou, GD, CN, 5106205d ago
-
Audit Logging | Automated testing | CI/CD | Cause analysis | Column-Level SecurityMid-level Full TimeGuangzhou, GD, CN, 5106205d ago
-
AI Native Software Engineering Manager CNY 144K-240KAnthropic | Autogen | CI/CD | Chunking | Context engineeringSenior-level Full TimeShanghai, Tsidi Building, China/Mainland7d ago
-
多模态理解算法实习生 CNY 25K-37KChain-of-Thought | Computer Vision | Data Annotation | Data cleaning | Data pipelineEntry-level Internship深圳、北京10d ago
-
Entry-level Internship深圳11d ago