搜索与数据工程实习生（Ai大模型方向）
Tasks
- Analyze anti scraping mechanisms
- Build RAG data pipelines
- Build distributed crawler systems
- Build proxy pool and task scheduling
- Build search indexing and retrieval
- Build training datasets
- Clean and parse data
- Collect data from public internet sources
- Control access frequency
- Improve scalability and runtime efficiency
- Monitor crawl exceptions
- Optimize RAG retrieval results
- Optimize crawl pipeline stability
- Optimize crawl strategies and request patterns
- Optimize search retrieval performance
- Parse dynamic web pages
- Scrape web and document data sources
- Structure and process data for knowledge base
- Support data annotation and effect analysis
- Support search quality evaluation
- Update search data
Perks/Benefits
- N/A
Skills/Tech-stack
AJAX | Anti-scraping | CSS selector | Cookie | Distributed crawling | Dynamic Web | Dynamic Web Page Parsing | Elasticsearch | Embedding | Faiss | Feature analysis | HTML | HTTP | HTTPS | Kafka | Knowledge Base | Linux | Milvus | MongoDB | MySQL | OpenSearch | Playwright | Proxy Pool | Python | RAG | REST API | Rate Limiting | Redis | Regular Expression | Request Feature Analysis | Scrapy | Selenium | Session | Task Scheduling | Vector Search | Web Scraping | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Entry-level Internship深圳22h ago
-
数据分析实习生（Agent方向） CNY 25K-37KBI tools | Behavior Analysis | Conversion funnel | Conversion funnel analysis | DashboardingEntry-level Internship上海、北京2d ago
-
AI Data Scientist Intern CNY 38K-50KAI Algorithms | Data Annotation | Data Integrity | Data Modeling | Data QualityOnsite work at company facilitiesEntry-level Internship Part TimeShanghai - Daning A2 PIC, China3d ago
-
Entry-level Internship深圳3d ago
-
Entry-level Internship上海3d ago
-
API | Anomaly Detection | Cloud Computing | Database Design | ETLMid-level Full TimeShanghai4d ago
-
Senior Consultant Specialist CNY 120K-180KApache Airflow | Apache Beam | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeXi'an, Shaanxi, China5d ago
-
Omni模型算法实习生 CNY 25K-37KAblation Study | Annotation Validation | Cross-modal alignment | Data Analysis | Data AnnotationEntry-level Internship北京、深圳8d ago
-
Omni模型算法实习生 CNY 25K-37KData Analysis | Data Label Validation | Data cleaning | Distributed Training | FinetuningEntry-level Internship北京、深圳8d ago
-
Data Enablement Lead HKD 115K-140KApache Doris | Apache Hive | ClickHouse | Cross-Functional Collaboration | Cross-functionalSenior-level Full TimeHong Kong SAR9d ago
-
Entry-level Internship北京、上海9d ago
-
Machine Learning | NumPy | Pandas | PowerBI | PythonFlexible internship schedule | On-site workEntry-level Internship Part TimeShanghai - Daning Main Blg, China10d ago
-
计算机视觉算法实习生（视觉检测） CNY 25K-37KC plus plus | CLIP | Color Space Transformation | Color space | Data PreprocessingEntry-level Internship合肥11d ago
-
多模态大模型数据算法实习生 CNY 25K-37KData Automation | Data Quality | Data pipeline | Language Models | Large Language ModelsEntry-level Internship北京11d ago
-
数据开发实习生 CNY 25K-37KAI tools | Apache Superset | Data Modeling | Data Quality | Data quality monitoringEntry-level Internship Part Time上海11d ago
-
Ai算法实习生（算法数据支持方向） CNY 25K-37KData Augmentation | Data Quality | Data Versioning | Data cleaning | Data quality assuranceEntry-level Internship上海11d ago
-
AI Agent 算法实习生 CNY 50K-50KAutogen | BeautifulSoup | Data cleaning | Information Retrieval | LangchainEntry-level Internship上海11d ago
-
Entry-level Internship上海11d ago
-
Entry-level Internship Part Time上海11d ago
-
Data Analytics Intern CNY 38K-50KAWS | Classification | Cloud Computing | Clustering | Data ModelingEntry-level InternshipGuangzhou, Guangdong, China12d ago
-
Generative AI Researcher Intern CNY 28K-50KAutoregressive modeling | Diffusion Models | Discrete Diffusion | GPU Acceleration | Mesh ProcessingFull-time internship | Internship program supportEntry-level InternshipShanghai12d ago
-
Data Analytics Intern CNY 38K-50KClassification | Cloud Computing | Clustering | Data Modeling | Data VisualizationCareer development | Flexible working hours | Learning opportunitiesEntry-level InternshipGuangzhou, GD, CN, 51062012d ago
-
算法软件实习生 CNY 25K-37KAutomation Testing | C# | C++ | Computer Vision | Data AnalysisInternship experience | Learning and developmentEntry-level Internship北京12d ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache NiFi | BigQueryMid-level Full TimeGuangzhou, Guangdong, China13d ago
-
AI Intern CNY 45K-50KArtificial Intelligence | Campaign planning | Competitor Analysis | Content development | Data AnalysisEntry-level InternshipShanghai, China13d ago