feat: add scripts for fetching arXiv papers and generating structured reviews
Sync to site1 / sync (push) Has been cancelled
Sync to site1 / sync (push) Has been cancelled
- Implemented `fetch_crowdroom_papers.py` to scrape arXiv papers related to CrowdRoom with customizable query topics and output options. - Created `gen_review_from_json.py` to render structured markdown reviews from search results JSON, including statistics and insights on papers and GitHub repositories. - Developed `search_info.py` for thematic searches on arXiv and GitHub, supporting HTTP/SOCKS5 proxies and structured output.
This commit is contained in:
@@ -0,0 +1,18 @@
|
||||
# Research Data
|
||||
|
||||
本目录存放论文调研的原始数据文件和缓存。
|
||||
|
||||
## 文件说明
|
||||
|
||||
| 文件 | 说明 |
|
||||
|------|------|
|
||||
| `search_results.json` | arXiv + GitHub 历史检索缓存(ZED2i 相关,含 2026-04/05 最新论文) |
|
||||
| `crowdroom_papers_raw.json` | CrowdRoom 专属 arXiv 抓取结果(当前因 429 限速为空) |
|
||||
| `lyra2_paper.txt` | Lyra 2.0 论文全文(arXiv:2604.13036,NVIDIA,2026-04) |
|
||||
| `lyra2_paper.pdf` | Lyra 2.0 论文 PDF 原文 |
|
||||
|
||||
## 注意事项
|
||||
|
||||
- `search_results.json` 是重要的历史缓存,请勿随意删除
|
||||
- 数据文件不纳入 git 版本控制(见 `.gitignore`)
|
||||
- 重新抓取请使用 `../tools/` 目录下的脚本
|
||||
Reference in New Issue
Block a user