feat: Add V2EX and HuggingFace as free sources (no API keys required)#148
Open
Alan5168 wants to merge 3 commits intomvanhorn:mainfrom
Open
feat: Add V2EX and HuggingFace as free sources (no API keys required)#148Alan5168 wants to merge 3 commits intomvanhorn:mainfrom
Alan5168 wants to merge 3 commits intomvanhorn:mainfrom
Conversation
- Add last30days_lite.py for zero-API aggregation - Add lib/v2ex.py: V2EX Chinese tech community hot topics - Add lib/huggingface.py: HuggingFace trending AI models - Add docs/free-mode.md: Documentation for new free sources - Integrate v2ex/huggingface into main search pipeline V2EX and HuggingFace require no API keys, expanding coverage to: - Chinese tech community discussions (V2EX) - Trending AI models with downloads/likes (HuggingFace) Co-authored-by: Alan Li <alan5168@github.com>
This was referenced Apr 3, 2026
Improvements based on @Jah-yee's feedback in mvanhorn#149: 1. V2EX: Add 'latest' endpoint for broader coverage - New fetch_v2ex_latest() function - Combined fetch_v2ex() merges hot + latest - Deduplicates by topic ID - Hot topics get relevance boost 2. HuggingFace: Add likes-to-downloads quality ratio - New _calculate_quality_ratio() function - Quality labels: ⭐ excellent (5%+), 👍 good (2%+), ✓ acceptable (0.5%+) - Quality boost in relevance scoring - Helps identify well-regarded models vs just popular ones 3. Documentation: Add Chinese quickstart guide - docs/quickstart-zh.md for V2EX users - Explains quality ratio interpretation - Usage examples and FAQ Thanks @Jah-yee for the valuable feedback!
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Resolves #149
Summary
This PR adds two new free sources to last30days that require no API keys:
Motivation
See detailed rationale in Issue #149:
Key Points:
Changes
scripts/lib/v2ex.pyscripts/lib/huggingface.pyscripts/last30days_lite.pyscripts/last30days.pydocs/free-mode.mdIntegration
Both sources are integrated into the main search pipeline:
VALID_SEARCH_SOURCES:v2ex,huggingface,hf_search_v2ex(),_search_huggingface()Usage
Output Examples
V2EX:
HuggingFace:
Testing
Both modules tested locally:
Why This PR is Unique (vs other source requests)
GITHUB_TOKENTAVILY_API_KEYKey differentiators:
Comparison Table
Expanding last30days coverage to global tech communities and AI model trends — zero API keys required.
Related: #134 (GitHub source), #128 (MiniMax API backend)