Gyubin-Han/community-crawler
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
d62867e0cb31e50c4b598fd477c135043d1b61dc
community-crawler/crawler
History
Claude d62867e0cb Add URL endpoint testing script 
- Test different Ruliweb URLs (search, board, best, main)
- Result: All endpoints return 403 "Access denied"
- Confirms that Ruliweb blocks all bot requests
- Validates that Puppeteer/Selenium is required
2025-11-15 17:34:10 +00:00
..
src
Improve fetcher with browser-like headers and cookie handling
2025-11-15 17:28:23 +00:00
package-lock.json
Add crawler implementation (Node.js + TypeScript)
2025-11-15 17:18:09 +00:00
package.json
Add crawler implementation (Node.js + TypeScript)
2025-11-15 17:18:09 +00:00
test-search.js
Add URL endpoint testing script
2025-11-15 17:34:10 +00:00
tsconfig.json
Add crawler implementation (Node.js + TypeScript)
2025-11-15 17:18:09 +00:00