𝕷𝖎𝖑𝖏𝖆𝖈𝖐 发表于 2025-3-14 08:31:08

人工智能时代，怎么才能屏蔽语言大模型？

网站不间断的被语言模型claude爬取，导致系统资源一直很高，robots跟本不管用。18.222.5.173 - - ＂GET /Spider/?url=%2Fzheli%2F15058.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂18.222.5.173 - - ＂GET /Spider/?url=%2Fzheli%2F15058.html HTTP/2.0＂ 200 20 ＂https://bm.cn/Spider/?url=%2Fzheli%2F15058.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂18.217.118.121 - - ＂GET /lizhizhichang/14027.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂18.217.118.121 - - ＂GET /lizhizhichang/14027.html HTTP/2.0＂ 200 14218 ＂https://bm.cn/lizhizhichang/14027.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.129.14.196 - - ＂GET /zheli/15754.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.129.14.196 - - ＂GET /zheli/15754.html HTTP/2.0＂ 200 6412 ＂https://bm.cn/zheli/15754.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂18.217.194.145 - - ＂GET /Spider/?url=%2Flizhigushi%2F11859.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂18.217.194.145 - - ＂GET /Spider/?url=%2Flizhigushi%2F11859.html HTTP/2.0＂ 200 20 ＂https://bm.cn/Spider/?url=%2Flizhigushi%2F11859.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂18.222.24.148 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F13700 HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂18.222.24.148 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F13700 HTTP/2.0＂ 200 27 ＂https://bm.cn/?p=%2FDo%2Fvisits%2Fid%2F13700＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂52.14.217.35 - - ＂GET /Spider/?url=%2Fzheli%2F14575.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂52.14.217.35 - - ＂GET /Spider/?url=%2Fzheli%2F14575.html HTTP/2.0＂ 200 20 ＂https://bm.cn/Spider/?url=%2Fzheli%2F14575.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂52.15.33.65 - - ＂GET /zheli/15446.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂52.15.33.65 - - ＂GET /zheli/15446.html HTTP/2.0＂ 200 6486 ＂https://bm.cn/zheli/15446.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.15.33.175 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F15151 HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.15.33.175 - - ＂GET /Spider/?url=%2Fzheli%2F15151.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.15.33.175 - - ＂GET /Spider/?url=%2Fzheli%2F15151.html HTTP/2.0＂ 200 20 ＂https://bm.cn/Spider/?url=%2Fzheli%2F15151.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.15.33.175 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F15151 HTTP/2.0＂ 200 27 ＂https://bm.cn/?p=%2FDo%2Fvisits%2Fid%2F15151＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.142.119.0 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F11859 HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.142.119.0 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F11859 HTTP/2.0＂ 200 27 ＂https://bm.cn/?p=%2FDo%2Fvisits%2Fid%2F11859＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.144.138.160 - - ＂GET /Spider/?url=%2Flizhirenwu%2F13822.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.144.138.160 - - ＂GET /Spider/?url=%2Flizhirenwu%2F13822.html HTTP/2.0＂ 200 20 ＂https://bm.cn/Spider/?url=%2Flizhirenwu%2F13822.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.18.103.72 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F16923 HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.18.103.72 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F16923 HTTP/2.0＂ 200 27 ＂https://bm.cn/?p=%2FDo%2Fvisits%2Fid%2F16923＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂18.119.10.178 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F12272 HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂18.119.10.178 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F12272 HTTP/2.0＂ 200 27 ＂https://bm.cn/?p=%2FDo%2Fvisits%2Fid%2F12272＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.15.163.5 - - ＂GET /Spider/?url=%2Fmingyan%2F11834.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.15.163.5 - - ＂GET /Spider/?url=%2Fmingyan%2F11834.html HTTP/2.0＂ 200 20 ＂https://bm.cn/Spider/?url=%2Fmingyan%2F11834.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂52.14.172.185 - - ＂GET /lizhigushi/9903.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂52.14.172.185 - - ＂GET /lizhigushi/9903.html HTTP/2.0＂ 200 6363 ＂https://bm.cn/lizhigushi/9903.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.145.68.208 - - ＂GET /lizhirenwu/12951.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.138.121.63 - - ＂GET /zheli/15750.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.145.68.208 - - ＂GET /lizhirenwu/12951.html HTTP/2.0＂ 200 8768 ＂https://bm.cn/lizhirenwu/12951.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.138.121.63 - - ＂GET /zheli/15750.html HTTP/2.0＂ 200 7679 ＂https://bm.cn/zheli/15750.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.144.190.95 - - ＂GET /zheli/14880.html HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.144.190.95 - - ＂GET /zheli/14880.html HTTP/2.0＂ 200 6297 ＂https://bm.cn/zheli/14880.html＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.145.129.10 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F9480 HTTP/2.0＂ 301 162 ＂-＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂3.145.129.10 - - ＂GET /?p=%2FDo%2Fvisits%2Fid%2F9480 HTTP/2.0＂ 200 27 ＂https://bm.cn/?p=%2FDo%2Fvisits%2Fid%2F9480＂ ＂Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)＂

拾光 发表于 2025-3-14 08:31:26

ua屏蔽

浅生 发表于 2025-3-14 08:32:07

bm.cn是你的？

浅生 发表于 2025-3-14 08:33:04

屏蔽不了，好多不管robots协议的。

独家记忆 发表于 2025-3-14 08:33:52

屏蔽IP。

IT618发布 发表于 2025-3-14 08:34:06

ua屏蔽
页: [1]
查看完整版本: 人工智能时代，怎么才能屏蔽语言大模型？