OpenAI 推出网络爬虫 GPTBot

类似于搜索引擎的索引机器人 "蜘蛛", GPTBot 将会遵守 robots.txt 和 OpenAI 的内容政策对网站内容进行抓取, 用于改进新模型.

GPTBot 的 UserAgent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.0; +https://openai.com/gptbot)

● GPTBot - OpenAI API
● ref: OpenAI Launches GPTBot With Details On How To Restrict Access

#OpenAI #AI

via CXPLAY's Memos

Openai

OpenAI Platform

Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.