OpenAI's recently unveiled SearchGPT is facing unexpected hurdles days after its launch. As reported by Business Insider, at least 14 top website publishers have blocked OAI-SearchBot, the web crawler designed to index information for SearchGPT. Blockers include The New York Times, Wired, The New Yorker, and Condé Nast publications like Vogue, Vanity Fair, and GQ.
Jon Gillham, CEO of Originality.ai, expressed surprise: "I am not sure why any publisher would block it. It is traffic that publishers want and need."
OpenAI emphasized that OAI-SearchBot's purpose was solely for indexing, not data collection for AI model training. They encouraged website owners to allow access to "ensure your site appears in search results."
The publishers' actions suggest a trust issue. OpenAI's history of collecting online data without permission may be a factor, despite assurances that SearchGPT is separate from their AI training.
The New York Times has taken a firm stance, stating they don't authorize use of their works for generative search or AI training without an express agreement. This aligns with their ongoing lawsuit against OpenAI and Microsoft.
Another factor may be the evolution of AI-powered search engines, which can provide summaries that reduce clicks to original content, potentially impacting publishers' traffic and revenue.
This situation unfolds as OpenAI has been forging partnerships with publishers for content access. The timing of these deals followed by SearchGPT's launch has raised eyebrows.
As this standoff develops, the tech world watches closely. The outcome could shape the future of online information access and the balance between technological advancement and intellectual property rights.
Will OpenAI find a way to appease publishers while maintaining comprehensive search coverage? Or will this lead to a fragmented internet landscape where AI-driven search tools struggle for complete results? The AI revolution faces a significant challenge.