Big Tech needs to get creative as it runs out of data to train its AI models. Here are some of its wildest solutions.

Last summer, the legal department at Google began asking employees to broaden the language around using consumer data, the Times reported. Some employees were informed that the company wanted to use data from the free consumer versions of Google Docs, Google Sheets, Google Slides, and even the restaurant reviews on Google Maps.

While Google updated its privacy policy in July 2023, the company says it didn't expand the types of data it uses to train AI models.

At Meta, the waning supply of usable data concerned executives so much they met almost daily in March and April last year to brainstorm alternatives, the Times reported.

One idea floated at these meetings was to buy Simon & Schuster. The famed publishing house has worked with authors like Stephen King and Jennifer Weiner and was purchased by private equity firm KKR for $1.62 billion last year.

Other attendees suggested a more budget-friendly option of paying $10 a book to obtain the full licensing rights to new titles.

Synthetic data is data generated by AI systems, and OpenAI has considered it an option for its models.

"As long as you can get over the synthetic data event horizon, where the model is smart enough to make good synthetic data, everything will be fine," OpenAI CEO Sam Altman said at a tech conference last May, according to the Times.

The issue with training AI systems on synthetic data is that it can reinforce some of the mistakes and limitations of AI, the Times reported. OpenAI is working on a process to address this in which one AI system produces data, and another AI system judges it.

OpenAI has also built Whisper, a speech recognition tool that can translate YouTube videos and podcasts. Its latest large language model, GPT-4, has been trained on over one million hours of YouTube videos transcribed by Whisper.

OpenAI's president, Greg Brockman, was a key developer of Whisper and told the Times that OpenAI relies on "numerous sources" of data for its systems.

Photobucket was once "the world's top image-hosting site" and accounted for nearly half of the US online photo market, according to Reuters. Part of that was because it hosted photos for early social media sites like Myspace and Friendster.

Its database of pictures might now soon be licensed to tech companies for training their AI systems, Reuters reported. Photobucket declined to identify prospective buyers to Reuters.