David Friedberg: AI Models are Training on YOUR DATA

All-In Podcast

Ask about All-In Podcast

Episode Description

Follow the besties: https://x.com/chamath https://x.com/Jason https://x.com/DavidSacks https://x.com/friedberg

Follow on X: https://x.com/theallinpod

Follow on Instagram: https://www.instagram.com/theallinpod

Follow on TikTok: https://www.tiktok.com/@allin

Follow on LinkedIn: https://www.linkedin.com/company/allinpod

Intro Music Credit: https://rb.gy/tppkzl https://x.com/yung_spielburg

Intro Video Credit: https://x.com/TheZachEffect

Brief Summary

The episode addresses risks of sharing proprietary knowledge with LLMs and concerns over data privacy.

Key points

  • Concerns Over LLM Training Data. A discussion on the implications of LLMs using proprietary insights for training.
  • The Value of Open Source. Emphasizing the importance of open source to protect proprietary information.

Transcript

Should they trust any of these LLMs with their proprietary knowledge for fear of having it cribbed into the core LLM? >> I have had experience where we've asked some fairly novel scientific questions and it identifies it as a novel insight. It's like, "Oh, never thought about that. It'd be interesting." Like, blah, blah, blah. And then using a different account, asking the same model later or the next version actually later, I've now experienced this. It's like, "Oh, well, you could do this." And it actually just describes this exact thing that we had in our chat in the previous version. Now, these are

a handful of anecdotal experiences, but I know the domain that we work in and the niche of it and the ID ideation of the stuff and the novelty of the stuff and the lack of papers being published and so on. So, I know that there isn't some new corpus of information out there that's training the new model. So, all I can say at that point is that my conversation or our analyses have been used for training. >> Okay, this does raise a really good question. What does it mean that the model's allowed to train on unidentifiable data? >> So, it doesn't use any of my personal information, but it can use an insight

derived from our chat, which it can then say is some training data that is unrelated, but the truth is it's actually a piece of IP that's for our our organizational's IP and our engagement back and forth. We don't have any NDA or confidentiality provisions or protections with them being a service provider back to us. This is why I care a lot about open source because I don't want them having my chat logs because they can use it for training to create an IP advantage that is now diffused to the rest of the market.

Related episodes