Discussion on Trusting AI with Personal Data (Part 4)

But they respond to this data as if it were an order, as if it were a fact. And so we have seen countless breaches. We have seen agents make perilous mistakes. And I think, yes, I could ask an agent to drive Tor for me, but that's not. Again, if we're talking about Meta's Muse, that's not my agent. Finally, we learned through reporting recently that Muse is logging people's contact lists, logging the people they talk to. So you install Muse, and I am in your contact list. Muse now has my information. They are logging when we talk to each other. They are creating dossiers about me and your communications with me, Cambridge Analytica style. And so you are making a choice for your convenience that also implicates me. Now, that might not be serious. We're privileged people. We're in San Francisco. Our threat model may be fairly moderate, but that could be extraordinarily serious for somebody working on human rights in an authoritarian country who is trying to communicate data with somebody outside of that country. And so this. Again, I don't care about winning this debate. I care about looking this in the face and recognizing we are eating the seed corn of our cybersecurity when we install these things in the name of convenience, without thinking through the perilous architectures that we have used to create them. So, Neil, given the check, given the challenge of segmenting and locking down data, why is the convenience value worth more than the risk we're creating here? Well, I think it's easy for us to dismiss these types of challenges, but again, the goal here is not that agents are perfect or that they're perfect protectors of security. The question is, how do they compare to the status quo? And the status quo is not great. Most people don't use signal. Unfortunately, the status quo is full of people who are gathering information about us, in part because we've made that convenience trade off over and over and over. So Meredith is totally right that we need secure agents, we need better agents, but the challenge is not to not use. Remember what the proposition is? The proposition is, should we trust agents with our information or should we not trust agents? And it's a conditional. It depends. It really depends on the agent, it really depends on the use, and it really depends on the access that it's asking for. Most of the agents right now, I don't let them.