Good data is hard to find. Hard data is good to find.
Not as much as I used to, but I use the Internet for everything. I use it for information. Like if I'm planning a trip or something, I'll check out the place I'm going to.
The experience of being able to search back over all your team's communications for, in our case, millions of messages, is super-valuable. But you don't know what that's like until you actually have it.
A world where everyone creates content gets confusing pretty quickly without a good search engine.
The NSA is not listening to anyone's phone calls. They're not reading any Americans' e-mails. They're collecting simply the data that your phone company already has, and which you don't have a reasonable expectation of privacy, so they can search that data quickly in the event of a terrorist plot.
Every day we have teams looking for new data sets.
In fact, the private sector is improving their algorithmic ability to search through big data month after month after month. And, of course, a big government bureaucracy isn't keeping up.
When we miss with all the metadata collection we've had, the San Bernardino couple and the Tsarnaev brothers, what that suggests to me is that we are using the wrong algorithms to search through all this data.
There's a whole company called Palantir that does nothing but derive and create algorithms riches to search through big data. We're not using their capabilities. For heaven's sake, some of this is just ineptitude.
