A Big Data idea came up at the Singapore Quantified Self meetup last week. Working title: the Fishbowl Flag.
Problem 1: There's a lot of data about me out there – public transit tap-in and tap-out logs; medical records; utility statements; geolocation records. In a sense it's "my data" because it's about me, but in another sense it's not, because it lives on external servers which I have no access to.
Problem 2: Researchers working with public data are limited to pared-down, anonymized datasets. The limits exist because the public haven't given informed consent to publication.
Solution to Problem 1: Imagine a Data Transparency Act that requires all public and corporate records of individual data to be made available to that citizen. In the Web 1.0 era that data would be compressed into a zip file and shipped grudgingly upon request, much as Facebook offers a zip archive of your account. In the cloud era that data would be made available in the cloud not just through a dumb webpage but through some sort of JSON-standard API. UP Singapore's data wiki and Microsoft's Project Nimbus give a sense of the datasets available.
Solution to Problem 2: Imagine if you could instruct all those data sources to share your data at the anonymity level of your choice, with the recipients of your choice. Even if only one Quantified Self geek out of a hundred muggles signed up to flip their fishbowl flag, a lot of data would be liberated. One might even choose to share one's data only with other people who had similarly signed up to share their data: you show me yours, I'll show you mine. First the early adopters do it, then the network effects take over and everybody volunteers.
In most societies the Fishbowl Flag would require opt-in. But under the theory of "libertarian paternalism", and under the theory that Singaporeans are unusually sanguine about state intrusion into the private sphere, it might be possible for Singapore to be the first country in the world to turn the Fishbowl Flag on by default.
I invite the Quantified Self people to continue this discussion here on my interblog.