It can be overwhelming to think about the ridiculously enormous volume of data floating around out there, and even more so to consider how little of it is actually getting put to good use. We seem to be good at the collecting aspect of data, but legislation and lack of training often makes the analytic and usage aspects a bit more tricky.

It’s the legislation that’s particularly frustrating, as the data is there, our tax dollars pay for its collection, and it belongs to us. Luckily, some interesting things are starting to happen on both sides of the open data equation that should make it easier in the future for data to be shared, analyzed, and used effectively.

Here are a few of the exciting developments that are happening on this front.

Interesting things are starting to happen on both sides of the open data equation that should make it easier in the future for data to be shared

DSSG

You really can’t have a conversation about the future of open data without talking about Data Science for Social Good. Training data scientists may be the single most important factor in how well data can be interpreted and used, and DSSG conducts intensive fellowship programs for the express purpose of preparing data scientists for the complex web of of work that lays ahead for them.

Fellows in DSSG’s programs work directly with federal agencies, local governments, and nonprofit organizations, helping them deal with their data issues and learning more about what these agencies do in the process. The fellowship lasts all summer, and is located in downtown Chicago, making it perfectly situated for interactions with the kinds of organizations and communities that need the most help with data.

CACS

One of the issues surrounding the freeing up of data is that it may prove impossible to understand for those who don’t have extensive training. The goal of California Common Sense is to break governmental data down into simpler components and and make it easier to consume for the general public.

The thinktank wants to educate the public on topics relating to how government works, and also on crime, education, health care, budgets, and pensions, so that a wider section of the population can make sense of the data that is becoming increasingly available to them.

The goal of California Common Sense is to break governmental data down into simpler components

DataSF

Exygy is proud to have built DataSF, a central online repository for data published by the City and County of San Francisco. There are hundreds of available datasets, and the data can be viewed by department and downloaded as desired, by anyone who wants or needs to use it. The goal is to allow this data to be used for the betterment of the residents of the San Francisco area, by helping the government to run more efficiently and for businesses to better understand the needs of the community.

Socrata

Seattle-based Socrata is a powerhouse of data management, with a range of apps and systems that can help any business or organization make sense of their data. Socrata works with city and federal governments to free up data and allow data exchanges to take place with the public, and it is an important player in the future of how data will be made available online.

In Kenya, for example, has had open data legislation since 2011, and makes a range of datasets available to the public through a Socrata-run online portal.

USAID

The United States Agency for International Development made an announcement last month that they would be moving to a new open data policy, inspired by what they refer to as “an era of unprecedented openness in government.” The new policy will allow for a central data repository where the data will be made public, along with a structure that will protect privacy and ensure usability.

“An era of unprecedented openness in government”

The benefits of such a policy fall on both sides, of course. Not only will the public and USAIDs partner organizations be able to contribute to improved development outcomes, but USAID itself can gain insights from both the data streams themselves, and observations on how the data is used.

CHHS

California Health and Human Services just complete a public beta of its Open Data Portal, and now offers a variety of public health datasets for download, with more to come. At the moment, anyone can download data relating to dozens of public health issues, and CHHS says its eventual goal for the site is to turn it into a one-stop-shop for all public health data in the state of California.

ODI

The Open Data Institute has a bright future ahead of it, as the European Union recently committed 14.4 million euros to open data projects that the institute will oversee. This is the largest single investment in open data in the world so far, and will be used to foster a three-pronged approach.

This is the largest single investment in open data in the world so far, and will be used to foster a three-pronged approach

Some of the money will be used for open data research, some for startups and startup incubators, and a portion will be allocated to a new training academy for data science, so that qualified individuals are available to work on future projects. With any luck, this push forward by the EU will inspire other governmental agencies across the globe to give open data high priority, and to come up with the money to back up the necessary initiatives.