Sep 2015

Is wikipedia a valid source of scientific knowledge?


Is wikipedia a valid source of scientific knowledge? Many would say yes. Others are still quite skeptical, or maybe just cautious about it. What seems to be the case though - and this is what this post is about - is that wikipedians are increasingly including references to scientific literature, and when they do it they do it right.

Based on data we've recently extracted from Wikipedia, it looks like that the vast majority of citations to nature.com content have been done according to the established scientific practice (i.e. using DOIs). Which makes you think that whoever added those citations is either a scientist or has some familiarity with science.

In the context of the nature.com ontologies portal we've done some work aimed at surfacing links between our articles and other datasets. Wikipedia and DBpedia (an RDF database version of wikipedia) have come to our attention quite soon: how much do wikipedia articles cite scientific content published on nature.com? Also, how well do they cite it?

So here's an interactive visualization that lets you see all incoming references from Wikipedia to the nature.com archive. The actual dataset is encoded in RDF and can be downloaded here (look for the npg-articles-dbpedia-linkset.2015-08-24.nq.tar.gz file).

NewImage

About the data

In a nutshell, what we've done was simply extracting all mentions of either NPG DOIs or nature.com links using the wikipedia APIs (for example, see all references to the DOI "10.1038/ng1285").

These links have then been validated against the nature.com articles database and encoded in RDF in two ways: a cito:isCitedBy relationship links the article URI to the citing Wikipedia page, and a foaf:topic relationship links the same article URI to the corresponding DBpedia page.

Screen Shot 2015 09 03 at 12 37 33 PM In total there are 51309 links over 145 years.

Quite interestingly, the vast majority of these links are explicit DOI references (only ~900 were links to nature.com without a DOI). So, it seems that people do recognize the importance of DOIs even within a loosely controlled context like wikipedia.

Using the dataset

Considering that for many wikipedia is become the de facto largest and most cited encyclopedia out there (see the articles below), this may be an interesting dataset to analyze e.g. to highlight citation patters of influential articles. Also, this could become quite useful as a data source for content enrichment: the wikipedia links could be used to drive subject tagging, or they could even be presented to readers on article pages e.g. as contextual information.

Toparticles

We haven't really had time to explore any follow up on this work, but hopefully we'll do that soon.

All of this data is open source and freely available on nature.com/ontologies. So if you're reading this and have more ideas about potential uses or just want to collaborate, please do get in touch!

Caveats

This dataset is obviously just a snaphot of wikipedia links at a specific moment in time.

If one were to use these data within a real-world application he'd probably want to come up with some strategy to keep it up to date (e.g. monitoring the Wikipedia IRC recent changes channel). Good news is, work is already happening in this space:

Readings

Finally, here are a couple of interesting background readings I've found in the nature.com archive:

Enjoy!

Cite this blog post:


Michele Pasin. Is wikipedia a valid source of scientific knowledge?. Blog post on www.michelepasin.org. Published on Sept. 2, 2015.

Comments:


See also:

2014


paper  Linked data experience at Macmillan: Building discovery services for scientific and scholarly content on top of a semantic data model

International Semantic Web Conference (ISWC-14), Riva del Garda, Italy, Oct 2014.


2009


paper  Ontological Requirement for Supporting Smart Navigation of Philosophical Resources

PhD Thesis, Milton Keynes, UK, The Open University, Jul 2009.


2006




paper  An ontology for the description and navigation through philosophical resources

European Conference on Philosophy and Computing (ECAP-06), Trondheim, Norway, Jun 2006.