Data sources

A list of potential data sources, including and their APIs and data licenses.

See also | :sharing:api

Notes

Consumers

:calibre (books)
:kodi (cover art, series, movies)

Webscraping

RoboBrowser
Wrapper for the Requests and BeautifulSoup libraries, with form-filling functionality.
https://github.com/jmcarp/robobrowser

Free sources by topic category

General
Freebase (link) (API) [CC-BY]
Wikidata (link) (API) [CC0]
Wikipedia (link) (API) [CC-BY-SA] [and some optionally FDL]

Books
Open Library (link) [?CC]
LibraryThing Common Knowledge (link) [CC-BY-SA]

Exercise
???

Food
???

Fossil record
Paleobiology Database (link) (API) [CC-BY]

Games
Board Game Geek [?#]
TheGamesDB (link) [?CC]
Libregamewiki (link) [FDL and CC-BY]

Coverart
fanart.tv (link) (for series, movies, music, etc)

Movies
TMDb (link) [?#] (license)
omdb (link) [CC-BY] (license)

Music
MusicBrainz Database (link) [CC0] (also other licenses)
TheAudioDB (link) [CC?]
libre.fm [?]

Series
TheTVDB (link) [CC-BY]

Software listings (not forges)
Free Software Directory [FDL] (but not (currently) compatible with CC-style sources)
Freshcode [CC-BY-SA]
OpenHatch (link) [CC-BY?]
Open Hub [CC-BY]
Ubuntu Wiki (link) [CC-BY-SA]

Related protocols:

Web
http://fossilbank.wikidot.com (free culture on the web) [CC-BY]

Nonfree data by topic category

Books
LibraryThing CoverThing (book covers) (link) [#] (no competitor clause, other restrictions are technical)

Games
Digital stores: GOG, Humble Store, itch.io, Ouya, PSN?, Steam, XBox Live [?#]

Music
last.fm [?#]
MusicBrainz Database supplementary data [#] (CC-BY-NC-SA)

Software
AlternativeTo [?#]
WikiVS (comparisons) (link) [?#] TODO: need a method to pick out all comparisons to X

Web
Internet Archive / Wayback Machine (link) [?X]

Licenses

[CC-*] - indicates use is permitted under some free culture Creative Commons license (specify which one)
[FDL] - indicates use is permitted under the terms of the Free Documentation License
[#] - indicates use is permitted, but restricted in some non-free way (including non-free CC, e.g. CC-BY-NC)
[X] - indicates use is not permitted
[?CC] - indicates use is unresearched and probably permitted in a CC-compatible way
[?#] - indicates use is unresearched and probably permitted, but restricted in some non-free way (including non-free CC, e.g. CC-BY-NC)
[?X] - indicates use is unresearched and probably restricted



Backlinks: openhub freshcode fsd database sharing:raw-data sharing:api

CC0 / Public domain dedication To the extent possible under law, d3vid seaward has waived all copyright and related or neighboring rights to "Data sources in Grasmere notebook, including code snippets" (why? how?)