Difference between revisions of "Technology"

From Wikidocumentaries
Jump to navigation Jump to search
(Reading content through APIs)
(Reading content through APIs)
 
(7 intermediate revisions by 2 users not shown)
Line 2: Line 2:
  
 
==General==
 
==General==
Wikidocumentaries is a project, which aggregates content from Wikimedia projects, openly licensed GLAM archives through queries and from the visitors. The project allows less notable topics, such as biographies or local history.
+
Wikidocumentaries is a project which aggregates content from Wikimedia projects, openly licensed GLAM archives through queries and from the visitors. The project allows less notable topics, such as biographies of ordinary people, or local history events.
 
 
The first selection of topics will cover the geographical area of Finland, people related to the the country, events in Finland etc. The topics are retrieved from Wikidata and stored in Wikidocumentaries, which is also a Wikibase. The selection of topics may also be created organically on the go.
 
  
 
==Content modules==
 
==Content modules==
Each content page consists of [[content modules]] that are added to the page depending on the page type, topic type and available content. The list presents ideas for the modules, not everything is created immediately. Each module is described in more detail on their own page.
+
Each content page consists of [[content modules]] that are added to the page depending on the page type, topic type and available content.
 
 
Modules can have different formats, based on the same content. They can be either
 
* '''[[Page module]]s''', when they are part of a topic page or the landing page
 
* '''[[Linkbox]]es''', when they are added as related info or teasers. There may be need for different formats.
 
* '''[[Module page]]s''', when the module is expanded to use a full page
 
  
 
See full list of [[Content modules]]
 
See full list of [[Content modules]]
Line 18: Line 11:
 
==Reading content through APIs==
 
==Reading content through APIs==
 
Content is primarily not stored in Wikidocumentaries. It is read from organisations and platforms that offer open and openly licensed content for use through APIs. The structure of the API calls will be stored in Wikidocumentaries and the information stored about the topics will be used to construct the queries.
 
Content is primarily not stored in Wikidocumentaries. It is read from organisations and platforms that offer open and openly licensed content for use through APIs. The structure of the API calls will be stored in Wikidocumentaries and the information stored about the topics will be used to construct the queries.
* Read [[Repositories and APIs]]
+
* [[APIs]]
  
 
==Tools==
 
==Tools==
 
Each topic can be complemented with more info, the relating article can be made better, images can be tagged with names, keywords or location etc. The site will host tools for working with the materials displayed.
 
Each topic can be complemented with more info, the relating article can be made better, images can be tagged with names, keywords or location etc. The site will host tools for working with the materials displayed.
* See the [[Tools]] page
+
* See [[Tool page]]
  
 
==Using Wikibase==
 
==Using Wikibase==
The site runs on a Wikibase, which stores a subset of Wikidata items. Wikidocumentaries will read Wikidata for new and changed info, and Wikidata will import data from Wikidocumentaries when it meets certain criteria.
+
The platform is built on a MediaWiki with a Wikibase extension. [[Using Wikibase]] will collect issues regarding topics related specifically to Wikibase. It will also handle issues about the MediaWiki install, extensions etc.
 
 
Other data to store in the Wikibase are definitions of APIs in various repositories where Wikidocumentaries expects to find content.
 
The technology of Wikidocumentaries is based on an experimental setup of using Wikidata data to create the backbone of the site information.
 
 
 
===Initial data import===
 
* All properties from Wikidata
 
* For values we would save the references
 
* Kimmo: The Wikidox properties should be named differently from Wikidata properties. Possibly a different range. Susanna: Discussed in Antwerpen meeting - to be handled with a reference.
 
 
 
===Data modelling===
 
* Items and properties
 
* Topics, APIs
 
 
 
Questions to solve about data modelling for Wikidocumentaries
 
* What is created locally for a topic that has a corresponding item in Wikidata?
 
* Is there a way we can use Wikidata properties for items ''LIVE'', without needing to define them locally?
 
 
 
===Creating topics in Wikibase===
 
Page = item in Wikidata and/or Wikidocumentaries. Each topic in Wikidocumentaries has a page.
 
* The initial set of topics in Wikidocumentaries are created by selecting a set of Wikidata items and creating them in Wikidocumentaries.
 
* When the user navigates to a page that does not exist in Wikidocumentaries, but for which there is an item in Wikidata (through a link in Wikipedia text for example), the page is automatically created.
 
* The user may create additional topics in Wikidocumentaries with a set of minimum required properties.
 
 
 
See more about [[Creating topics]]
 
 
 
===Using ShapeExpressions===
 
* The scope of automatically created item may at some point be defined as a Shape Expression, which will probably be stored in the Federated Wikibases registry. This definition can help add whole thematic areas at once in a coordinated manner.
 
* The newly created items in Wikidocumentaries can be automatically imported to Wikidata, when they meet a certain criteria. This can also be expressed as a ShEx.
 
 
 
====Questions====
 
* What can be a realistic schedule for deploying Shape Expressions?
 
  
 
==User interface==
 
==User interface==

Latest revision as of 05:19, 15 August 2019

A gradually growing definition of the site's technological design challenges and decisions.

General

Wikidocumentaries is a project which aggregates content from Wikimedia projects, openly licensed GLAM archives through queries and from the visitors. The project allows less notable topics, such as biographies of ordinary people, or local history events.

Content modules

Each content page consists of content modules that are added to the page depending on the page type, topic type and available content.

See full list of Content modules

Reading content through APIs

Content is primarily not stored in Wikidocumentaries. It is read from organisations and platforms that offer open and openly licensed content for use through APIs. The structure of the API calls will be stored in Wikidocumentaries and the information stored about the topics will be used to construct the queries.

Tools

Each topic can be complemented with more info, the relating article can be made better, images can be tagged with names, keywords or location etc. The site will host tools for working with the materials displayed.

Using Wikibase

The platform is built on a MediaWiki with a Wikibase extension. Using Wikibase will collect issues regarding topics related specifically to Wikibase. It will also handle issues about the MediaWiki install, extensions etc.

User interface

Wikidocumentaries starts by creating the necessary functionalities in the MediaWiki interface. The goal is, however, to create an independent interface that reads the underlying Wikibase and MediaWiki information through an API.

Questions

  • What is the best way to include linked images from the web?


Navigation

About Technology Design Content modules Tool pages Projects
Status

Wikidocumentaries blog

Wikidocumentaries demo

Phabricator project

Facebook group

GitHub repository

Translation in TranslateWiki

Wikidocumentaries Slack

Setting up dev environment

Resources

Translations

Languages

Using Wikibase

Federation with Wikidata

APIs

Linking

Media metadata

Properties to content

User registration

Licensing

Page types

Landing page

Search page

Topic page

User page

Organisation page

Project page

Tool page

Tasks

Components

Main toolbar and footer

Search

Faceting

Topic page header

Content module

Dropdown

Modal

Icons

Active modules

Article

Family tree

Gallery

Historical map

Images

Image viewer

Infobox

Map

Module ideas

Audio/Video

Bibliography

Correspondence

Discussion

Graph

Name

Newspaper articles

Testimonials

Timeline

Visualizations

Wikidocumentary

3D

Visual editor

Query tool

QuickStatements

Open Refine

Creating topics

Uploading images

Geolocating tool

Metadata editor

Rectifying maps

Transcription

Annotation tool

Central Park Archives

Convent Quarter

Wikisource