File:Enrichment-datastore.png
From Wikimedia Commons, the free media repository
Jump to navigation
Jump to search
Size of this preview: 763 × 600 pixels. Other resolutions: 305 × 240 pixels | 611 × 480 pixels | 977 × 768 pixels | 1,150 × 904 pixels.
Original file (1,150 × 904 pixels, file size: 68 KB, MIME type: image/png)
File information
Structured data
Captions
Summary[edit]
DescriptionEnrichment-datastore.png |
English: Ideas of how an enrichment datastore might work in the context of Cirrus |
Date | |
Source | Own work |
Author | Guillaume Lederrey |
Source for this diagram:
@startuml participant Hadoop participant "PageRank\nDatastore" as prds database "PageRank DB" as prdb database "PageRank DB\nn-1" as prdb1 database "JobQueue" as jq participant MediaWiki actor User database Elasticsearch == New page rank ready == Hadoop -> prds: send new page rank data create prdb prds -> prdb: create new database prds -> prdb: import new page rank data ||| prds -> prdb: get data activate prds prds -> prdb1: get data note left : implementation could\nalso work on raw files prds -> prds: compute diff between\ncurrent and previous\npage rank prds -> prdb1: destroy previous page rank DB destroy prdb1 prds -> jq: create update jobs for changed page ranks deactivate prds == Page updated == User -> MediaWiki: update page MediaWiki -> jq: create update job fo modified page == Process updates == jq -> MediaWiki: start processing page update activate MediaWiki MediaWiki -> MediaWiki: get page data MediaWiki -> prds: get page rank data prds -> prdb: get page rank data MediaWiki -> Elasticsearch: update Elasticsearch deactivate MediaWiki @enduml
Licensing[edit]
I, the copyright holder of this work, hereby publish it under the following license:
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.
File history
Click on a date/time to view the file as it appeared at that time.
Date/Time | Thumbnail | Dimensions | User | Comment | |
---|---|---|---|---|---|
current | 11:20, 19 May 2016 | 1,150 × 904 (68 KB) | GLederrey (WMF) (talk | contribs) | User created page with UploadWizard |
You cannot overwrite this file.
File usage on Commons
There are no pages that use this file.