File:Crowd annotator evaluation for 2016 claims in the WAFER test set for which SIDE produces a citation with higher evidence score than the existing Wikipedia citation.webp
Jump to navigation
Jump to search
Size of this PNG preview of this WEBP file: 800 × 286 pixels. Other resolutions: 320 × 114 pixels | 640 × 229 pixels | 1,511 × 540 pixels.
Original file (1,511 × 540 pixels, file size: 256 KB, MIME type: image/webp)
Captions
Captions
Crowd annotators' preference judgements; From the study "Improving Wikipedia verifiability with AI"
Summary
[edit]
| Description |
English: "We collect five annotations per claim and report majority vote results, bucketed according to the verification engine score associated with the existing Wikipedia citation (bucket size reported on top). a, Crowd annotators' preference for citations suggested by SIDE versus those on Wikipedia for a given claim, without knowing their identity. Fleiss’s κ inter-annotator agreement = 0.2. b, Evidence annotations for Wikipedia citations: (1) enough to verity the claim; (2) the claim is only partially verified; (3) no evidence. Fleiss’s κ inter-annotator agreement = 0.11." |
| Date | |
| Source | https://www.nature.com/articles/s42256-023-00726-1 |
| Author | Authors of the study: Fabio Petroni, Samuel Broscheit, Aleksandra Piktus, Patrick Lewis, Gautier Izacard, Lucas Hosseini, Jane Dwivedi-Yu, Maria Lomeli, Timo Schick, Michele Bevilacqua, Pierre-Emmanuel Mazaré, Armand Joulin, Edouard Grave & Sebastian Riedel |
Licensing
[edit]
This file is licensed under the Creative Commons Attribution 4.0 International license.
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
File history
Click on a date/time to view the file as it appeared at that time.
| Date/Time | Thumbnail | Dimensions | User | Comment | |
|---|---|---|---|---|---|
| current | 10:13, 28 December 2023 | | 1,511 × 540 (256 KB) | Prototyperspective (talk | contribs) | Uploaded a work by Authors of the study: Fabio Petroni, Samuel Broscheit, Aleksandra Piktus, Patrick Lewis, Gautier Izacard, Lucas Hosseini, Jane Dwivedi-Yu, Maria Lomeli, Timo Schick, Michele Bevilacqua, Pierre-Emmanuel Mazaré, Armand Joulin, Edouard Grave & Sebastian Riedel from https://www.nature.com/articles/s42256-023-00726-1 with UploadWizard |
You cannot overwrite this file.
File usage on Commons
There are no pages that use this file.
