User:Ilya/Jury tools evaluation matrix

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search
Evaluation matrix
Parameter WLX Jury Tool wlmpa Germany jury tool JuryTool (by Yarl) Wiki-Loves-Jurytool Israel jury tool
Source code GitHub GitLab ? GitHub GitHub not published yet
Implemented in Scala[1] PHP PHP JavaScript PHP ?
Main frameworks/libraries Play 2.4, ScalikeJdbc[2] Symphony 2.2[3]
(Outdated[4], major effort to update[5])
Doctrine 2.2
MediaWiki backend ScalaWiki Copy of botclasses.php (gh, gh2),
Last commit Aug 6, 2016 11 Sep, 2014 (README change)
18 Oct, 2013 (code change)
July 2016 [6] Oct 9, 2015 Aug 5, 2016 ?
First (public) commit/deployment Oct 13, 2013[7] 12 Aug, 2013[8] October 2013 [9] Sep 28, 2014 2011 (code released in 2015) ?
Number of commits 302 133 ? 23 42 ?
Number of contributors 1 (Ilya) 1 (David Narvaez) 1? (Wiegels) 1 (Yarl) 5 1? (Ynhockey)
Usage/Features Documentation Commons:WLX Jury Tool ? In German Readme Readme ?
Installation Scripts/Documentation Scripts
for Debian/Ubuntu
and Centos.
Documentation for ToolLabs deployment
Readme ? Readme ReadMe ?
Used by 2013: Ukraine
2014: ~5 countries
2015[10][11]-2016 ~20
Asked by 37 in 2013[12]
12 in 2014[13][14]
Germany 2014: Poland Austria, Germany (…) Israel +
Automated tests CI, 23% coverage no
Admin features
Admin UI yes yes yes no yes ?
Import images From admin selected category[15][16]
via MediaWiki API
Works with 40,000+ images per contest
Hangs with 10,000 images per contest has to be prepared in json
User profile features
Root admin
can configure and view any contest
yes no, each contest is a separate webserver folder and db no, each contest is a separate webserver folder and db
Contest admin
can configure and view own contest
yes
Contest organizer
can view own contest but cannot configure it
yes no such role no such role
Adding users In admin UI [17]
Mass import of users yes[18]
Juror can be added to several contests no[19] yes, as each contest is a separate webserver folder and db yes, as each contest is a separate webserver folder and db
Admin can edit users Name, email, role, language and password [20]
Regular user can edit own profile yes
Rating round features
Admin can create rounds yes yes [21]
Images for round can be filtered by
Commons category
yes [22] yes
Images for round can be set
from file list
no yes
Images for the round can be filtered
by number of jurors
that selected an image in the previous round
yes [23] manually via exporting/importing file list
Images for the round can be filtered by
average rate on the previous round
yes no
Images for the round can be filtered by
megapixels
yes no
Images in the round can be distributed
one juror per image
yes yes
Images in the round can be distributed
to all jurors, and hidden after
several (configured number) rates an image
no yes
Images in the round can be distributed
image to all jurors
yes no
Images in the round can be distributed
to several (configurable number) jurors
yes no
Feature X


References

[edit]
  1. Not first tier language by popularity
  2. build.sbt
  3. composer.json
  4. Symfony Versions
  5. From Symfony 2.3 to Symfony 2.7: the complete guide
  6. Version 2.1.4 in July 2016
  7. [1]
  8. [2]
  9. Version 1.0 October 2013
  10. Commons:Wiki Loves Earth 2015/Jury Tool
  11. Commons:Wiki Loves Monuments 2015/Jury Tool
  12. Commons:Wiki_Loves_Monuments_2013/Tools
  13. Commons:Wiki_Loves_Monuments_2014/Tools
  14. http://wlmjurytool2014.wmflabs.org/
  15. File:WLX Jury Tool Admin Contest Images 01.png
  16. File:WLX Jury Tool Admin Contest Images dropdown.png
  17. File:WLX Jury Tool Admin creating new user.png
  18. File:WLX Jury Tool Admin mass importing users.png
  19. Jury can be added to multiple contest
  20. File:WLX Jury Editing user profile.png
  21. Version 2.1.3 on June 2016: Dialog to create and edit rounds
  22. File:WLXJuryCategoryFilter.png
  23. File:WLXJuryCreateSecondRound.png