Commons:Bots/Requests/RijksmuseumUploaderBot

RijksmuseumUploaderBot (talk · contribs)

Operator: Acagastya (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions)

Bot's tasks for which permission is being sought: Following the anouncemet of the Rijksmuseum to release several media files under the CC-Zero license, this bot's sole purpose is to transfer free media from Rijksmuseum's site to Commons.

Automatic or manually assisted: Automatic.

Edit type (e.g. Continuous, daily, one time run): Daily.

Maximum edit rate (e.g. edits per minute): ~5-6 uploads per minute (when tested on local IP; might be slightly better on a VPS).

Bot flag requested: (Y/N): Y

Programming language(s): JavaScript

Acagastya (talk) 08:11, 24 January 2021 (UTC)

Discussion

• Please make a test run. --Krd 09:21, 24 January 2021 (UTC)

Sure, @Krd: ; however I got a warning (必需輸入驗證碼, "verification code required") -- I am guessing because the account is new and is not confirmed yet. Would I have to wait for a couple of days for that?
Acagastya (talk) 16:13, 24 January 2021 (UTC) (confirmed rights granted by MGA73.)
Acagastya (talk) 17:32, 24 January 2021 (UTC)

Running on 30 files (which may have some non-free files + some dublicates -- neither non-free files nor dublicates should be uploaded).
Acagastya (talk) 17:32, 24 January 2021 (UTC)

Just performed the test run; and cross-verified the uploads, they all were indeed in public domain, and no dublicates were uploaded.
Acagastya (talk) 17:40, 24 January 2021 (UTC)

•  Comment They do have many nice photos so they are worth uploading. Perhaps @Multichill: can have a look and comment? --MGA73 (talk) 17:55, 24 January 2021 (UTC)
• I'm slightly confused. The Rijksmuseum released all their content under CC0 many years ago, I actually went to the launch party. That was not that long before the real opening so must have been in 2013. You can find some of the images in Category:Images from the Rijksmuseum and looks like a lot ended up in Category:Uncategorized images of the Rijksmuseum. Dumping the files here on Commons is easy. Uploading them here with the right metadata on the other hand, is a bit harder. I'm hoping you're going for that. Are you actually using their API? It provides quite rich metadata. You should grab both Dutch and English and put it in {{Artwork}} and also assign proper categories. Also use Institution:Rijksmuseum Amsterdam. Also {{Cc-zero}} doesn't take any parameters and {{LicenseReview}} is not needed here. Can you share your code? Multichill (talk) 21:40, 24 January 2021 (UTC)

@Multichill: Yes, indeed, I am using the APIs provided by Rijksmuseum. From their dataset, I tried the script with 50 collections (as the museum lists them), and of them 18 were not uploaded on Commons, which means, there are going to be many Rijksmuseum files which are not on Commons. I can add the description, as you have mentioned. I would have to tweak the script a little bit, to handle {{Artwork}} differently from the ceramics. Is Institution:Rijksmuseum Amsterdam for the author? Will do that too. Re {{Cc-zero}} not taking parameters -- I was hoping that would come up in discussion: should we create a {{Rijksmuseum PD}} (like {{ESO}} or {{YouTube}})? MGA73 had suggested not to use {{LicenseReview}}, but just wanted to confirm during the discussion. I will push the source code to my git server and share the code soon. I will be also looking for more metadata that I can possibly include (but since the API provides so much more, I don't know where to stop. At one point, it feels like this should be done on Wikidata, and/or, a separate bot should be handling addition of all the metadata the API provides such as the dimensions of the artefacts.)
Acagastya (talk) 04:55, 25 January 2021 (UTC)

To add, the details API has a too much information, so we need to decide what all are we adding, and/or if a bot should add relevant data to wikidata, and that BotMultichillT can then add.
Acagastya (talk) 07:53, 25 January 2021 (UTC)

@Multichill: the source code is here. Please note, 'refactored' is the branch name which has new changes which handles wise category addition.
Acagastya (talk) 19:28, 25 January 2021 (UTC)

 Question @Multichill: Is {{Art Photo}} not better than {{Artwork}} for stuff that is not paintings? --MGA73 (talk) 13:34, 30 January 2021 (UTC)

Art photo is basically {{Artwork}} with some extra info about the photo. Don't think that is relevant in this context.

When uploading you should aim at adding all the relevant metadata at upload and not having to clean up a lot later. What to add? Just whatever can be mapped to the fields in {{Artwork}} without too much hassle. Multichill (talk) 15:30, 30 January 2021 (UTC)

Thanks for specifying, @Multichill: , it can be done on a Sunday (but not coming Sunday). I will do it and let you know.
Acagastya (talk) 17:11, 30 January 2021 (UTC)

@Acagastya: Is there any update? --Krd 07:34, 16 March 2021 (UTC)

@Krd: I have made some adjustments, but hadn't gotten some time to show it to, say mga73 due to off-wiki commitments. I shall add a few things soon and run another demo.
Acagastya (talk) 07:43, 16 March 2021 (UTC)

Please report when finished with test run. --Krd 10:27, 17 April 2021 (UTC)

Closing as stale. --Krd 09:09, 16 June 2021 (UTC)