Commons:Bots/Requests/DigitaltMuseumBot

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search

DigitaltMuseumBot (talk · contribs)

Operator: DigitaltMuseum (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information)

Bot's tasks for which permission is being sought: Batch upload of photos from digitaltmuseum.org. Photos are manually selected by the publisher.

Automatic or manually assisted: manually assisted

Edit type (e.g. Continuous, daily, one time run): one time run

Maximum edit rate (e.g. edits per minute): maximum 10/min

Bot flag requested: (Y/N): Y

Programming language(s): Python (pywikibot)

DigitaltMuseum (talk) 09:24, 17 September 2021 (UTC)[reply]

Discussion

What about User:BotKulturIT? --Achim (talk) 11:18, 17 September 2021 (UTC)[reply]

@Achim55: We're new with Wikimedia and messed up by creating 2 bot users. Then later found out we couldn't delete. User:BotKulturIT won't be used. --DigitaltMuseum (talk) 10:35, 23 September 2021 (UTC)[reply]
Ok, I redirected it. Thanks for contributing here! --Achim (talk) 13:21, 23 September 2021 (UTC)[reply]
How many files are intended to be uploaded? Please make a few test uploads. --Krd 16:16, 23 September 2021 (UTC)[reply]
@Achim55:  ? --Krd 09:15, 8 October 2021 (UTC)[reply]
I have no idea. I've had looked up their website and found some valuable content there. I sent a wikimail to them. --Achim (talk) 20:49, 8 October 2021 (UTC)[reply]
@Achim55: @Krd: We don't have an accurate number of files. I'll try to explain what we're trying to achieve: Digitaltmuseum currently has 6.8 million objects, many with images and some with multiple images. The objects are owned by an institution, usually a museum. Our plan is to develop a service which enables these owners to
  1. collect images they want to upload to Wikimedia
  2. generate mapping files based on the collected images and data from DigitaltMuseum. They must upload these to the institution's page on Wikimedia
  3. upload the collection in the institutions's name, using DigitaltMuseumBot
The workflow and mapping is based on this project from Nordiska museet: https://github.com/NordicMuseum/Wikimedia-Commons-uploads
--DigitaltMuseum (talk) 10:44, 12 October 2021 (UTC)[reply]
DigitaltMuseum, that's fine. For to see that the bot is running correctly we need a few test uploads by the bot. Another thing: If you are editing personally please use your 'DigitaltMuseum' account and leave the 'DigitaltMuseumBot' account for the bot's edits only, thank you. --Achim (talk) 11:50, 12 October 2021 (UTC)[reply]
@Achim55: Thanks for the tip! We would like to do test uploads to the beta cluster. In the "Do a test upload" section of Guide to batch uploading there's a dead link to an explanation. Do you know if it's available somewhere? --DigitaltMuseum (talk) 13:41, 12 October 2021 (UTC)[reply]
@Achim55: @Krd: Created user & botuser on beta and copied the bot userpage from DigitaltMuseumBot. The abuse filter didn't like the content and both user & IP is now blocked ("New user adding external links in userspace") :/ Any tip on how to unblock? --DigitaltMuseum (talk) 07:02, 13 October 2021 (UTC)[reply]
. Please provide links to the blocked users. --Krd 13:44, 19 October 2021 (UTC)[reply]
@Krd: https://commons.wikimedia.beta.wmflabs.org/wiki/User:DigitaltMuseum & https://commons.wikimedia.beta.wmflabs.org/wiki/User:DigitaltMuseumBot --DigitaltMuseum (talk) 10:29, 26 October 2021 (UTC)[reply]
Now unblocked. --Krd 12:10, 26 October 2021 (UTC)[reply]
@DigitaltMuseum: Is this ready for a test run? --Krd 14:18, 9 November 2021 (UTC)[reply]
@DigitaltMuseum:  ? --Krd 09:12, 23 November 2021 (UTC)[reply]

Stale. --Krd 08:59, 3 December 2021 (UTC)[reply]

Please make test uploads at Commons. --Krd 15:58, 8 December 2021 (UTC)[reply]
Hi @Krd: Tried an upload now but get this message:
WARNING: API error permissiondenied: The action you have requested is limited to users in one of the groups: *, [ [Commons:Users|Users]].
The logged-in user in pywikibot:
Name:
DigitaltMuseumBot
Id:
10624743
Groups:
['*', 'user', 'autoconfirmed']
Rights:
['read', 'writeapi', 'abusefilter-view', 'abusefilter-log', 'upload', 'upload_by_url', 'reupload-own', 'purge', 'reupload', 'autoconfirmed', 'editsemiprotected', 'skipcaptcha', 'abusefilter-log-detail', 'transcode-reset']
Don't know if this is related to pywikibot or if there's something wrong with the bot user. Any suggestions? DigitaltMuseum (talk) 09:53, 10 December 2021 (UTC)[reply]
Stuck with permissiondenied, any ideas @Achim55, @Krd? DigitaltMuseum (talk) 08:50, 15 December 2021 (UTC)[reply]
What is the action you tried to do? Do you use normal login or Special:BotPasswords? Krd 08:57, 15 December 2021 (UTC)[reply]
WARNING: API error permissiondenied is logged on every upload attempt. The bot user seems to be logged in ok, with the groups & rigths mentioned above, when we set a breakpoint in pywikibot. Don't know if you are familiar with bywikibot, here's the files related to login in case you see something useful:
user-config.py:
mylang = 'commons'
family = 'commons'
usernames['commons']['commons'] = 'DigitaltMuseumBot'
password_file = 'user-password.py'
user-password.py:
(u'DigitaltMuseumBot', BotPassword(u'DigitaltMuseumBot', u'PASSWORD'))
Appreciate your help @Krd DigitaltMuseum (talk) 10:36, 15 December 2021 (UTC)[reply]
Also, uploading works against beta and if we run pywikibot with -test argument DigitaltMuseum (talk) 10:39, 15 December 2021 (UTC)[reply]
Sadly I have no idea. I have now set the bot flag, please check if that helps. Krd 10:10, 16 December 2021 (UTC)[reply]
@Krd Finally got it to work! Might've been a cache problem. Updated the Bot password grants, then got a much longer list of rights on the next run. Please see https://commons.wikimedia.org/wiki/Special:ListFiles?limit=50&user=DigitaltMuseumBot&ilshowall=1 DigitaltMuseum (talk) 11:43, 17 December 2021 (UTC)[reply]
There are a lot of red links in the uploaded files. What is your intention about that? Krd 16:07, 17 December 2021 (UTC)[reply]
@Krd there were some missing templates. We've added those and made municipality mapping work. Links to the institutions's page on Wikimedia (which should exist prior to any real uploads through this bot) should be the only dead ones now. DigitaltMuseum (talk) 12:08, 22 December 2021 (UTC)[reply]
I still see e.g. Institution:Østfold fylkes billedarkiv as red link, and also Categories used during upload. Can this be fixed before mass uploads get started? --Krd 14:45, 22 December 2021 (UTC)[reply]
@Krd These are links to the Institution's page on Wikimedia, and as stated in the previous comment, they should exist prior to any upload. We can look into a simple ping to see if they exist before the job starts, but this is the institution's responsibility really. DigitaltMuseum (talk) 06:21, 23 December 2021 (UTC)[reply]

I'm still asking myself why these files are CC-by-sa with attribution to the archive. Is this correct? Or is this a question out of scope of this bot request? --Krd 19:09, 27 December 2021 (UTC)[reply]

@DigitaltMuseum: Can you please elaborate a bit on the copyright aspect? --Krd 04:27, 5 February 2022 (UTC)[reply]
@DigitaltMuseum:  ? --Krd 05:48, 19 March 2022 (UTC)[reply]

Stale. --Krd 16:25, 10 April 2022 (UTC)[reply]

Retrieved from "https://commons.wikimedia.org/w/index.php?title=Commons:Bots/Requests/DigitaltMuseumBot&oldid=647989987"