User talk:Zhuyifei1999/Archive 11

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search

{{OTRS received}} is now a license (metadata-wise), so why did your bot tag the above-mentioned file?    FDMS  4    21:32, 13 June 2015 (UTC)

✓ Done Added to the exclusion list --Zhuyifei1999 (talk) 01:12, 14 June 2015 (UTC)

15:04, 15 June 2015 (UTC)

Bots


You are receiving this message because a technical change may affect a bot, gadget, or user script you have been using. The breaking change involves API calls. This change has been planned for two years. The WMF will start making this change on 30 June 2015. A partial list of affected bots can be seen here: https://lists.wikimedia.org/pipermail/wikitech-l/2015-June/081931.html This includes all bots that are using pywikibot compat. Some of these bots have already been fixed. However, if you write user scripts or operate a bot that uses the API, then you should check your code, to make sure that it will not break.

What, exactly, is breaking? The "default continuation mode" for action=query requests to api.php will be changing to be easier for new coders to use correctly. To find out whether your script or bot may be affected, then search the source code (including any frameworks or libraries) for the string "query-continue". If that is not present, then the script or bot is not affected. In a few cases, the code will be present but not used. In that case, the script or bot will continue working.

This change will be part of 1.26wmf12. It will be deployed to test wikis (including mediawiki.org) on 30 June, to non-Wikipedias (such as Wiktionary) on 1 July, and to all Wikipedias on 2 July 2015.

If your bot or script is receiving the warning about this upcoming change (as seen at https://www.mediawiki.org/w/api.php?action=query&list=allpages ), it's time to fix your code!

Either of the above solutions may be tested immediately, you'll know it works because you stop seeing the warning.

Do you need help with your own bot or script? Ask questions in e-mail on the mediawiki-api or wikitech-l mailing lists. Volunteers at m:Tech or w:en:WP:Village pump (technical) or w:en:Wikipedia:Bot owners' noticeboard may also be able to help you.

Are you using someone else's gadgets or user scripts? Most scripts are not affected. To find out if a script you use needs to be updated, then post a note at the discussion page for the gadget or the talk page of the user who originally made the script. Whatamidoing (WMF) (talk) 19:03, 17 June 2015 (UTC)

Did the panoramio bot take a break on June 18. Just wondering. Best Regards, --Leoboudv (talk) 08:18, 19 June 2015 (UTC)

Labs NFS outage from yesterday. I just started all the review bots. --Zhuyifei1999 (talk) 08:21, 19 June 2015 (UTC)

bug while logging in [8]

Invalid Issuer: https://commons.wikimedia.org !== http://commons.wikimedia.orgException encountered, of type "Exception"
[c3252d39] /commonsarchive/w/index.php?title=Special:OAuthLogin/finish&oauth_verifier=67868bdd8498345f35f19dff566c7027&oauth_token=c6542178bcf5c11d8da268b2a5045337 Exception from line 138 of /data/project/commonsarchive/public_html/w/extensions/OAuthAuthentication/libs/mwoauth-php/MWOAuthClient.php: JWT didn't validate
Backtrace:
#0 /data/project/commonsarchive/public_html/w/extensions/OAuthAuthentication/handlers/OAuth1Handler.php(47): MWOAuthClient->identify(OAuthToken)
#1 /data/project/commonsarchive/public_html/w/extensions/OAuthAuthentication/specials/SpecialOAuthLogin.php(66): MediaWiki\Extensions\OAuthAuthentication\OAuth1Handler->identify(OAuthToken, MWOAuthClient)
#2 /data/project/commonsarchive/public_html/w/includes/specialpage/SpecialPage.php(384): MediaWiki\Extensions\OAuthAuthentication\SpecialOAuthLogin->execute(string)
#3 /data/project/commonsarchive/public_html/w/includes/specialpage/SpecialPageFactory.php(582): SpecialPage->run(string)
#4 /data/project/commonsarchive/public_html/w/includes/MediaWiki.php(267): SpecialPageFactory::executePath(Title, RequestContext)
#5 /data/project/commonsarchive/public_html/w/includes/MediaWiki.php(566): MediaWiki->performRequest()
#6 /data/project/commonsarchive/public_html/w/includes/MediaWiki.php(414): MediaWiki->main()
#7 /data/project/commonsarchive/public_html/w/index.php(41): MediaWiki->run()
#8 {main}

Tried http and https version.--GZWDer (talk) 08:50, 19 June 2015 (UTC)

By the way, please change the last statement of the main page to "This is a fork of old commonsarchive.org - which is no longer online." as commonsarchive.org now redirect to tools.wmflabs.org/commonsarchive.--GZWDer (talk) 08:54, 19 June 2015 (UTC)
Fixed the login issue. Feel free to fix the main page yourself, it's not protected. --Zhuyifei1999 (talk) 09:14, 19 June 2015 (UTC)

15:23, 22 June 2015 (UTC)

15:56, 29 June 2015 (UTC)

15:13, 6 July 2015 (UTC)

Flickr image size?

It appears the bot does not pass as good high resolution images but places them into the Category:Flickr images needing human review. Is it not possible to pass all sizes at Flickr, assuming they have all the other correct details, instead of making more work for the human reviewers? There are plenty of bad uplaods that need reviewing without adding obviously good images to the category. Ww2censor (talk) 09:46, 12 July 2015 (UTC)

I looked into two random samples from the category. They both appear to have EXIF orientation, which is known to break the bot --Zhuyifei1999 (talk) 10:43, 12 July 2015 (UTC)
Maybe that is the problem with the images I notice but if I see one that I think should have been passed I'll post here for you to review. Thanks Ww2censor (talk) 11:08, 12 July 2015 (UTC)

15:06, 13 July 2015 (UTC)

03:05, 21 July 2015 (UTC)

Gallica

Hi, I asked for [45] yesterday, and I still didn't get an answer. Could you find a way to advertise when a job is complete? This tool sends a mail when a job is done. Do you have a log of the requests? Regards, Yann (talk) 16:00, 25 July 2015 (UTC)

I just did a manual run on bastion to make the file available, since the run on grid engine sometimes fail for unknown reasons (like in this case, receiving SIGINT from unknown sources). I'll do some more testing to try to find the root cause, and possibly implement some email notifications tomorrow. --Zhuyifei1999 (talk) 17:05, 25 July 2015 (UTC)
Thanks. Again with [46]. Submitted yesterday, still not available. Regards, Yann (talk) 09:07, 26 July 2015 (UTC)
The issue is appearantly OOM-related. Setting job memory to 3 GB instead of 2 GB works in both tries I made. And 3 GB is now set as default. As for the email, do bub use Special:EmailUser or is the email provided by the user? --Zhuyifei1999 (talk) 14:25, 26 July 2015 (UTC)
(I added some bootstrap style) --Steinsplitter (talk) 14:50, 26 July 2015 (UTC)

15:05, 27 July 2015 (UTC)

FlickreviewR 2

Would it be possible for you to add an additional task to FlickreviewR 2's operations? I've found that at least some Flickr images aren't in archive.org, but the site will ask you if you want to save the current version of a live page that's not in its database. For example, go to https://web.archive.org/web/*/https://www.flickr.com/photos/28539833@N03/2894454172. This would be helpful in a {{Flickr-change-of-license}} situation (such as the image I just linked), since you could point someone to a past version of the image, but particularly helpful if the uploader denied changing the license and professed that we'd copied an all-rights-reserved image without permission. Nyttend (talk) 11:56, 30 July 2015 (UTC)

Hmm. If that's allowed (at least I can't find any bot policies on archive.org), I'll code it in the next few weeks when I have more time. The challenge is that I can't find any existing libraries for browsing and saving pages to archive.org. --Zhuyifei1999 (talk) 13:27, 30 July 2015 (UTC)
If this is not possible, then consider either archiving the page or saving a "screen shot" of the page (and digitally signing the resulting file) so that disputes like this and one that arose in the early arguments of this FfD can be quickly resolved (note: The previous FfD is still open, but there is now a general consensus that FlickrevieR 2 did its job accurately - the main remaining dispute is whether the image uploader had the right to license it under CC in the first place). Davidwr (talk) 19:28, 1 August 2015 (UTC)
I think saving to archive.org is possible, but it's complicated. --Zhuyifei1999 (talk) 02:21, 2 August 2015 (UTC)

Panoramio Review Bot

Zhuyifei1999, please adjust the review bot. It worked but suddenly it does recognize too less photos. Before it worked perfect. Commons has too less reviewers. Commons has only two really reviewing users and these having a lot to do. Category:Panoramio images needing human review--Blackwhiteupl (talk) 14:36, 31 July 2015 (UTC)

I'm looking into it. --Zhuyifei1999 (talk) 04:17, 1 August 2015 (UTC)
See File:Kohlberg (Hill), Pirna 121946982.jpg for example. http://static.panoramio.com/photos/original/121946982.jpg (the script also checks large, medium, small, thumbnail, square, mini_square sizes) has 12 MB while your upload is 2 MB. Which url did you download from? --Zhuyifei1999 (talk) 05:29, 1 August 2015 (UTC)
Dear Zhuyifei1999, until now I got these Panoramio pictures within a click on "Download" there in the site in every time. This causes that the picture has lesser MB. I compared the same picture with lesser MB with the same picture which has more MB. The photos are for the eye the same in size, color and so on. For around one month I was downloading masses of pictures there within the "Download" button there. I had uploaded them and your Panoramio - bot was accepting all these pictures. It were been over 300 pictures. And since the next upload session the bot could not recognize the most until now. That means that these pictures had lesser MB (same quality) and uploaded them to Wikimedia Commons. The bot recognized all of these pictures nevertheless and suddenly not. You can say the bot recognizes any picture. If the picture is bigger than 12MB the Panoramio decreases the MB (downloaded with the "download" button) and the bot wants the same MB amount at least I found out. Iam looking in a category with only by me uploaded pictures and all pictures with 2 or 3 MB of pictures which have a size of around 12 MB the bot did not recognize. Beginning with 12 MB the Panoramio site blocks this size for downloads to make it complicated. You are get a version with lesser MB and the bot here has different MB sizes and does not recognize the picture. Thank you. --Blackwhiteupl (talk) 14:00, 1 August 2015 (UTC)
@Blackwhiteupl: Right now (until a few days later) I have internet issues when accessing Panoramio, so it is hard for me to find out where the "download" links point to. The bot autoatically comparies the file uploaded to commons with the files on Panoramio with the following sizes: original, large, medium, small, thumbnail, square, and mini_square. And when it match but in a different size than "original", the bot is programmed to upload the file in "original" size. I am unaware of any other sizes or download urls. I cannot do much right now without your url of the file. Thank you. @Steinsplitter: Maybe you can look into this if you have time. --Zhuyifei1999 (talk) 14:39, 1 August 2015 (UTC)
I looked into it. The files in question don't have the same SHA1. This is the bot behavior we want to prevent abuse. There is nothing wrong with the bot itself. --Steinsplitter (talk) 14:43, 1 August 2015 (UTC)
No, not the original size. What's inside that download link? --Zhuyifei1999 (talk) 14:47, 1 August 2015 (UTC)
Yes. But is is only the matter with the MB size sorry. The source was the same. To download the picture you have this url. This url for example http://www.panoramio.com/photos/d/121951056.jpg (this link is there if you want download the geese picture for info) has the /d/ inside the normal source of the picture. regards--Blackwhiteupl (talk) 14:52, 1 August 2015 (UTC)
Looks like I should better curl and grep step by step on tool labs to find out where in the world you downloaded that file from (file url) 😭 --Zhuyifei1999 (talk) 15:00, 1 August 2015 (UTC)
Sorry Zhuyifei1999 THe peoples meaning mostly with url the site address of something but could mean as well this of the Kohlberg Hill file

<img src="http://static.panoramio.com/photos/large/121946982.jpg" alt="Pirna, Deutschland" id="main-photo_photo" style="max-height: 571px;">

--Blackwhiteupl (talk) 15:21, 1 August 2015 (UTC)

For your Kohlberg Hill File:Kohlberg (Hill), Pirna 121946982.jpg example the download link is written so <a href="/photos/d/121946982.jpg">Download photo</a>

--Blackwhiteupl (talk) 15:24, 1 August 2015 (UTC)

Here is the code for the static download manual <img style="-webkit-user-select: none" src="http://static.panoramio.com/photos/original/121946982.jpg">

--Blackwhiteupl (talk) 15:27, 1 August 2015 (UTC)

"large" and "original" are previously recognized, "d" now [54] fixed ;) Now I'm gonna mass revert previous broken reviews with VFC ;) --Zhuyifei1999 (talk) 16:22, 1 August 2015 (UTC)

Ok. Do not know what VFC does mean. Gonna search thus term on Wiki. Thank you. --Blackwhiteupl (talk) 18:36, 1 August 2015 (UTC)

COM:VFC :P --Zhuyifei1999 (talk) 18:40, 1 August 2015 (UTC)
Ok. Thank you that you are a dynamic and motivated user here. I know how it is if somebody does not react in important situations. Thank you. --Blackwhiteupl (talk) 19:26, 1 August 2015 (UTC)

Status report

Dear Zhuyifei1999, it worked with the repeating review bot with around 400 pictures or more, but with 37 the bot has the problem with "size not found" again. Category:Panoramio images needing human review Thank you --Blackwhiteupl (talk) 22:38, 1 August 2015 (UTC)

Dear Zhuyifei1999, I am seeing that Panoramio has changed the parameters down to 10 MB All over 10 MB is downloaded with smaller MB size and the bot can probably not recognize. They do not want masks for different photo sizes such as on Wikimedia Commons or Flickr. Thank you. --Blackwhiteupl (talk) 23:28, 1 August 2015 (UTC)
If the uploader downloaded the file from http://www.panoramio.com/photos/d/****.jpg, the review should work, as the bot is now coded to check that source as well. As for the 37 remaining images, I'll look into them later. Hopefully there aren't anything more complicated --Zhuyifei1999 (talk) 02:15, 2 August 2015 (UTC)

15:51, 3 August 2015 (UTC)