Commons:Bots/Work requests/Archive 8

Exif based categorisation

I am hoping that a bot can categorise media files based on exif values. For example a template could be placed on a bot's talk page ({{Categorize by metadata|camera=Kodak EasyShare C140|category=Taken with Kodak EasyShare C140}}, see File:Lewis street underpass in Pasco, Washington 1.jpg and User talk:CommonsDelinker/commands). If the task is approved the template would be moved to the bot's command page and search for the text "Kodak EasyShare C140" in the table row with the class "exif-model" and add the category Category:Taken with Kodak EasyShare C140 as needed. – Allen4names (IPv6 contributions) 21:24, 9 December 2012 (UTC)

I could consider integrating this into User:DrTrigonBot, which means the bot would do this for the uncategorized files it crawls anyways. Could possibly be extended later as you wish. Any other oppinions here (pros and cons)? Greetings --DrTrigon (talk) 15:31, 31 December 2012 (UTC)

I think it is a good idea. Bugzilla:21795 hasn't gone anywhere.

I would use subcategories of Category:Photographs by camera directly.

Exif values can be found in the database. It should be possible to build a toolserver query searching for files with valid values, but not yet in a subcategory of Category:Photographs by camera. --  Docu  at 15:57, 31 December 2012 (UTC)

Processing Category:PD-Art (PD-old default)

As part of Commons:WikiProject Public Domain/PD-Art review it's necessary to process the 125k files in Category:PD-Art (PD-old default). A bot can help a lot here; I hope someone can take this on, even though it may not be so easy to do. Here's what I suggest, based on some experience cleaning out the category, and using the opportunity to make various improvements to the files (not just fixing the PD-Art issue). All files will need to be reviewed manually afterwards, so we may as well make as many improvements as we can.

For each file in the category:

1. Convert any {{Information}} template to {{Artwork}}, moving across data from {{Information}} fields to the equivalent in {{Artwork}}. If there is no Information template or similar at all, just add a blank {{Artwork}} (this will save time later when the file is manually reviewed).
2. If there is no Creator template, look in each category the file is in to see if there is one there, and if there is, put it in the file in the artist field of Artwork.
3. If there is a Creator template (including any added in step two)
   • pull the deathyear from the template, and add this into the PD-Art template in the file, as in {{PD-Art|PD-old-auto|deathyear=XXXX}}
   • if the Creator template has no deathyear, try for a birthyear, and apply {{PD-Art|PD-old-100}} if birthyear is 1800 or earlier.
4. Categorise the file for manual review (using different categories depending on what was done), plus tag the file with an explanatory template (to be removed after review).

That's the basic improvements needed. To this we can add auto-adding Institution templates (same as for auto-adding Creator templates in step 2), and more ambitiously, trying to automatically pick out parts of the file description which can be either moved to specific fields in the Artwork template, or replaced with appropriate templates. Example: "XX x YY cm" could be converted to the Size template and copied to the dimension field. Example: "oil on canvas" can be copied to the medium field, and converted to {{Oil on canvas}}. Now on the one hand I don't want to put people off the basic task; and on the other hand, since every file will need manual review, it would be a shame to waste the opportunity to make these additional improvements. Rd232 (talk) 00:24, 11 January 2013 (UTC)

I do not think step 2 is safe, since many painters painted portraits of their friends, often both subject and author had creator template. We should not add the first one we find, but verify somehow that current name in the author field (or description) matches the creator template. I can volunteer to do step #3: since I already have code for that. --Jarekt (talk) 04:46, 11 January 2013 (UTC)

Any attempt at verification or replacement of text in step 2 would obviously be best - often the Creator name is there in plain text (with or without birth/death years in brackets); using Category:Author matching Creator template, Creator template not used is an easy win here (as long as the template matches one of the file's categories). But as long as the auto-added Creator template has an appropriate "this-is-an-automated-guess-based-on" annotation, I think it's OK, as the entire process is supposed to be reviewed manually afterwards. But anyway, I'm happy for you to go ahead with this task in any way you feel comfortable. Thanks. Rd232 (talk) 10:50, 15 January 2013 (UTC)

Panoramio review

We have almost 700 files in Category:Panoramio review needed at the moment. I thought we have a bot to review the files from Panoramio now but I can't remember which bot and I could not find a notice about it. So perhaps I just remember wrong.

Anyway if someone can remember more or can create a bot to do it it would be nice. --MGA73 (talk) 18:54, 16 January 2013 (UTC)

Search links in file descriptions

Some geograph images include external search links, e.g. Special:Search/"www.geograph.org.uk search" (currently 1372). Many of these could easily be replaced by Commons categories or simply removed. Maybe there is a way to do this by bot. --  Docu  at 08:55, 19 January 2013 (UTC)

I looked at some of those images (like File:Morning at Outfitting Wharf, Belfast - geograph.org.uk - 978843.jpg), and I think that description is better off with the links than without. However if we keep them we should put them in [] brackets. --Jarekt (talk) 13:19, 25 January 2013 (UTC)

I think in that sample we can replace most search links with internal links.

The categories already cover all the ones for ships. --  Docu  at 03:59, 28 January 2013 (UTC)

At File:Morning at Outfitting Wharf, Belfast - geograph.org.uk - 978843.jpg,

I replaced all search links with the relevant categories. --  Docu  at 03:06, 29 January 2013 (UTC)

I agree that the search links in geograph set could be replaced by commons categories, but I do not know how to do it automatically. I could make them more visible by adding []. Should I? --Jarekt (talk) 16:12, 5 March 2013 (UTC)

I added [] brackets to all the files I found. --Jarekt (talk) 12:22, 12 March 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 14:26, 22 March 2013 (UTC)

Norden.org images

Norden.org has a huge number of photos available under a CC licence, which can be found here. A category is at Category:Files from norden.org. Would be great if someone with a bot could manage this uploading for us. I will advise a Swedish editor at sv:Användardiskussion:Allexim#Politician_photographs that I have this request in, and I am sure they can help to categorise images, and I will try to pitch in as well. russavia (talk) 21:45, 19 February 2013 (UTC)

I've also notified Icelandic Wikipedia at is:Wikipedia:Potturinn#Problematic_images_to_be_deleted due to a large number of problematic images currently hosted there that these images could replace. russavia (talk) 01:49, 20 February 2013 (UTC)

 Done (or rather, in progress) You can find the images at Category:Images from norden.org uploaded by Fæ. Naming was an issue, and I have created my own mapping so that the closest plain ascii files names are used, even though the text in the descriptions uses the original regional characters (such as æ and ý). Not all images were on a free licence and I have only uploaded CC-BY-2.5-dk releases, which appears to have been the default. Note that the 'en' template may include 'no', 'sv' or other language text, this was hard to tease out and I have stuck to just 'en' as the default site categories (imported as 'keywords') are in English. It is an area probably best to fix by hand by those with language skills (I can't distinguish snø from höty). Thanks --Fæ (talk) 17:42, 5 March 2013 (UTC)

I like to search for missing thumbnails

I am not sure this is the right place to request this, but I dont find a better one. Currently I develop the User:Thumbnails Check Bot which should check for missing thumbnails in recent uploads and try to fix the reason. (i.E. convert large progressive JPGs and reupload them). On short test runs I found some images with missing thumbnails and a unknown reason. (i.E. 1, 2, 3) But there are only up to three images a day with missing thumbnails. So I like to check all images uploaded in the last year to get a overview how many images there are and (more importent) find all kind of problems why there is not a valid thumbnail to analyse and develop the bot. In the short tests (last days) I checked around 5000-10000 new uploads a day. I asume it will require ~150000 API requests and ~3,6 Mio. HEAD (not GET/POST!) (in complete ~30 GB traffic) request to check all thumbnails of the last year. I assume a running time around a month. There are no edits, just reading. This will be done by anonymous, because there is no login needed. So I can not request a bot flag, because there not a account needed for this. The script will be like this, a custom User-Agent will be used. So I request here if this is a problem to run do this job (anonymous) or is there a problem so my (static) IP maybe can banned? --Slick (talk) 12:10, 12 March 2013 (UTC)

A few random thoughts:

• May be you can work with data dumps http://dumps.wikimedia.org/commonswiki/20130301/ instead of API, you would have much less of a footprint
• I do not know much about internal database structure of Mediawiki database but I suspect that you can just query to find files without thumbnails.
• I would still suggest to ask for bot approval, It will allow you to discuss your plans get some more advice and if your task is reviewed and approved than you would not have to worry about your IP being blocked.

--Jarekt (talk) 13:12, 12 March 2013 (UTC)

Good idea, but I do not own the ressources to work with this large dumps and I do not run a mysql. I dont think I can find valid thumbnails in the database. The job of the User:Thumbnails Check Bot was discussed already and the bot flag for this will request when it is finish. But before create the bot, I like to get more information. And I can not request a bot flag for a non-exists bot. And I dont like to mix the request for the bot and the request to get information to develop the bot. --Slick (talk) 14:59, 12 March 2013 (UTC)

You might be able to ask someone to run a query to find images without thumbnails for you at https://jira.toolserver.org/browse/DBQ . --Jarekt (talk) 15:21, 12 March 2013 (UTC)

I don't think this info is contained in the database. But as far as i know User:Dispenser already ran such a job! --Dschwen (talk) 16:56, 12 March 2013 (UTC)

{{Presumably}}

Could somebody please replace {{LangSwitch|en=presumably|nl=vermoedelijk}} with {{presumably}}? I see quite many appearences, all are identical, and this would allow translations to other languages. BartekChom (talk) 19:55, 31 March 2013 (UTC)

Bartek, I do not think I can search for files using {{LangSwitch|en=presumably|nl=vermoedelijk}} can you point us to some examples where you have seen that, it is probably associated with a single user or project. --Jarekt (talk) 20:10, 3 April 2013 (UTC)

Without template name [1]. About 50 pages. Is it worth a bot configuration or should I replace by hand? This single user seem to be User:Vincent Steenberg. BartekChom (talk) 14:46, 5 April 2013 (UTC)

 Zrobione --Jarekt (talk) 16:14, 5 April 2013 (UTC)

Thank you. BartekChom (talk) 16:46, 5 April 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 02:22, 8 April 2013 (UTC)

Remove incorrect gps data from flickr import

Would somebody be so kind to remove the gps data from these (580) images? All the images have exactly the same GPS position which may sometimes be more or less correct but is mostly totally off. thank you! Amada44  ^{talk to me} 08:43, 6 April 2013 (UTC)

Should be all  Done. (See 1 for an example). --McZusatz (talk) 18:19, 7 April 2013 (UTC)

excellent! Thank you! Amada44  ^{talk to me} 18:58, 7 April 2013 (UTC)

This section was archived on a request by: McZusatz (talk) 17:51, 8 April 2013 (UTC)

SineBot clone

See also: COM:VP#Signature bot on Commons and Special:Permalink/92833740#Signature bot on Commons.

Hi, recently there was a VP discussion about a signature bot. Is anyone capable of writing a SineBot clone and sticking it somewhere to run continuously on Commons (i.e. WMFlabs or TS)? Mono 15:24, 17 March 2013 (UTC)

May be invite the VP bot owner to come and set shop here?--Jarekt (talk) 20:34, 17 March 2013 (UTC)

invalid flickr urls

The Upload Wizard added some invalid flickr urls. Example: File:Clasping Leaved Twisted Stalk.gif. While the bug is fixed, the files on commons still need fixing. Its a bit tricky: the 'null' needs to be replaced by the flickr id of the user. See this diff as an example. Here the list of all files concerned. Thanks, Amada44  ^{talk to me} 18:50, 8 April 2013 (UTC)

So how do you find proper flickr id of the user? for example here. --Jarekt (talk) 19:28, 8 April 2013 (UTC)

never mind, I figured it out. --Jarekt (talk) 19:35, 8 April 2013 (UTC)

I always use http://idgettr.com/ I have just seen that you have done all of them! Great work! Thank You! - Amada44  ^{talk to me} 20:01, 8 April 2013 (UTC)

No not all but few authors with the most files. There are still many singletons. Those might be best done by hand. I was thinking about waiting for the list to catch up with the changes, to see what is left. --Jarekt (talk) 00:39, 9 April 2013 (UTC)

Should be  Done now. --Jarekt (talk) 13:05, 9 April 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 13:41, 10 April 2013 (UTC)

Watermark

Please, can any of you add {{watermark}} in this user's contributions?

Tks. Yanguas (talk) 01:46, 10 April 2013 (UTC)

Please make him aware of the guidelines. His talk page is empty… --Leyo 08:03, 10 April 2013 (UTC)

Done. Are you going to add the template now? Tks. Yanguas (talk) 13:30, 10 April 2013 (UTC)

Someone have done it already. --Jarekt (talk) 13:46, 10 April 2013 (UTC)

 Done using VisualFileChange. --Leyo 13:47, 10 April 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 11:57, 12 April 2013 (UTC)

Backlog at COM:CDC

Hello. At Commons:Administrators'_noticeboard#Delinker_broken there are concerns regarding the backlog of category moves at COM:CDC. SieBot (talk · contribs) is not working again. Is any user with a bot approved for category moves willing to clear a bit those requests? Thanks. —MarcoAurelio (talk) 11:49, 17 March 2013 (UTC)

Approval requested.  Hazard-SJ  ✈  01:40, 19 March 2013 (UTC)

File by Guillaume Speurt, from Flickr

All images of Paris by this user are marked with {{Location dec|48.874425|2.328758|source:Flickr}}, which is wrong and should be either removed or commented out. Beside, though the copyright seems to be ok, they are all watermarked, so I supppose the {{Watermark}} could be added as well. --Zolo (talk) 07:21, 4 May 2013 (UTC)

 Done I removed location and added Category:Files from Guillaume Speurt Flickr stream to Category:Images with watermarks. --Jarekt (talk) 13:16, 7 May 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 13:16, 7 May 2013 (UTC)

replaceing png images with svg versions

Hi, I made all province of Iran files as SVG please replace the green maps in Category:Province location maps of Iran with svg versions.for example file:IranFars.png > file:IranFars-SVG.svg Yamaha5 (talk) 10:59, 12 April 2013 (UTC)

• I could offer adding {{Superseded}}. CommonsDelinker will not replace the usage of these files (PNG->SVG does not work); if you like to have them replaced, I can give you instructions how you can easily achieve this using a user script. The issue is that I am not sure whether all people will be happy having a the green maps replaced with ones consisting of other colors. -- Rillke^(q?) 16:04, 12 April 2013 (UTC)

my maps are more detailed also it shows Iran's Islands and Golf and lacks which are important also the map's colours are the same as File:Iran_locator1.png which are used in wikipedia so these colour combination is not strangeYamaha5 (talk) 17:48, 12 April 2013 (UTC)

Convinced.

Write the following line in your Special:MyPage/common.js.

importScript('User:Sreejithk2000/JustReplace.js');

Then do something useful while the servers are busy recreating the minified version of your user scripts (usually takes up to one minute), then go to the file description page of the map that should be replaced and click Global replace (it's in the dropdown next to the search box in vector skin; it's a separate tab in monobook). Enter the new file's title, a reason and tick the checkbox Do never use CommonsDelinker. A compatible browser (e.g. recent versions of Firefox, Chrome, Safari, Opera…) must be used where making Cross-Origin-XHRs is not blocked by browser extensions/Add-Ons like noscript.

The script will then automatically query and replace the file's usage (up to 45 each time it is invoked). Your browser will make XMLHTTP requests to each wikimedia wiki the file is used on (I tell you this for the case you're using a web proxy) and the edits will be counted to your contributions there.

If not all usages were replaced, you may try it again after 2 minutes. Some wikis have restrictive edit rate limits (10 edits/2 min); others will ask to solve captchas; both is not supported by the script and these pages/wikis will be skipped. But the majority should work.

I am unfortunately not aware of any existing bot code that would do a better job here. -- Rillke^(q?) 08:00, 13 April 2013 (UTC)

Category addition : USMC files

Hi, my request is to add a category of Category:PD US Marines if the file is tagged with {{PD US Military}} OR ELSE Category:United States Marine Corps

to all files whose name start with "USMC" in Category:Media needing categories as of 13 December 2012. Those files count more than 4400. This will help me greatly in categorizing files in this category. --Nightingale (talk) 03:06, 7 May 2013 (UTC)

I think you mean {{PD-USGov-Military}}. Is this sample ok: https://commons.wikimedia.org/w/index.php?title=File%3AUSMC-033110-M-7012H-070.jpg&diff=95775183&oldid=85046112 ? --McZusatz (talk) 14:57, 7 May 2013 (UTC)

We should probably also change {{PD-USGov-Military}} to {{PD-USGov-Military-Marines}}. --Jarekt (talk) 16:09, 7 May 2013 (UTC)

Ich kenne mich mit dem US Militär nicht so sonderlich aus, aber nur weil die Marines das Bild veröffentlich haben (was die gemeinten USMC Files waren), muss der Fotgraf kein Marine gewesen sein. Von daher halte ich {{PD-USGov-Military-Marines}} nur für die Fälle für passend wo der Fotograf eindeutig als Marine indentifiziert ist. Für die Massenverkategorierierung ist daher {{PD-USGov-Military}} IMHO passender. --Slick (talk) 17:22, 7 May 2013 (UTC)

OK good point. Lets keep {{PD-USGov-Military}}. --Jarekt (talk) 19:05, 7 May 2013 (UTC)

Oh, mistake, sorry for the german. By the way, if a bot will work on this, it should use Category:Import_by_User:Slick-o-bot/Marines.mil_images. --Slick (talk) 19:08, 7 May 2013 (UTC)

Thank you for your attention. I leave you much more experienced guys as to which category should be added. I've been adding manually categories to the files in Category:Media needing categories as of 13 December 2012 for a few days. I just want to remind you that thousands of "USMC" files are also in Category:Media needing categories as of 2 December 2012 through Category:Media needing categories as of 12 December 2012. --Nightingale (talk) 00:51, 8 May 2013 (UTC)

It seems Category:Marines.mil images to check already is a subcat of Category:United States Marine Corps. So it would not make sense to also add Category:United States Marine Corps. --McZusatz (talk) 06:27, 8 May 2013 (UTC)

I suggest, if Category:United States Marine Corps is not already added to the files in Category:Marines.mil images to check it should add, because this category is for maintenance only and should removed when a file is checked. So as long a file is in Category:Marines.mil images to check the Category:United States Marine Corps is not wrong to add. --Slick (talk) 06:45, 8 May 2013 (UTC)

This task seems to be  Done? But I noticed there are still many pictures with only hidden category and without the uncategorized template. I think those should also be processed. (example File:USMC-00194.jpg). --McZusatz (talk) 08:29, 12 May 2013 (UTC)

This section was archived on a request by: Slick (talk) 13:13, 14 May 2013 (UTC)

Broken file redirects

Can a bot be made to remove on a regular basis the redirects to deleted files. The Commonsdelinker does not handle it properly, and there is little hope to have its code corrected any-time soon. Example: File:Kaliningrad_(2051049698).jpg. --Foroa (talk) 08:47, 12 April 2013 (UTC)

I am not sure about automatic process since most bots do not have administrative rights. I occasionally delete problem files from Commons:Database reports/File description pages without an associated file. It goes quite fast with AWB tool. However automatic recurring process would be preferable. --Jarekt (talk) 11:57, 12 April 2013 (UTC)

Thank you, there seems to be more File:WWE Championship belts 6.jpg, and some more in Special:UncategorizedFiles. --Foroa (talk) 12:15, 12 April 2013 (UTC)

Special:UncategorizedFiles is harder to work with since there is no good way to copy the list to AWB and there is more images that are not redirects, so it might be better to delete them when they pop out on Commons:Database reports/File description pages without an associated file list. --Jarekt (talk) 13:20, 12 April 2013 (UTC)

I've recently written some code, letting my bot create a list here. It seems OK so far, so I'll seek approval to let the bot tag the files for deletion rather than list them to be tagged.  Hazard-SJ  ✈  00:37, 25 April 2013 (UTC)

Add category

I found many files here. These files are Train station signs in Tokyu Corporation.

For example, Hasunuma eki.png is Station sign at Hasunuma station. Eki means station. In this case Hasunuma station and Train station signs in Tokyu corporation will be proper.

Please add categorys like that.--콩가루 (talk) 10:36, 4 May 2013 (UTC)

That does not sound like a job for a bot. So unless there is a specific set of files and we are performing some well defined set of operations, it will have to be done by hand. --Jarekt (talk) 12:14, 15 May 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 11:46, 21 May 2013 (UTC)

Cut a couple of words in description

Hi to everyone who reads this,

I would consider to remove, on all my imported pictures, the mention <small>([[User:Floflo|Floflo]])</small> placed next to my name in the descriptions (see as a example, the last one). I have imported some 1000 pictures, so it'll be very long for me to do it manually. Therefore I wanted to check, before doing it by myself, if it could be a possible mission for a bot? Many thanks, --Floflo (talk) 18:59, 4 May 2013 (UTC)

I like the hyperlink in the name. Would it be OK to replace "Florian Pépellin (Floflo)" with "Florian Pépellin"? --Jarekt (talk) 13:19, 7 May 2013 (UTC)

Well, not much because there is no major and very useful information in my user page... Besides that was the reason for which I considered to remove the link...Is a link compulsory? --Floflo (talk) 18:29, 7 May 2013 (UTC)

It is not and I can remove it, but there will be always link to your page in section "File history". It also helps people verify that stated photographer and the uploader claim to be the same person. Finally your page does have useful information like button to show some other of your uploads or a link to send you an email. --Jarekt (talk) 19:02, 7 May 2013 (UTC)

The argument about e-mails and my other uploads is interesting. But I'm not sure actually that many people use them (as far as I know for the e-mails, no one received within 7 years..). You're also right about the link in "File History", that's why I thought to remove a reddundant link in the description. I'm nearly sure now that having another link here won't be quite more useful, but you make me doubt! --Floflo (talk) 19:48, 7 May 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 11:46, 21 May 2013 (UTC)

Clean up

For these files. Please remove in the description of file ".JPG" and ".jpg". For example. --Insider (talk) 08:32, 21 May 2013 (UTC)

Done with VFC. --McZusatz (talk) 09:47, 21 May 2013 (UTC)

Thanks. --Insider (talk) 10:25, 21 May 2013 (UTC)

This section was archived on a request by: Insider (talk) 10:25, 21 May 2013 (UTC)

Display issues of language templates

There are two kinds of display issues of language templates:

1. The text in parameter 1 is not displayed due to a = in the text. The 1= in the beginning that avoids this problem is missing. Examples: Special:Permalink/28178560, Special:Permalink/69118001, Special:Permalink/24951271
2. If there are a certain number of language templates that are used as {{en}}Some sample text, the language select feature effects all texts to be displayed after each other (with the language names in a block above). Examples: Special:Permalink/42105123, Special:Permalink/31255164, Special:Permalink/72387078

We have Category:Template:De with no text displayed and Category:Template:nl with no text displayed where pages with these problems for {{De}} and {{Nl}} are in. The vast majority of cases has already been fixed for the former category. A large fraction of pages in these categories do not have one of the two problems described above, since there are not (yet) enough language templates to trigger the language select feature.
I think that there should we maintenance categories for all languages templates, but fixing would not be feasible without getting assistance by bots. The main task would be to move the text after a language template inside it:

{{en}}Some sample text

{{en|Some sample text}}

or

{{en}}Some sample text with a = in it

{{en|1=Some sample text with a = in it}}

--Leyo 10:19, 22 March 2013 (UTC)

Sounds like a good idea. I will look into it. In the mean time I created {{Language templates with no text displayed category header}} to be used in subcategories of Category:Language templates with no text displayed. --Jarekt (talk) 14:51, 22 March 2013 (UTC)

Thanks. I actually had the same idea concerning the template. ;-) --Leyo 14:57, 22 March 2013 (UTC)

I was thinking more about it and many language templates have very few files using them. There is probably no need for maintenance categories for them. May be we should use some threshold and only do the category for templates with more than 1000 (?) transclusions. --Jarekt (talk) 16:49, 22 March 2013 (UTC)

Do you have a good method for finding errors for such templates without a maintenance category? --Leyo 17:10, 22 March 2013 (UTC)

An alternative is to change with a bot {{nl}} to {{nl| }}. This removes those images from the category. Fix the rest manually. Or fix the rest in the category with a bot as well: {{nl|xxxx}} to {{nl|1=xxxx}}. HenkvD (talk) 19:36, 22 March 2013 (UTC)

Your first suggestion would not solve the problem #2 (another example). It would just “hide” it. --Leyo 21:00, 22 March 2013 (UTC)

That is right, but I think it is a quick fix, and as a result all texts are shown (maybe not on better place). Trying to replace {{en}}Some sample text to {{en|Some sample text}} might be a difficult progamming. For instance this where the {{nl}} and {{en}} contains a full information template. HenkvD (talk) 13:13, 23 March 2013 (UTC)

 Done I took a little different approach and added this to {{Description}} template which is called by all language templates. So now all the problematic images will be added to Category:Language templates with no text displayed, instead to individual categories for each language. --Jarekt (talk) 01:53, 24 March 2013 (UTC)

I also run a bot run (see here) adding "1=" to language templates with "=" in the text, and replacing blocks of {{xx}}text1{{yy}}text2 with {{xx|text1}}{{yy|text2}}. --Jarekt (talk) 19:30, 24 March 2013 (UTC)

Thank you for your work. I am fine with your modification to {{Description}}, but I would not like to miss the subcategory at least for {{De}}. Once the legacy cases are gone, it will provide an easy option to check for problems in files transferred from de.wikipedia to Commons. Furthermore, subcategories tells us more precisely where the error is located.

It seems that the script of your bot is not yet perfect: see e.g. [2], [3], [4], [5] or other cases. --Leyo 23:39, 24 March 2013 (UTC)

I do not think a perfect one is possible. I was aiming for fixing most files I can, with least chances of breaking things. So in many cases the bot did not finished the job. The rest will likely have to be done in semi-automatic mode. I do not mind leaving Category:Template:De with no text displayed or other specific language categories behind, but I did not wanted 200 of those categories with some files in several dozen of those. --Jarekt (talk) 03:45, 25 March 2013 (UTC)

One possibility to get rid of a probably dozens of cases would be to remove empty templates, i.e. with no text inside or behind, by bot. --Leyo 07:54, 3 April 2013 (UTC)

I run something along those lines, so all cases where that was the only issue should be done. However I was trying to be conservative about how to detect text or behind language template and might have missed some. --Jarekt (talk) 11:35, 3 April 2013 (UTC)

{{Picture of the day}} is also a possible cause of the problem, if a language subpage does not contain a description. Example: Template:Potd/2009-02-13 (pt). BTW: It says

Description missing! Tag this page with {{speedydelete}} if it was created by mistake.

, but the page is not put into a maintenance category. Should this be changed? --Leyo 16:29, 5 April 2013 (UTC)

The image was added to the Category:Language templates with no text displayed maintenance category, and template was added to Category:Potd templates missing descriptions. I think that is correct. The pages in Category:Potd templates missing descriptions should probably be deleted. --Jarekt (talk) 14:47, 10 April 2013 (UTC)

I was working on clearing Category:Language templates with no text displayed, help would be appreciated, since many types of issues are unique enough to write a bot. Another problem is that since this maintenance category was added to a template used on a LOT of pages, the pages were not refreshed afterwards so images in that category are only added after some other event causes the refresh. Past experience with other similar categories and templates suggests that that process can go on for months, so we will not see all the files that should be in Category:Language templates with no text displayed for a while. --Jarekt (talk) 14:55, 10 April 2013 (UTC)

I know. Hence, I am constantly cleaning out Category:Template:De with no text displayed and it is constantly being refilled… --Leyo 14:35, 11 April 2013 (UTC)

I fixed hundreds of category pages with empty language templates created or edited by User:Bernd Schwabe in Hannover.
Could someone please touch all edits to file pages by User:Chumwa? Several of them are not in the maintenance category since they have not been refreshed recently. --Leyo 17:52, 13 April 2013 (UTC)

The maintenance category is again really full. :-( Perhaps, the implementation of Lua (TemplatePar) would help by allowing to distinguish between cases like {{en}} and {{en|Sentence containing a = in the text}}. --Leyo 17:30, 29 April 2013 (UTC)

We could do that but I am not sure how that would be helpful. --Jarekt (talk) 17:51, 30 April 2013 (UTC)

(i) Prioritizing the latter case over the former, (ii) facilitating bot runs.

I guess Lua shouldn't be tested on e.g. Template:en, but rather on a template with less transclusions. --Leyo 17:59, 30 April 2013 (UTC)

Category:Images from KIT

Hi, could a bot generate a list of all red categories with a name that starts with "Category:Images from KIT". Depending on the outcome, we will see how we can handle those categories that are occupying wanted categories since several years.

Same request for categories that start with "Category:Images from US Navy". --Foroa (talk) 07:14, 3 May 2013 (UTC)

Foroa, below are a few sets:

--Jarekt (talk) 12:02, 7 May 2013 (UTC)

I can create those categories if we agree on what should be in each. --Jarekt (talk) 19:09, 7 May 2013 (UTC)

Thank you. Could you please update the list to contain all red Images from KIT categories ? Hopefully, I can get them all arranged this time. Thank you. --Foroa (talk) 12:34, 15 May 2013 (UTC)

OK, there are still hundreds of such categories hanging there for several years. Would it be possible to create all the red ones in Category:Images from KIT categories to be classified, I will move them later with cat-a-lot in more appropriate categories. --Foroa (talk) 09:45, 20 May 2013 (UTC)

 Done --Jarekt (talk) 02:11, 21 May 2013 (UTC)

Romanian newspapers

Thank you. Maybe first the simple cases: the tree last items, the Romanian newspapers (as their uploader is blocked): just in their parent category, no key, as it is easier then to move them in year cats using cat-a-lot. --Foroa (talk) 18:13, 8 May 2013 (UTC)

Thank you for the ones in Category:Foae pentru minte, but there are still many red ones left over. --Foroa (talk) 06:01, 9 May 2013 (UTC)

It looks as if the added categories have been limited to categories with 4 or more items. You can take them all; one day or another the pour Romanian uploader will be unblocked and those cats will fill up anyway. I noticed that we have no Romanian administrator to discuss the problem, wondering what we could do. --Foroa (talk) 09:29, 9 May 2013 (UTC)

 Done now --Jarekt (talk) 00:35, 10 May 2013 (UTC)

Many thanks, only a bunch left for Category:Foae pentru minte. --Foroa (talk) 06:23, 10 May 2013 (UTC)

It makes no sense not to create red ones that contain only 4 or less items, we better settle the problem ones and for all, and those categories will not go away. We are getting Special:WantedCategories down to a basic level of 5 items, and hopefully within a few months to a level of 4. --Foroa (talk) 08:17, 10 May 2013 (UTC)

I think it is done now. I created my original lists based on Special:WantedCategories page which omits categories with not enough files. --Jarekt (talk) 17:18, 10 May 2013 (UTC)

Category:United States Navy images by location to be classified

All red categories categories that start with "Category:Images from US Navy" should be categorised as Category:Images from US Navy, location Bellingham, Wash. in Category:United States Navy images by location to be classified, no sort key. Those categories become typically a subcat or a redirect as the upload bot becomes active from time to time. --Foroa (talk) 14:48, 14 May 2013 (UTC)

 Done --Jarekt (talk) 12:11, 15 May 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 16:19, 30 May 2013 (UTC)

Category:Images from the Geograph British Isles project needing categories

We need to have all the red categories such as Category:Images from the Geograph British Isles project needing categories in grid NZ2073‏‎ created in Category:Images from the Geograph British Isles project needing categories. If possible, they should contain a self-deletion template, that tags the category as speedy/empty when empty. It would be great if those categories could be associated with a county, provided it doesn't needs a lot of efforts. Thank you. --Foroa (talk) 12:22, 19 April 2013 (UTC)

I don't see what you're talking about.  Hazard-SJ  ✈  02:19, 23 April 2013 (UTC)

These red categories need to be created till the contents is removed and properly categorised. When they are empty, they can be deleted as done in Category:Images from the Geograph British Isles project needing categories in grid SP1579. --Foroa (talk) 09:39, 23 April 2013 (UTC)

Wow, that certainly is a lot, but I'm up for it. All we need on them is a condition for self-requesting deletion, mark it as hidden, and add the category you mentioned? If so, I'll code it and request approval to do it.  Hazard-SJ  ✈  01:00, 25 April 2013 (UTC)

For information as it is related to this category creation request, the plan for Faebot is to continue going through every Geograph image and classifying by county name (see User:Faebot/Geograph). This means that for any image with no categories, it will be added to the county (or equivalent administrative region) category so it at least has a starting point and is more likely to be found by the general public user. Thanks --Fæ (talk) 09:49, 23 April 2013 (UTC)

Ok, in Category:Images from the Geograph British Isles project grid squares by number of files which is not very useful in my opinion as the count decreases permanently; it might be more useful if the content count at creation time is the sort key. On the other hand, you have an idea about the problem with categories that don't autodelete. --Foroa (talk) 16:20, 29 April 2013 (UTC)

Is there a blocking factor ?--Foroa (talk) 07:15, 3 May 2013 (UTC)

Similar request for [6]]: all red Federațiunea categories should be created in Category:Federațiunea. If possible: sort key:Year, month. --Foroa (talk) 10:09, 7 May 2013 (UTC)

And similar fro Category:Foae pentru minte. --Foroa (talk) 10:29, 7 May 2013 (UTC)

Forgoten }

I have typooed about 50 descriptions. Could you add extra } in description after {{en|string.} for files in User:Juandev/VicuñaUploader#2013-06-02 22:06:44?--Juandev (talk) 21:52, 2 June 2013 (UTC)

Errr, not a good idea. Someone partially repaired that.--Juandev (talk) 21:52, 2 June 2013 (UTC)

 Done --Jarekt (talk) 11:42, 3 June 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 11:42, 3 June 2013 (UTC)

Working out the "largest" user pages

Hi,

Faebot recently churned through the list of all active users (the API gives those active in the last 30 days), worked out which had a user page, and returned the length. For example my user page is shown by this call to have a length of 5,702 bytes. So I have an interesting list and can identify the top 10 or top 100 user pages for active users by "length".

Now, here's my problem. I was actually trying to find out which user pages are the "largest" in terms of the size of page the browser has to download. This would include transcluded images, in particular it would highlight those user pages being used for very large galleries and might be so large as to be unusable or unreadable in many browsers or platforms.

Does anyone have a suggestion on how to go about creating such a list of user pages by final download size, possibly being restricted to a short-list similar to the one I already have generated by length? Thanks --Fæ (talk) 10:28, 10 April 2013 (UTC)

I can not think of any easy solutions, but we could write a simple code to download all user pages and count number of characters in HTML code. --Jarekt (talk) 12:01, 12 April 2013 (UTC)

Why don't you try to simply sum all images' size to the page size? Using images as a generator for imageinfo: for example, this query gets the size for all the first 500 images included in my userpage. --Ricordisamoa 00:24, 12 May 2013 (UTC)

Very good, I like this API based way of solving the problem. I'll consider hacking this when I have a couple of spare hours (in, say June!). Thanks --Fæ (talk) 04:16, 12 May 2013 (UTC)

Images from AELG website

Hi. See the discussions Commons:Deletion requests/Category:Alfredo Conde in AELG and Category talk:Images from AELG. The category Category:Images from AELG contains 264 subcategories of individual writers from the website of Association of Writers in Galician Language. The category names like Category:Alfredo Conde in AELG are incorrect and confusing. The adverbial should express the source of the photos, not the location nor the membership. The discussion appears to come to the solution:

• All 264 categories should be renamed (from [[:Category:‹name› in AELG]] to [[:Category:Photographs of ‹name› from AELG website]]) and be equiped with appropriate {{DEFAULTSORT:}}.
• For each of the 264 categories, the parent category of the writer should be created if doesn't exist yet. (Create [[:Category:‹name›]] as the parent category for every [[:Category:‹name› in AELG]]). The main category of the person should be categorized into Category:Writers in Galician by default, using appropriate {{DEFAULTSORT:}}.

--ŠJů (talk) 11:27, 14 May 2013 (UTC)

Exuse me. You say we come up with the solution. But I disagree. I dont think such difficult system you are proposing is good. I would propose better system:

1. Add to all files in categories of Category:Images from AELG source template, which will add images to Category:Images from Association of Writers in Galician Language. Possibly it can be done just by setting all those images to category.
2. Hide Category:Images from Association of Writers in Galician Language.
3. Rename Category:‹name› in AELG to Category:‹name›
4. Add all new Category:‹name› to Category:Members of Association of Writers in Galician Language
5. Posibly delete all categories:‹name› in AELG. Category:Images from AELG might be redirected to Category:Images from Association of Writers in Galician Language

This system is nothing unusual. It is based on similar systems which already exists on Commons, like previously mentioned files from Bundesarchive (in English German federal archive), where is the following system:

Bundesarchive – all images donated by German Federal Archive are placed in Category:Images from the German Federal Archive. But this category is hidden. It means technical category telling us the origin of files. As far as there is a field "source" in the description, there is no nead to have a valid category for source. Than every each image is set to category like subject. So e.g. File:-Bundesarchiv B 145 Bild-F055060-0007A, Köln, SPD-Parteitag, Börner-2.jpg, which depicts Holger Börner somewhere is in Category:Holger Börner and by templates its set to technical categories: Images from the German Federal Archive, CC-BY-SA-3.0-DE, Fotowerkstatt, Bilderwerkstatt, Edited images.

So I am proposing to have here categories with valid English names (i.e. no abreviations). Category:Images from Association of Writers in Galician Language will than include all images donated by AELG and Category:Members of Association of Writers in Galician Language will than include all categories with AELG members (i.e. Category:‹name›). Category:Images from Association of Writers in Galician Language will be hidden, because it is technical category. Than there will be 264 basic categories: Category:‹name› including pictures donated by AELG, but also coming form other sources. So if we have a look on one example:

EXAMPLE:

File:Alfredo Conde (AELG)-2.jpg will be in Category:Alfredo Conde, Category:name of place (where the image was taken) and hidden Category:Images from Association of Writers in Galician Language. Category:Alfredo Conde will be set in Category:Members of Association of Writers in Galician Language.--Juandev (talk) 14:15, 14 May 2013 (UTC)

I agree with ŠJů proposal because with this categories we have subcategorized more than 800 photos. If all the photos were from different writers the proposal of Juandev would be correct but in this case we have more than one photo of many of the writers.

Only a note to ŠJů proposal, I think that all the parent category of the writers exists. Bye, --Elisardojm (talk) 22:11, 14 May 2013 (UTC)

The categorization structure proposed here by Juandev is also acceptable, his argument by Bundesarchive is very appropriate. Wikimedia Commons use commonly not so detailed categorization within a category by source. Would you willing to accept such solution, Elisardojm?

As regards a dilemma between original abbreviation and translated full name of the organization, I would prefer the English full name for the main category of the organization and original abbreviation in names of subcategories and templates.

Btw, Elisardojm, you wrote: „I think that all the parent category of the writers exists.“ I checked all the 264 existing subcategories of Category:Images from AELG. Only 3/264 of the subcategories (Alfredo Conde, Darío Xohan Cabana, Pilar García Negro) have their parent category of the writer. I think, Juandev's solution is more simply and useful than to create 261 new categories as the second categorization layer. --ŠJů (talk) 12:30, 15 May 2013 (UTC)

Thus, I try to summarize the proposed process modified according to the discussion:

1. Label all included images with {{AELG}}.  Done a long time ago.
2. Categorize all images with {{AELG}} to the hidden source category Category:Images from AELG website through the template.  Done right now.
3. Move (rename, merge) all 264 subcategories of Category:Images from AELG from the current name [[:Category:‹name› in AELG]] to the new name [[:Category:‹name›]]. Together with this step for every category:
   1. Add appropriate {{DEFAULTSORT:<last name>, <first (and second) name>}}
   2. Remove the category from Category:Images from AELG (delete the emptied category)
   3. Add the category as a subcategory into Category:Writers in Galician by default, possibly also (or alternatively) into Category:Members of the Association of Writers in Galician Language

Some improvements or objections? --ŠJů (talk) 12:30, 15 May 2013 (UTC)

Sorry, I thought that all categories had its parent category of writer, but if the parents category don't exists we can create them.

The main problem that I see to the proposal of Juandev is that it delete the subcategories of the writers of the AELG category and this category will have more than 600 photos. These photos can be grouped because there is a lot of them that are of the same writer, and therefore I think that would have to be in subcategories so that the main category was orderly. The same category of the images of Bundesarchive has subcategories, by year, by author, etc.

I agree to rename the categories that have an unsuitable name. Bye, --Elisardojm (talk) 11:42, 20 May 2013 (UTC)

A bot

Hi!

My name is Sophie Österberg and I'm working as an education manager at Wikimedia Sverige. I'm trying to help teachers here to set up a portal for them on Commons as they want a place to put, organise and see their flipped-classroom movies. But I would need this (as specified by a colleague who knows much more than I about this)

Specifications: A bot which once every 24 hours:

1) checks a given maintenance category Y, and for each movie A in this category:

• • visits the movie description and identifies the categories it is in.
  • check if any of these categories correspond to a pre-specified list Z of keywords. If so associate A with the corresponding value (z)
  • remove category Y from the movie

2) Visits a given page containing one gallery associated which each keyword in Z.

• For each of the keywords in Z add any associated movie (from step 1) to the top of the relevant gallery.
• prune any galleries so that they are no longer than W movies.

I would be so happy if anyone would find this challenging and intriguing and thus help teachers in Sweden with their portal by creating this. If so, I would be very grateful. Sophie Österberg (WMSE) (talk) 11:59, 21 May 2013 (UTC)

For your gallery bot to be even more community driven, I suggest a project page somewhere contains a list of "maintenance categories" (there may be several) and a list with "key words" to be monitored, possibly each with the associated link to its gallery page/sub-page. Using on-wiki lists that the community can adapt and see the bot respond to within 24 hours, will avoid any need to ask for the bot script to be changed for any of these configuration details. There are bot scripts that do very similar things, so this seems very do-able. --Fæ (talk) 12:16, 21 May 2013 (UTC)

Ok, sounds like a great idea! --Sophie Österberg (WMSE) (talk) 12:24, 22 May 2013 (UTC)

Fix some invalid PDFs

Tracked in Phabricator
Task T25326

A subset of Category:PDF files affected by MediaWiki restrictions files needs to be re-exported to PDF in some way, see bug. I don't know exactly what command was used but bugzilla:23326#c13 shows an example error message that a bot could check for. I don't know how Marco fixed it; in worst case, the images can be extracted with pdfimages -j and converted again to PDF, though this will lose the text layer. --Nemo 09:36, 30 May 2013 (UTC)

Basically I only used lpr -P PDF input.pdf (needs cups-pdf installed). CUPS also uses GS in the back end but applies some filtering which seem to repair the PDF file. (See: File:Albina 1866-07-01, nr. 36.pdf for example)

Also keep in mind some PDFs fail due to resource limitations which can't be fixed by the bot. Those should be skipped. --McZusatz (talk) 15:03, 30 May 2013 (UTC)

I think I can complete the upload of the fixed PDFs this week. --McZusatz (talk) 13:11, 13 June 2013 (UTC)

This section was archived on a request by: McZusatz (talk) 11:17, 17 June 2013 (UTC)

Fixing Italian descriptions and links to it.wikipedia

There seem to be many subcategories, galleries and files in Category:Language templates with no text displayed that need to be corrected using a default algorithm (example). It would be great if someone could do this by bot. --Leyo 23:22, 9 June 2013 (UTC)

The problem with language templates is that it is hard to tell where text in each language ends. Also there are great many different 2 and 3 letter language templates, and it is hard to distinguish them from other 2, 3 letter templates. My bot was working on this problem for a while and fixed many thousand cases, but I try to be conservative in my replacement rules. I can try to run it on current set of files. Other bots, ideas are welcome. --Jarekt (talk) 12:39, 12 June 2013 (UTC)

I understand the complexity of this task. What about just fixing the links to Wikipedia articles from

[http://it.wikipedia.org/wiki/Article_name article name]

to

[[:it:Article name|article name]]

and similar? There seem to be such badly formatted links also to es.wikipedia. If this is already done, a lot of manual fixing time may be saved. --Leyo 12:54, 13 June 2013 (UTC)

 Done --Jarekt (talk) 15:57, 13 June 2013 (UTC)

Thank you. --Leyo 09:31, 17 June 2013 (UTC)

This section was archived on a request by: Leyo 09:31, 17 June 2013 (UTC)

Category:Pages with broken file links

I need a bot for running null-edits on all content in this cat and subcats. Running it once should be sufficient. For the subcat Category:Files with broken file links I need a regular bot run at least twice a week for null-edits. These null-edits will result in cat-removal from all images where a thumbnail image was missing upon upload, all vandalized images or images with missing link targets would stay in the matching cats. --Denniss (talk) 23:42, 19 May 2013 (UTC)

I'll have this done as soon as I can.  Hazard-SJ  ✈  03:52, 22 May 2013 (UTC)

 Partially done. I've run a script through Category:Pages with broken file links non-recursively (it null-edited about 1617 pages in all), taking the category down from 1,504 pages to 43, but in turn, increasing the other categories' numbers of pages. I've updated the code to recurse whenever it goes through that category, so in the future it should end up going through all the categories.  Hazard-SJ  ✈  05:05, 23 May 2013 (UTC)

It looks as if the automatic background category page update on Commons has changed. Many template driven categories work now with a delay of days or even weeks. (non empty and broken category redirects, disambiguation pages, ...). --Foroa (talk) 06:02, 23 May 2013 (UTC)

Thanks for running the script, as stated in the first post a recurring run is only required for the files subcat as it's usually a problem with the thumbs not present on image upload (damn user-specific templates displaying a thumb of the image itself, cat already grown back to 350+ files). I could not really see an automatic background category page update - most content of the main cat stayed there for months unless a page was actually edited. And I must have (null)edited thousands of them. BTW is it possible to run this script through the files subcat on specific days, say Monday and Thursday at 0:00 UTC? --Denniss (talk) 11:20, 27 May 2013 (UTC)

I'm running the script recursively now. --Zhuyifei1999 (talk) 03:35, 11 June 2013 (UTC)

I'm refreshing non-empty category redirects daily, but I have some problems refreshing those categories. The output is HTTPError: 504 Gateway Time-out\nWARNING: Could not open 'http://commons.wikimedia.org/w/api.php'. Not sure what's wrong. --Zhuyifei1999 (talk) 13:57, 11 June 2013 (UTC)

I've already replied to a query on my talk page from some time ago saying that it was on a crontab to run twice a week.  Hazard-SJ  ✈  03:55, 16 June 2013 (UTC)

What was the output? Did it get 504 too? BTW, I removed that command from the crontab, and I won't restore it until mw:User:Xqt reply to me on mw:User talk:Xqt#Another bug --Zhuyifei1999 (talk) 12:15, 17 June 2013 (UTC)

I've run it on my computer without errors part-way at least twice, but checking it now gives the error on both my computer and on Labs for some pages. I'll try to hard-code the script to directly get and skip pages with such errors for now.  Hazard-SJ  ✈  01:26, 18 June 2013 (UTC)

Actually, I've decided to try an alternative. I'll see how it goes, and if not, I'll try the hard-coding.  Hazard-SJ  ✈  01:42, 18 June 2013 (UTC)

Seem making little progress: some are locked, others are too long, still others are just have the broken file links. --Zhuyifei1999 (talk) 03:10, 19 June 2013 (UTC)

Yes, it's happening on many pages, strangely. However, the script ran, though quite slowly, so let's leave it at that for now.  Hazard-SJ  ✈  23:06, 19 June 2013 (UTC)

Seems that even null-editing on web browsers can make error too, which is not good, might need section edits manually. Also it seems that my script python ~/pywikipedia/touch.py -catr:Pages_with_broken_file_links && python ~/pywikipedia/touch.py -subcatsr:Pages_with_broken_file_links && python ~/pywikipedia/touch.py -subcats:Pages_with_broken_file_links with modified touch.py has run completely, but the pages/cats/files of Category:Pages with broken file links decreased only a little or none at all. --Zhuyifei1999 (talk) 10:53, 20 June 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 06:53, 28 June 2013 (UTC)

The tool and the bot are operated by

I just came over the confusing sentence

The tool and the bot are operated by [[User:Jan Luca]] and [[User:Magnus Manske]].

I have been a bit confused about this introduction which did not really match that particular software. Digging in history brought me to tools:~magnus/commonshelper2.php (or BotMoveToCommons?).

Apparently this is spread over 2746 description pages.

A bot might be so kind and cleanup the remains.

Leyo already changed Botcheck.js.

Greetings --PerfektesChaos (talk) 09:12, 30 May 2013 (UTC)

 Done. I also removed The upload bot is [[User:CommonsHelper2 Bot]] which is called by [http://toolserver.org/~commonshelper2/index.php CommonsHelper2]. because this should go in the upload summary rather than jamming the description. --McZusatz (talk) 14:07, 30 May 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 06:53, 28 June 2013 (UTC)

Category:Flade Kirke

Hi, I would like a bot to move all the files in Category:Flade Kirke to Category:Flade Kirke (Frederikshavn Kommune). Thank you very much, --Bob Collowân (talk) 13:29, 26 June 2013 (UTC)

If you're sure about this, replace the content with {{category redirect|Flade Kirke (Frederikshavn Kommune)}} and RussBot will do it after seven days. --Zhuyifei1999 (talk) 13:47, 26 June 2013 (UTC)

Or use User talk:CommonsDelinker/commands.  Hazard-SJ  ✈  22:14, 26 June 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 06:53, 28 June 2013 (UTC)

Thanks for your help. --Bob Collowân (talk) 11:01, 28 June 2013 (UTC)

In galleries of biological organisms, move images categorised as maps into a separate section

There are a large number of galleries of photographs of species. Many have the pictures categorized sensibly into images, maps, video etc (e.g. Ailuropoda_melanoleuca). Others put the maps and images into a single gallery (e.g. Pipistrellus_nathusii). Most of these map images are already categorized as some form of map (i.e. are in a subcategory of Category:Maps, usually in Category:Distributional_maps_of_organisms). It would be useful to move any images categorized as maps into a "Maps" section of the gallery page, creating one if it does not exist already. This would require a bot which searches through gallery pages at the species level, and working out if each image has Category:Maps as a supercategory. Any such images should be moved to a separate section called "Maps", creating such a section if it does not already exist.

My motivation for this is to allow the images to be correctly identified and classified by the Encyclopedia of Life, but this should be generally useful for wikimedia commons visitors too. HYanWong (talk) 16:57, 13 June 2013 (UTC)

We mostly abandon galleries as a mean of organizing the data, so I would not trust them as they are likely out of date. It was a useful tool when we had much less content, but it was mostly unmaintainable. Any process used by the Encyclopedia of Life to identify and classify content should probably be category based. --Jarekt (talk) 17:25, 13 June 2013 (UTC)

Ah, that's interesting. Is that also true for images of biological species? I was under the impression that in this instance, galleries were more hand-vetted than categories: a place to collect a subset of the category images that are deemed examplars, or high quality in some way. If that isn't the case, what methods could be used to a) access a selected set of reasonable quality media for a given species and b) classify those media into maps, sounds, etc etc. I see that there is no classification to, for instance, Category:Ailuropoda_melanoleuca, compared to its gallery page. HYanWong (talk) 19:13, 13 June 2013 (UTC)

I guess I did not work much with biological species categories or galleries, other than categorizing a lot of images without ever looking at the galleries. May be there are people maintaining them. It is probably east to test: grab few dozen random species and compare their category and gallery, and the dates of the recent edits of the gallery. Wikipedia pages might be more up to date source of examplar images and maps. --Jarekt (talk) 03:20, 14 June 2013 (UTC)

Category:Atomic spectra

It seems I can't do this one with VFC. Basically I want to change two things to all Images in the Category:Atomic spectra which were upload by me (McZusatz): Take the first word of the description ( = file name = name of element) ...

• ... and wrap it up with [[Category:***Name of Element goes here***]]
• ... and determine it's number of protons (= atomic number). Use the two digit atomic number and add it as sort key to the [Category:Atomic spectra|***sort key***]. --McZusatz (talk) 18:50, 3 June 2013 (UTC)

• Just noting that I've coded this, and I did a trial with 15 edits (I actually tested them all already), just waiting for approval now.  Hazard-SJ  ✈  03:05, 22 June 2013 (UTC)

Thanks, the edits look fine. Do you need approval for a bot which does less than 100 edits? Also you already did 15 of them. --McZusatz (talk) 11:22, 3 July 2013 (UTC)

• I got the go-ahead last night from russavia, so I'll finish up now.  Hazard-SJ  ✈  03:19, 14 July 2013 (UTC)
  •  Done, it made bout 93 more edits.  Hazard-SJ  ✈  04:45, 14 July 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 06:03, 14 July 2013 (UTC)

Broken redirects

Could a bot, on a regular base, delete all the broken file redirects in Special:BrokenRedirects since Bernsteinbot no longer reports those. --Foroa (talk) 09:05, 25 May 2013 (UTC)

Delete, as in tag for deletion? I could do that.  Hazard-SJ  ✈  03:52, 7 June 2013 (UTC)

Yes but only for file and file talk name space. --Foroa (talk) 10:38, 7 June 2013 (UTC)

Trying, might finish tomorrow. --Zhuyifei1999 (talk) 04:14, 11 June 2013 (UTC)

Which template to mark with? --Zhuyifei1999 (talk) 09:48, 11 June 2013 (UTC)

 Done See Commons:Bots/Requests/YiFeiBot (2), Commons:Deletion requests/2013/06/11. --Zhuyifei1999 (talk) 11:32, 11 June 2013 (UTC)

No need to create extra work. Just insert {{Speedydelete|Broken redirect}} before the redirect. --Foroa (talk) 11:55, 11 June 2013 (UTC)

Should have  Done. I don't know if I have edited File:Headshot 01.JPG or not. The stdout told me that it was edited. --Zhuyifei1999 (talk) 12:42, 11 June 2013 (UTC)

Looks good, you may finish the list. --Foroa (talk) 12:57, 11 June 2013 (UTC)

Little problem: deletion summary does not mention to what it was redirected, which would be much better. --Foroa (talk) 13:24, 11 June 2013 (UTC)

What do you really mean? Shall I add what it is redirecting to to the edit summary? --Zhuyifei1999 (talk) 13:34, 11 June 2013 (UTC)

If you add {{Speedydelete|Broken redirect to}}, as I tried it in File:Headshot 01.JPG, I guess it will appear like that in the deletion edit summary. --Foroa (talk) 14:22, 11 June 2013 (UTC)

 Done as in File:SchildGIFkleiner.gif. But I wonder why I didn't detect File:Headshot 01.JPG? --Zhuyifei1999 (talk) 15:29, 11 June 2013 (UTC)

Far from done: Special:BrokenRedirects. --Foroa (talk) 18:05, 11 June 2013 (UTC)

 Done by retrieving special page instead of API, but how come API didn't detect all? Do we need a more complicated script, since some of the cross outed ones are still broken redirects, or wait till someone regenerates the cache? --Zhuyifei1999 (talk) 01:05, 12 June 2013 (UTC)

Cleaned up some, but many of the ones shown in blue are not necessarily valid redirects. List will be updated tomorrow morning but the problem will not go away. --Foroa (talk) 06:10, 12 June 2013 (UTC)

It's running hourly, so it will mark them as soon as it detects them. --Zhuyifei1999 (talk) 07:10, 12 June 2013 (UTC)

Running it hourly is not a solution. Part of those things used to be reported in Commons:Database reports/Broken redirects but this one seems stalled: User_talk:MZMcBride#BernsteinBot_inactive. Was very handy. Note that in all cases, user hard redirects to another wikipedia need to be replaced by a {{Softredirect}}. --Foroa (talk) 07:37, 12 June 2013 (UTC)

So I should report them to Commons:Database reports/Broken redirects instead? (Not so hard.) --Zhuyifei1999 (talk) 09:09, 12 June 2013 (UTC)

Would probably be a good idea. The list was compiled daily and it included hard redirects to wikipedias, that don't work obviously. --Foroa (talk) 09:19, 12 June 2013 (UTC)

Finish making the script, and now running, but it's quite slow. --Zhuyifei1999 (talk) 10:29, 12 June 2013 (UTC)

Rerunning, some error found. --Zhuyifei1999 (talk) 14:27, 12 June 2013 (UTC)

Got a 500 Internal Server Error, will rerun at 13:00, 14 June 2013 (UTC) --Zhuyifei1999 (talk) 10:00, 14 June 2013 (UTC)

I already have a script running to tag specific broken redirects. I had also planned to do the original request here, but then Zhuyifei1999 came along, so I delayed in responding, to see how things would go. However, it seems there was a plan to move back over to the database report. I'm nos sure how exactly Zhuyifei1999 is getting his results, but it's incomplete. I generated 76 results within 24 hours after his latest report (I'll be working on it, so the numbers might go down by the time you see this), so I could take over this report. I could also take care of the original request if necessary. Could I have a situation update please?  Hazard-SJ  ✈  00:51, 18 June 2013 (UTC)

 Question How do you generate all the redirects? I'm trying RedirectGenerator(use_api=True, namespaces=[ 0 , 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 100 , 101 , 102 , 103 , 104 , 105 , 106 , 107 , 828 , 829 , 1198 , 1199]), but it seems to skip most of the namespaces. --Zhuyifei1999 (talk) 02:28, 18 June 2013 (UTC)

I used the replicated database.  Hazard-SJ  ✈  03:01, 18 June 2013 (UTC)

Like en:Wikipedia:Database reports/Broken redirects/Configuration? I just can't get that working, since it's not pywikipedia. --Zhuyifei1999 (talk) 03:44, 18 June 2013 (UTC)

Okay, would you prefer if I took that over?  Hazard-SJ  ✈  23:04, 19 June 2013 (UTC)

Ok, you take over if your bot runs better (which seems true). --Zhuyifei1999 (talk) 07:25, 20 June 2013 (UTC)

Comment from Foroa (not sure where to put):

 Doing…  Hazard-SJ  ✈  04:16, 22 June 2013 (UTC)

It took many months to weed out all user page hard redirects to external wiki's. Don't know for what reason as some of them they where there since years. --Foroa (talk) 06:30, 20 June 2013 (UTC)

Suggested edit summary when changing user page hard redirects to soft redirects: "Hard redirects don't work between Wikipedia projects" --Foroa (talk) 07:14, 20 June 2013 (UTC)

--Zhuyifei1999 (talk) 10:06, 20 June 2013 (UTC)

This section was archived on a request by:  Hazard-SJ  ✈  06:10, 16 July 2013 (UTC)

Trimming 12pixels off the bottom of images

I am starting a cooperative upload project of photographs with an unfortunate credit bar added to the bottom, that could be removed by a standard process. An initial set of these are at Category:Airliners.net photos (check needed).

I am using Python but running on Leopard (without Xcode) and am fairly limited in tools I can install, so I can use sips for image processing but, so far, have been unable to find a way of trimming these before uploading. Has anyone come up with a standard bot that I can leave a template on the images with the effective instruction "crop the bottom 12 pixels off this image" and it will do that for all those marked? Alternative suggestions welcome. --Fæ (talk) 19:56, 21 June 2013 (UTC)

This might be helpful to you. Also, User:Cropbot does cropping, but it apparently has an interface. Besides, using templates would easily make it too abuse-prone. People could run around tagging unnecessarily.  Hazard-SJ  ✈  02:57, 22 June 2013 (UTC)

Thanks, but I can't install PIL due to dependencies (I think it was my lack of Xcode that was the problem, cannot quite recall as it was last year I tried to install it). If I am stuck on this, I might have to swap to my Windows laptop to have more options, such as PIL. --Fæ (talk) 06:05, 22 June 2013 (UTC)

In that case, assume you're using Python 2, try imageop.crop (it was depreciated in 2.6, and removed in 3).  Hazard-SJ  ✈  16:20, 22 June 2013 (UTC)

Thanks, that was a good suggestion. I have fiddled about with imageop for about 45 minutes, but it's not obvious to me how to get this to work without an example to study/crib from. Rather than spending a lot of time due to the oddities of my install, I'll park this until I have time to get PIL working on my laptop and then run a solution from there (unless another volunteer decides to have a crack at these). There's plenty of time, as I think there is plenty to do before all the potential aviation photographs in question are uploaded. --Fæ (talk) 21:25, 22 June 2013 (UTC)

I started coding this, but I'm having an issue with PIL on my computer. I'll install PIL and test the script on Labs when I get around to it (I'm going offline now), so hopefully all goes well there.  Hazard-SJ  ✈  06:05, 23 June 2013 (UTC)

Thanks for looking at it. I have been marking all the images in Category:Airliners.net photos (check needed) with {{Watermark}}, so the job can be fairly easily specified as "pick all images in <check needed category>, if they have the watermark template then crop the image and remove the watermark template". My uploads are running at 2,600/11,000 done, so I would guess this will take several days to complete. After that, we may have lined up more batches released from this source, so the script would be useful to re-run. --Fæ (talk) 06:27, 23 June 2013 (UTC)

Working I have got PIL running on my windows laptop and ran an initial test on the file File:Boeing 737-8Q8, Air India Express AN1199769.jpg, which looks fine (with a jpeg quality in PIL set at "98"). The bottom 12 pixels seem right to crop, but I have built in a pixel test at (0,height-12) and (0,height-13) as a double check before cropping (i.e. it will reject if the first is not very dark and the second is not above a lightness threshold). Being able to test individual pixels means a more sophisticated test could be used if necessary. I am comfortable that I can easily leave my laptop to run this for all files in the category with the watermark template, and I should be able to get this working either today, or later in the week. The limiting factor is my preference for hacking it out on my (non-PIL) desktop and then having to test it on the laptop. --Fæ (talk) 16:06, 23 June 2013 (UTC)

 Done I have it working, (managed to find time whilst watching the last episode of Engrenages). I am going through the category alphabetically, so you can check the results. The pixel test is skipping some files with dark bottom left corners, but that can be tweaked later.

I have pasted the code at faebot.blog. --Fæ (talk) 11:25, 24 June 2013 (UTC)

This section was archived on a request by:  Hazard-SJ  ✈  06:10, 16 July 2013 (UTC)

Rijksmonumenten

Please add red categories starting with RCE suggested as here to Category:RCE suggested categories. Thank you. --Foroa (talk) 05:42, 25 June 2013 (UTC)

 Done manually (coding and testing would take more time). There seem to be more as here. --Zhuyifei1999 (talk) 06:30, 26 June 2013 (UTC)

Thank you, please do. --Foroa (talk) 07:27, 26 June 2013 (UTC)

And maybe on a regular basis (3 days), add all categories that contain (aircraft) to Category:Unidentified aircraft. --Foroa (talk) 07:31, 26 June 2013 (UTC)

Bot running. For the aircraft thing, is there any example? --Zhuyifei1999 (talk) 09:02, 26 June 2013 (UTC)

And there's a problem that it can't get "next page" automatically, I have to give it an offset to work, so cannot be run regularly. (Or might need to find a way to fix) --Zhuyifei1999 (talk) 09:08, 26 June 2013 (UTC)

 Done --Zhuyifei1999 (talk) 09:42, 26 June 2013 (UTC)

Example: Category:JA304J (aircraft). --Foroa (talk) 10:25, 26 June 2013 (UTC)

All? Including Category:N7470 (aircraft), Category:N905NA (aircraft), which don't seem to be a good idea to be there. --Zhuyifei1999 (talk) 10:43, 26 June 2013 (UTC)

No, all red categories if possible, but as a minimum the ones in Special:WantedCategories. --Foroa (talk) 11:54, 26 June 2013 (UTC)

 Done the ones ended with (aircraft) in Special:WantedCategories.

Some more in Special:WantedCategories

Some more recurring category creations in Special:WantedCategories from bot and mass uploaders, that cost me hours of work per week. Starting with the easy ones.

Categories ending with the name "Land of Valencia": create category with [[Category:Land of Valencia|?]]

Categories containing a file that is categorised in Category:Kharkiv: Create category with [[Category:Kharkiv|?]]

Categories containing a file that is uploaded by User:Open Access Media Importer Bot and hence in Category:Uploaded with Open Access Media Importer: Create category with [[Category:Uploaded with Open Access Media Importer and needing category review]]

For the latter two cases, you only have to check one file in the category. Thank you. --Foroa (talk) 05:55, 27 June 2013 (UTC)

It might be a good idea to create a special subpage that contains the active auto-category creation rules for Special:WantedCategories (updated every 3 days). --Foroa (talk) 06:06, 27 June 2013 (UTC)

For the special page, maybe those developers would do. For the last case, example? For the others,  doing now. --Zhuyifei1999 (talk) 08:18, 27 June 2013 (UTC)

Examples: all categories in Category:Uploaded with Open Access Media Importer and needing category review and the ones in Category:Kharkiv under the question mark.

Bot running: Using Category:Uploaded with Open Access Media Importer and needing category review instead of Category:Uploaded with Open Access Media Importer: Not sure how to detect why it is in the category. --Zhuyifei1999 (talk) 10:40, 27 June 2013 (UTC)

With special page, I mean any separate page that is not emptied by an archive bot. --Foroa (talk) 08:48, 27 June 2013 (UTC)

Still don't understand. Ask Hazard-SJ. --Zhuyifei1999 (talk) 10:40, 27 June 2013 (UTC)

All problems found and fixed. Should be running correctly by now. It takes several hours to finish (if including the last two cases). --Zhuyifei1999 (talk) 06:39, 28 June 2013 (UTC)

Really need to check on Category:Uploaded with Open Access Media Importer as several cats are skipped otherwise. --Foroa (talk) 07:22, 28 June 2013 (UTC)

You mean use Category:Uploaded with Open Access Media Importer instead to identify the category we need? I've just done that. It'll apply on the next run on tool labs (11:45, 28 June 2013 (UTC)). --Zhuyifei1999 (talk) 08:42, 28 June 2013 (UTC)

What about categories that starts with Images from the Geograph British Isles project needing categories in grid ? --Zhuyifei1999 (talk) 11:33, 28 June 2013 (UTC)

Never mind, I've made [[Category:Images from the Geograph British Isles project needing categories by grid square|%s]]\n__HIDDENCAT__\n{{User:Avicennasis/emptycat}} --Zhuyifei1999 (talk) 12:11, 28 June 2013 (UTC)

 Done running once. --Zhuyifei1999 (talk) 23:10, 28 June 2013 (UTC)

I did not notice the Category:Kharkiv ones. --Foroa (talk) 12:08, 1 July 2013 (UTC)

Found none, any false negatives? --Zhuyifei1999 (talk) 13:38, 1 July 2013 (UTC)

There's only 33 medias directly categorized in Category:Kharkiv, the probability of finding one is really low. --Zhuyifei1999 (talk) 14:03, 1 July 2013 (UTC)

Indeed, someone removed all Kharkiv cats, but it should still work when checking for Category:Cultural heritage monuments in Kharkiv. Example: Category:Червоножовтнева, 5. --Foroa (talk) 15:05, 1 July 2013 (UTC)

Shall I recursively detect the medias in Category:Kharkiv?(too dangerous.) Only cultural heritage monuments? --Zhuyifei1999 (talk) 23:26, 1 July 2013 (UTC)

Category:Kharkiv looks fine for now, thank you.

Another one: All categories that contain an image with Category:Images from the Rijksdienst voor het Cultureel Erfgoed: create in Category:Rijksmonumenten places to be classified, no key. --Foroa (talk) 05:33, 2 July 2013 (UTC)

Found none (again), any false negatives for testing? --Zhuyifei1999 (talk) 11:13, 2 July 2013 (UTC)

Category:Smitshoek, Category:Smerp. --Foroa (talk) 11:45, 2 July 2013 (UTC)

Problem found: didn't use API, so only Category:Smitshoek, and Category:Farms in the Netherlands recognized. Now problem fixed and bot running. --Zhuyifei1999 (talk) 02:43, 3 July 2013 (UTC)

 Done Seems ran a few times. --Zhuyifei1999 (talk) 14:04, 3 July 2013 (UTC)

This section was archived on a request by:  Hazard-SJ  ✈  06:11, 16 July 2013 (UTC)

Links to renamed accounts

As some people might have noticed, m:Single User Login finalisation announcement will have the result that certain Commons accounts will be renamed automatically at the end of the month and then automatically reassigned to someone else. For example, there might be an account "User:Example" which is automatically renamed to "User:Example~commonswiki" upon which the user name "User:Example" is reassigned to a user on German Wikipedia. Would it be possible (and acceptable) to get a bot which automatically updates all links to the associated user and user talk pages? Otherwise, we will probably end up with lots of links which point to the wrong user because the user name has been reassigned to someone else, and this can be confusing. Or is the Wikimedia Foundation planning to do this for us as part of the renaming task? --Stefan4 (talk) 13:57, 2 May 2013 (UTC)

I think that would be quite easy on user by user basis, but I am not sure how to do it for all accounts. --Jarekt (talk) 11:31, 7 May 2013 (UTC)

Ah, but we are not talking 'all' accounts, only a limited list of these SUL changes. If the list of old/new account names is available somewhere, then updating all links is do-able by pulling the what links here list for each old account name link. --Fæ (talk) 06:29, 15 May 2013 (UTC

Do we have a list of such "compromisable" accounts? How many are they? --Ricordisamoa 06:53, 14 June 2013 (UTC)

Yes, by just having a list, this could be easily done.  Hazard-SJ  ✈  23:08, 19 June 2013 (UTC)

Mass category-for-discussion help

Please tag the following categories with {{subst:cfd|Category:Music of 1905}}.

Extended content

Music in 1711‎ Music in 1723‎ Music in 1728‎ Music in 1748‎ Music in 1761‎ Music in 1762‎ Music in 1764‎ Music in 1770‎ Music in 1771‎ Music in 1773‎ Music in 1774‎ Music in 1776‎ Music in 1778‎ Music in 1779‎ Music in 1781‎ Music in 1782‎ Music in 1783‎ Music in 1784‎ Music in 1785‎ Music in 1786‎ Music in 1787‎ Music in 1788‎ Music in 1789‎ Music in 1791‎ Music in 1794‎ Music in 1796‎ Music in 1797‎ Music in 1798‎ Music in 1799‎ Music in 1800‎ Music in 1801‎ Music in 1802‎ Music in 1803‎ Music in 1805‎ Music in 1806‎ Music in 1808‎ Music in 1809‎ Music in 1811‎ Music in 1813‎ Music in 1814‎ Music in 1815‎ Music in 1816‎ Music in 1817‎ Music in 1818‎ Music in 1819‎ Music in 1820‎ Music in 1825‎ Music in 1826‎ Music in 1829‎ Music in 1830‎ Music in 1831‎ Music in 1832‎ Music in 1833‎ Music in 1834‎ Music in 1835‎ Music in 1836‎ Music in 1837‎ Music in 1838‎ Music in 1839‎ Music in 1840‎ Music in 1841‎ Music in 1842‎ Music in 1843‎ Music in 1844‎ Music in 1845‎ Music in 1846‎ Music in 1847‎ Music in 1848‎ Music in 1849‎ Music in 1850‎ Music in 1851‎ Music in 1852‎ Music in 1853‎ Music in 1854‎ Music in 1855‎ Music in 1856‎ Music in 1857‎ Music in 1858‎ Music in 1859‎ Music in 1860‎ Music in 1861‎ Music in 1862‎ Music in 1863‎ Music in 1864‎ Music in 1865‎ Music in 1866‎ Music in 1867‎ Music in 1868‎ Music in 1869‎ Music in 1870‎ Music in 1871‎ Music in 1872‎ Music in 1873‎ Music in 1874‎ Music in 1875‎ Music in 1876‎ Music in 1877‎ Music in 1878‎ Music in 1879‎ Music in 1880‎ Music in 1881‎ Music in 1882‎ Music in 1883‎ Music in 1884‎ Music in 1885‎ Music in 1886‎ Music in 1887‎ Music in 1888‎ Music in 1889‎ Music in 1890‎ Music in 1891‎ Music in 1892‎ Music in 1893‎ Music in 1894‎ Music in 1895 Music in 1896‎ Music in 1897‎ Music in 1898‎ Music in 1899‎ Music in 1900‎ Music in 1901‎ Music in 1902‎ Music in 1903‎ Music in 1904‎ Music in 1905‎ Music in 1906‎ Music in 1907‎ Music in 1908‎ Music in 1909‎ Music in 1910‎ Music in 1911‎ Music in 1912‎ Music in 1913‎ Music in 1914‎ Music in 1915‎ Music in 1916‎ Music in 1917‎ Music in 1918‎ Music in 1919‎ Music in 1920‎ Music in 1921‎ Music in 1922‎ Music in 1923‎ Music in 1924‎ Music in 1925‎ Music in 1926‎ Music in 1927‎ Music in 1928‎ Music in 1929‎ Music in 1930‎ Music in 1931‎ Music in 1932‎ Music in 1933‎ Music in 1934‎ Music in 1935‎ Music in 1936‎ Music in 1937‎ Music in 1938‎ Music in 1939‎ Music in 1940‎ Music in 1941‎ Music in 1942‎ Music in 1943‎ Music in 1944‎ Music in 1945‎ Music in 1946‎ Music in 1947‎ Music in 1948‎ Music in 1949‎ Music in 1950‎ Music in 1951‎ Music in 1952‎ Music in 1953‎ Music in 1954‎ Music in 1955‎ Music in 1956‎ Music in 1957‎ Music in 1958‎ Music in 1959‎ Music in 1960‎ Music in 1961‎ Music in 1962‎ Music in 1963‎ Music in 1964‎ Music in 1965‎ Music in 1966‎ Music in 1967‎ Music in 1968‎ Music in 1969‎ Music in 1970‎ Music in 1971‎ Music in 1972‎ Music in 1973‎ Music in 1974‎ Music in 1975‎ Music in 1976‎ Music in 1977‎ Music in 1978‎ Music in 1979‎ Music in 1980‎ Music in 1981‎ Music in 1982‎ Music in 1983‎ Music in 1984‎ Music in 1985‎ Music in 1986‎ Music in 1987‎ Music in 1988‎ Music in 1989‎ Music in 1990‎ Music in 1991‎ Music in 1992‎ Music in 1993‎ Music in 1994‎ Music in 1995‎ Music in 1996‎ Music in 1997‎ Music in 1998‎ Music in 1999‎ Music in 2000‎ Music in 2001‎ Music in 2002‎ Music in 2003‎ Music in 2004‎ Music in 2005‎ Music in 2006‎ Music in 2007‎ Music in 2008‎ Music in 2009‎ Music in 2010‎ Music in 2011‎ Music in 2012‎ Music in 2013‎

I've requested that the entire category tree get renamed, so every category should have the CFD notice. Please note that there's a zero-width character at the end of each category name; I've tried but failed to remove it. Nyttend (talk) 20:32, 21 July 2013 (UTC)

 Doing… --Zhuyifei1999 (talk) 03:42, 26 July 2013 (UTC)

 Done --Zhuyifei1999 (talk) 04:31, 26 July 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 12:15, 26 July 2013 (UTC)

Changing license of many files

I've uplouded many photos with the wrong license (CC BY-SA 3.0 instead of CC BY 3.0 ES),so how can i change their license, instead of editing one by one? --85.130.249.14 09:31, 25 July 2013 (UTC)

This can be done using VisualFileChange. --Leyo 14:14, 25 July 2013 (UTC)

I didn't get how to do it, what is "contributor"? --Dorhi (talk) 10:33, 26 July 2013 (UTC)

1. Make sure you are logged in
2. Click here (suggest you open this in a new browser tab).
3. Click "Proceed"
4. On top, select action "Custom replace"
5. In Pattern to match insert {{cc-by-sa-3.0}}
6. In Text to insert instead insert {{cc-by-3.0-es}}
7. Select one or two files where you would like to test it (the checkboxes behind the numbers).
8. Press the Execute button at the bottom.
9. If everything worked as expected, scroll down as often as required to see all files you want to change, then select all loaded (checkbox on the top) and execute.

-- Rillke^(q?) 10:52, 26 July 2013 (UTC)

Done, thanks! --Dorhi (talk) 12:09, 26 July 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 12:15, 26 July 2013 (UTC)

Adding any file I upload to my personal gallery

Hi. Every time I upload a picture I manually add it to my gallery (which is my main user page). Is there a bot or another tool that can do this automatically? Thanks! --Xicotencatl (talk) 18:40, 4 August 2013 (UTC)

1. If you have a user category and you add this always, you can use OgreBot
2. Gallery tool has an export-a-list feature. Click after your uploads appeared. Only files that were loaded are listed. But you could of couse also link to that gallery directly using {{User gallery}} in your user box or gallery inside {{#babel: directly.
3. Commonist has such a feature.
4. tools:~daniel/WikiSense/Gallery.php sometimes works.
5. If you just want to show your latest uploads, you can transclude {{Special:Listfiles/Xicotencatl|limit=5}}

-- Rillke^(q?) 19:58, 4 August 2013 (UTC)

OK, thank you! --Xicotencatl (talk) 21:01, 4 August 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 10:52, 6 August 2013 (UTC)

Uncategorizing

I need an help for uncategorize my last upload : User:K800i/gallery Tue Aug 06 15:18:32 CEST 2013. All files are in Category:Aubenas-les-Alpes, and should not.

English is not my native language, I can read french, english and spanish. K800i (talk) 14:31, 6 August 2013 (UTC)

Uncategorize from which category? --Zhuyifei1999 (talk) 15:07, 6 August 2013 (UTC)

From Category:Aubenas-les-Alpes, sorry. K800i (talk)

 Done --Zhuyifei1999 (talk) 15:47, 6 August 2013 (UTC)

Vu et  Thank you.. K800i (talk) 15:58, 6 August 2013 (UTC)

You're welcome (sorry but I don't know how to say it in French). --Zhuyifei1999 (talk) 16:20, 6 August 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 16:20, 6 August 2013 (UTC)

Changes seen and approved ;  Thank you. {{Merci}} doesn't exist, but {{Thanks}} displays merci : funny. 88.139.143.8

That's because your interface language is French. --Zhuyifei1999 (talk) 15:03, 7 August 2013 (UTC)

Updating links to local project files (when the image concerned is now at Commons)

There is a list of images which link to files on a local project (but where the file itself is now on Commons) The list (first 2000) :- http://tools.wmflabs.org/bawolff/commons_interwiki_could_be_local.txt

I've attempted to fix a few of these entries manually, but given the sheer numbers of images affected by this issue, I figured a bot would be better to perform this task which is mostly about removing characters from the first portion of an interwiki link.

Can some of the Commons bot writers assist in sorting out what could be done from a technical perspective? Sfan00 IMG (talk) 01:39, 26 July 2013 (UTC)

As a partial solution I’d suggest, when moving from X: to Commons:, to check all inbound links to File:in_question in X: and to X:File:in_question in Commons:, and to ignore the issue of possible links to X:File:in_question from another projects (that may be reliably resolved only with thousands of queries). Incnis Mrsi (talk) 10:01, 26 July 2013 (UTC)

Two comments:

1. Good idea, but File Upload Bot (Magnus Manske) should do that.
2. Not sure the relinking is possible, for:
   1. I can't understand that list.
   2. How do the bot know which kind of link to change to: [[:File:Foo.jpg]] or [[File:Foo.jpg]]

--Zhuyifei1999 (talk) 10:25, 26 July 2013 (UTC)

Populating & updating Commons:List of meta category criteria

I'm interested in improving the list of meta-cat criteria at Commons:List of meta category criteria -- one thing that would be nice to have is a bot to regularly count the number of categories using each criteria, and update that page. If someone is interested, I can give more details. JesseW (talk) 08:27, 19 August 2013 (UTC)

Good news: I'm interested. Bad news: I don't understand most of them. --Zhuyifei1999 (talk) 10:45, 19 August 2013 (UTC)

Well, can you help with the specific request I made above (to count how many categories use each criteria, and populate the table)? JesseW (talk) 03:31, 20 August 2013 (UTC)

Yeah. --Zhuyifei1999 (talk) 12:27, 20 August 2013 (UTC)

 Should have programmed, current output is at User:YiFeiBot/sandbox. I'm going to submit a bot request for now. --Zhuyifei1999 (talk) 14:10, 21 August 2013 (UTC)

Thanks for getting the numbers! I've made a suggestion for possible next steps on Commons talk:List of meta category criteria. Let me know what you think. JesseW (talk) 04:44, 23 August 2013 (UTC) :This section was archived on a request by: JesseW (talk) 04:44, 23 August 2013 (UTC)

Categorizing INSEE-numbered files.

Hello, can someone let a bot categorise the 36,682 insee-numbered files of the Category:Population diagrams of municipalities in France into the corresponding municipality categories. A small percentage of the files have its municipality cat already. And the same question for the insee-numbered files in the lower subcategories of the category: Category:OpenStreetMap maps of communes in France. Here, a larger percentage have its municipality cat already.

A 1-to-1 correspondence of number and name of the 36,682 municipalities is to be found here.

• fr:Projet:Communes de France/Liste des communes (01 à 30)
• fr:Projet:Communes de France/Liste des communes (31 à 60)
• fr:Projet:Communes de France/Liste des communes (61 à 976)
• may-be also fr:Projet:Communes de France/Liste des communes (TOM)

Attention, they contain the wikipédia-names, not yet the commons-cat name.

Is this possible? -Havang(nl) (talk) 14:12, 31 July 2013 (UTC)

Sorry, I don't get it. How to know which category to categorize? --Zhuyifei1999 (talk) 17:29, 31 July 2013 (UTC)

Exemple: in Category:Population diagrams of municipalities in France the bot comes at File:Population - Municipality code 01011.svg. At fr:Projet:Communes de France/Liste des communes (01 à 30) one sees that insee nr 01011 (01011 => look at 1011) corresponds to Apremont (Ain) and hence, the file has to be given Category:Apremont (Ain).

NB: the page fr:Projet:Communes de France/Liste des communes (01 à 30) opens very slowly. --Havang(nl) (talk) 10:05, 1 August 2013 (UTC)

NNB: Maybe the bot can do it by pairs: starting with insee number 30011, the corresponding two files are File:Population - Municipality code 30011.svg and File:Map commune FR insee code 30011.png both files belong to Category:Les Angles (Gard) --Havang(nl) (talk) 10:27, 1 August 2013 (UTC)

 Doing… Shall I uncatgorize it from Category:Population diagrams of municipalities in France? --Zhuyifei1999 (talk) 11:19, 1 August 2013 (UTC)

I think, we should keep the general category for the moment. I did some preparatory job with corresponding full category name and brackets, making red categories blue, see User:Havang(nl)/List 1. I used * for separation, that list is convertible to a table. INSEE has 5 digits, all communes starting with INSEE 01XXX (department Ain) are in that list. As 0 was kept out, the number is restricted to 4 digits. May-be this is helpful. --Havang(nl) (talk) 11:34, 1 August 2013 (UTC)

I prepared already departments 1-6 in User:Havang(nl)/List 1, and 7-12 in User:Havang(nl)/list 2. --Havang(nl) (talk) 11:41, 1 August 2013 (UTC)

What are they for? My script can read them from French Wikipedia using regexes. It'll be finished tomorrow. --Zhuyifei1999 (talk) 14:31, 1 August 2013 (UTC)

Can your script read that INSEE nr 12043, fr:Calmont (Aveyron) does not go into Category:Calmont (Aveyron) but into Category:Calmont-de-Plancatge? In each department there are 3 to 10 of such cat's; I adapted those in my lists. See also fr:Discussion Projet:Communes de France#Demandé: tableau: nr INSEE-nom commune. May-be my doing is superfluous: I can also, after your bot has run, check the red cats for correction. Tell me which of those two methods you prefer.--Havang(nl) (talk) 15:11, 1 August 2013 (UTC)

If you prefer your way, I have no problem with it, but please tell me when you created all the lists, and I'll make the final programming. --Zhuyifei1999 (talk) 15:34, 1 August 2013 (UTC)

The files are so big, that it's easier to do small tranches, and that does me prefer your bot running first. If I overlook files categorised in red, they will be found sooner or later. So go ahead. --Havang(nl) (talk) 16:04, 1 August 2013 (UTC)

Sorry, it's having some delay for some problems with French characters, ASCII and Unicode. Maybe it'll work if using your list.  Fixed --Zhuyifei1999 (talk) 14:20, 2 August 2013 (UTC)

 Running... But I guess the encode error might still happen. --Zhuyifei1999 (talk) 16:46, 2 August 2013 (UTC)

The system works fine. I got back to the list with red cat's, see User:Havang(nl)/List 1‎, which permits me to create the cat in red , make a redirect from the old cat's items, move all and adapt the commons link on WP:fr, all corrections doing at once. See exemple [[Category:Beauregard (Ain) on my contributions list [7]. We choosed the better procedure. .--Havang(nl) (talk) 20:52, 2 August 2013 (UTC)

Thanks. --Zhuyifei1999 (talk) 04:31, 3 August 2013 (UTC)

Category:Files with broken file links

About 1000 NARA .tif images popped up there because they lack their .jpg counterparts. Is it possible for a bot to grab the .tif images, save them as high-quality .jpg and upload them under the same name (just with .jpg instead of .tif)? Doing this by hand takes ages and I don't want to use the easier fix (remove gallery entry for .jpg version). Bot could use the description page of the .tif image with just a slight alteration to the tiff parameter (from yes to no). --Denniss (talk) 22:02, 16 July 2013 (UTC)

Yes, it's possible, and I'm willing to do this. I won't be able to code it immediately, but I'll create a bot request for it now.  Hazard-SJ  ✈  00:32, 17 July 2013 (UTC)

You'll need a test run, or I'll try to take over. --Zhuyifei1999 (talk) 07:48, 17 July 2013 (UTC)

 Programmed, permission to run? --Zhuyifei1999 (talk) 10:01, 17 July 2013 (UTC)

Go ahead and file your request.  Hazard-SJ  ✈  00:15, 19 July 2013 (UTC)

Isn't that something the NARA bot is supposed to do from JPEGs generated by NARA? If the NARA JPEG is imported later, and there is already a JPEG here, who gets the filename? --Closeapple (talk) 22:12, 13 August 2013 (UTC)

The original one, my final script cancelled uploading to existing ones. --Zhuyifei1999 (talk) 04:51, 14 August 2013 (UTC)

Takeover the work of User:DumbBOT

Hi, could another Bot take over the work of DumbBOT (talk · contribs). It seems to be broken since some days. I allready talked to its operator - see here. But as he is not active since 2009, I don't think I will get a reaction. The DumbBOT was creating the daily subcategories of Category:Unknown like Category:Media without a license as of 4 September 2013, Category:Media missing permission as of 4 September 2013 or Category:Media without a source as of 4 September 2013. The last days I created these categories manually, but yesterday I was busy in real live so that now a lot of images sitting in its parent categories. I will try to repair ha manually soon. Bu for the future it would b nice if another bot could create such catgories for the next day before midnight UTC each day. This shlouldn't hopefully not a big deal for a regulaly running bot. Any offers ? Thx in advance. --JuTa 19:28, 4 September 2013 (UTC)

Ok, hot a hard code. --Zhuyifei1999 (talk) 22:52, 4 September 2013 (UTC)

I already have a bot running that creates daily cats. Adding the requested categories to my bot would be trivial. --Dschwen (talk) 23:29, 4 September 2013 (UTC)

And done. --Dschwen (talk) 23:42, 4 September 2013 (UTC)

Just did its first automatic run with the new categories Special:Contributions/DschwenBot --Dschwen (talk) 00:08, 5 September 2013 (UTC)

That was a quick one:) Thx a lot. --JuTa 00:05, 5 September 2013 (UTC)

This section was archived on a request by:  Hazard SJ  21:13, 6 September 2013 (UTC)

Remove {{Metacat}} from pages with {{YearsByMonth}}

{{YearsByMonth}} automatically includes {{Metacat}}, but back in 2010, User:RocketBot added {{Metacat}} to a bunch of those pages, presumably by mistake. Can someone go through and remove them? JesseW (talk) 04:33, 5 September 2013 (UTC)

 Running... (example) --Ricordisamoa 08:02, 5 September 2013 (UTC)

 Completed --Ricordisamoa 08:57, 5 September 2013 (UTC)

This section was archived on a request by: Thank you!JesseW (talk) 03:03, 6 September 2013 (UTC)

Identifying uses of {{MetaCat}}

On Commons_talk:List_of_meta_category_criteria I suggested adding an additional column to the table listing how many of the categories are tagged with {{MetaCat}}. I thought I'd bring that request to a wider audience... JesseW (talk) 04:36, 5 September 2013 (UTC)

Add another parameter to the template? --Zhuyifei1999 (talk) 08:51, 5 September 2013 (UTC)

Trying using User:YiFeiBot/~/pywikipedia/com_metacat_count.py, but the mw:Manual:Text table doesn't exist. --Zhuyifei1999 (talk) 11:09, 5 September 2013 (UTC)

 Loading dump to database. --Zhuyifei1999 (talk) 11:06, 7 September 2013 (UTC)

 Test running... (the source will be public after a successful run)--Zhuyifei1999 (talk) 03:11, 8 September 2013 (UTC)

 Done see if it is correct. BTW, it is an outdated dump about a few days ago. --Zhuyifei1999 (talk) 06:45, 8 September 2013 (UTC)

It looks good, thanks! If you could add a calculated column: # of non-redirect, non-tagged categories, too, that would be nice. JesseW (talk) 05:57, 9 September 2013 (UTC)

 Done --Zhuyifei1999 (talk) 09:10, 9 September 2013 (UTC)

This section was archived on a request by: JesseW (talk) 01:39, 11 September 2013 (UTC)

Fix spelling error

Category:Ten Thousands Buddhas Monastery uses a plural form of the word "Thousand", which does not exist because the word "thousand" is already plural. Thus, "Thousands" is a spelling error that needs to be corrected en masse with a find-and-replace. The spelling error is used in the Commons template on w:Ten Thousand Buddhas Monastery, so when the replace is done, it needs to be changed on the Wikipedia article too. Badon (talk) 05:16, 9 September 2013 (UTC)

Already done with Cat-a-lot by Zhuyifei1999 and updated on the English Wikipedia by McZusatz.  Hazard SJ  23:36, 9 September 2013 (UTC)

This section was archived on a request by:  Hazard SJ  23:36, 9 September 2013 (UTC)

Uploading a high value stream from Flickr (we have template)

The UK Foreign and Commonwealth Office has a high value Flickr stream of 3,500 photos/images some of which we have on Commons already. The files are licenced with a non-derivative licence on Flickr, but we have {{FCO}} which covers all FCO images (being licenced under the {{OGL}}). This is a high value stream, and there are hundreds of articles on a heap of projects which could use some of their images for articles, but given the ND on Flickr, we can't upload it via f2C, etc. Would anyone like to upload this entire stream using {{OGL}}, putting images into Category:Files from Foreign and Commonwealth Office Flickr stream (to check), and I will get onto the categorisation, cleanup, etc of these high value, and much needed images. russavia (talk) 10:01, 21 August 2013 (UTC)

Can you make this section in a nutshell? I hate a huge wall of words. --Zhuyifei1999 (talk) 14:01, 21 August 2013 (UTC)

 Coding...  Hazard-SJ  ✈  02:51, 23 August 2013 (UTC)

Thanks mate, do let me know if I can be of further help with it :) Cheers, russavia (talk) 03:12, 23 August 2013 (UTC)

Commons:Bots/Requests/Hazard-Bot 13  Hazard-SJ  ✈  00:14, 25 August 2013 (UTC)

Overwritten files

In the last days (till next Monday), the anti-overwrite warning in Special:Upload is off. It is needed to check all overwritten files ("new versions") from this period to eleminate mistakes. See Commons:Village pump#Overwrite warning failed! for discussion. --ŠJů (talk) 19:51, 24 August 2013 (UTC)

From when? I need to know the time range when doing a DB query. --zhuyifei1999 (talk) 04:30, 25 August 2013 (UTC)

The VP discussion seems to indicate this was limited to a Javascript problem in the upload wizard (from Bawolff's comment) which is due to be fixed by tomorrow. I would assume nothing else has a problem, such as the API, unless we are alerted otherwise; so this seems to not be something most of our bots would get tripped up by. --Fæ (talk) 06:55, 25 August 2013 (UTC)

To clarify, the problem was only on the old Special:Upload (The script in question was the 'mediawiki.legacy.upload' module) Upload wizard should have been fine, and any api uploads should have been fine. Bawolff (talk) 17:18, 25 August 2013 (UTC)

Copying files from an external website

Hello! I am not sure if this is the right place or not. Because i am not sure if we should request works here for existing bots or to get a bot created. Anyways here we go....

The National Repository of Open Educational Resources, India has got its content open to everyone under CC-BY-SA 3.0 license. The gallery of images can be found over here. Is it possible to get a bot to upload all these images to Commons? There would be some human interfacing required later on for sure; to add description, move files to better names, check if the files fall in our COM:SCOPE, etc. I think there will hardly be any images which would fall outside our scope and vast majority look quite encyclopedic as well. So, is this thing possible? §§Dharmadhyaksha§§ {T/C} 12:00, 21 August 2013 (UTC)

It can be done, but it needs a review. I suggest moving this request to Commons:Batch uploading where batch uploaders hang out (including me).

This site does raise a couple of questions that would need some discussion or investigation. My questions would be:

1. Some of the uploads appear doubtful in terms of copyright, such as this map, this scan, this photo taken in 1942. What assurance do we have that all of the material was the copyright of the uploaders?
2. The website states that images are CC-BY-SA "unless mentioned otherwise". How could we systematically filter those that may not be CC-BY-SA (I have yet to spot an example that was marked in this way)?

--Fæ (talk) 13:40, 21 August 2013 (UTC)

This is going to be tricky. In addition to your examples, I don't think Government of India has rights for images such as these. We will have to review each image either before or after the upload. May be a add images to a category like "Unreviewed images from NROER" first and then allow license reviewers to review it. --Sreejith K (talk) 16:39, 21 August 2013 (UTC)

(Edit conflict)Thanks! Now regarding your questions. The map could very well have been created by them. The scan could also be of a PD image. The Gandhi-Nehru pic of 1942 is actually in PD in India. Now, for the 3rd case, the problem is that our servers are in US and in such cases we can delete these images. Same goes for all images. If found dubious, case by case analysis can be done. All images could be uploaded in small batches and kept in a newly created category which will nest in Category:License review needed. Our reviewers could review each file and then pass it. I would suggest a small batch first of maybe a hundred. And then see what what problems we get. §§Dharmadhyaksha§§ {T/C} 16:44, 21 August 2013 (UTC)

As a batch uploader myself, I think this is unlikely to be picked up as a suitable mass upload project, as the batch uploader would get a lot of personal hassle for knowingly uploading images that fail the precautionary principle (I find that even errors at the level of fewer than 1/1000 give me a lot of grief). If you wish to test out the images, licences and formats to use on Commons with a small sample of 100, I suggest this is done manually a few at a time rather than worrying about automation for the test. In total there around 2,600 images available which is on the small side for batch uploading, and it would be sensible to be able to point to a successful test set as the model, which itself would make the batch upload robust. Alternatively, you might consider a pre-checked list which avoids uploading any image that looks likely to need a more detailed review (such as diagrams, scans from unnamed sources and most portrait photographs). Thanks --Fæ (talk) 06:46, 25 August 2013 (UTC)

Okay! Thanks for your reply. §§Dharmadhyaksha§§ {T/C} 11:53, 26 August 2013 (UTC)

Removing two incorrect parameters

Please remove the following two parameters from all templates that transclude {{Book}}:

| Page         = 
| Data checked = 

See sample edit. --Leyo 08:21, 23 September 2013 (UTC)

If it doesn't cause loss of data, I will do it. --Zhuyifei1999 (talk) 09:37, 23 September 2013 (UTC)

 Coded → Commons:Bots/Requests/YiFeiBot (10) --Zhuyifei1999 (talk) 10:28, 23 September 2013 (UTC)

This should be extended to the file namespace but only after the templates had been fixed and at least 6 hours passed since this run (to get the cats cleaned-up in the background). I've seen too many .djvu files using these wrong parameters in their local book template. Example --Denniss (talk) 11:01, 23 September 2013 (UTC)

ok. --Zhuyifei1999 (talk) 12:45, 23 September 2013 (UTC)

The same job was being coordinated in this discussion. Sorry I did not see this discussion, or I would have dropped a note that I (and possibly others) are done with this task, or coordinate our efforts. All that is left are 90+ files which probably need manual processing. By the way, I am also working on Category:Pages using Artwork template with incorrect parameter, removing "country" parameter and doing other clean up. --Jarekt (talk) 13:10, 27 September 2013 (UTC)

Thanks. Too much time was lost by Commons:Bots/Requests/YiFeiBot (10)… --Leyo 14:11, 27 September 2013 (UTC)

Just approved. This bot-approval delay is seriously too long. --Zhuyifei1999 (talk) 15:13, 27 September 2013 (UTC)

I do not think Commons:Bots/Requests process is very good for small, one time only "find and replace" type of tasks. When I requested my bot flag years ago, I asked for "Help with Jarekt's editing tasks. No scheduled tasks.", and all my 1.9M edits since were all one-time-only tasks done mostly with AWB. And the tasks often evolve as you work on them. For example, in case of Category:Pages using Book template with incorrect parameter, after cleaning up the book templates, I switched to creating new book templates and adding them to the files that often just used {{Book}} directly. --Jarekt (talk) 15:26, 27 September 2013 (UTC)

This section was archived on a request by: Jarekt (talk) 13:10, 27 September 2013 (UTC)

Syncing the categories on NARA files

A lot of NARA files have two copies, one in .jpg and one in .tif format. Many of the .jpg ones have been categorized, while their .tif counterparts remain uncategorized. I'd like to get a bot to sync them up, thereby clearing out a lot of uncategorized images. JesseW (talk) 02:46, 10 August 2013 (UTC)

Any examples? My bot uploaded some of the JPEG files, and Denniss moved and cleaned the page, but I didn't find one which category is changed. --Zhuyifei1999 (talk) 03:50, 10 August 2013 (UTC)

I'm just taking a look, starting with a little bit of passive analysis.

Assumptions:

1. it is fair to find matches to files with the NAIL number and ARC; I am using the normal Commons search API to find matches of any title. If this fails then the search falls back to using the full file title to find variations in the extension name
2. all TIFs of interest are listed in Category:High-resolution TIFF images from the National Archives and Records Administration

Test examples

I have the basics of the script running, which seems to initially show that most files are in sync already. Examples: File:Franklin D. Roosevelt, Eleanor Roosevelt in Hyde Park, New York - NARA - 196710.tif File:Franklin D. Roosevelt, Eleanor Roosevelt in Hyde Park, New York - NARA - 196710.jpg Where Category:Eleanor Roosevelt in group portraits is missing from the TIF. File:Hon. Alexander H. Bailey, N.Y - NARA - 526589.tif add from jpg Category:Black and white photographic portraits of men of the United States File:Hon. Alexander H. Bailey, N.Y - NARA - 526589.jpg add from tif Category:Bailey (surname) File:"A Chinese soldier guards a line of American P-40 fighter planes, painted with the shark-face emblem of the `Flying Tige - NARA - 535530.tif File:Flying tigers.jpg add from tiff: Military aircraft of the Second Sino-Japanese War, Teeth in art, Military uniforms of China, Leggings ... File:A Chinese soldier guards a line of American P-40 fighter planes, painted with the shark-face emblem of the "Flying... - NARA - 535531.tif Happy to start running these changes shortly after a bit more format tweaking, error handling, and a relaxed breakfast. --Fæ (talk) 06:35, 10 August 2013 (UTC)

I have no problem if you run this job, but be aware this category: Category:High-resolution TIFF images from the National Archives and Records Administration: it only apply to TIFF files. --Zhuyifei1999 (talk) 07:10, 10 August 2013 (UTC)

I was assuming that the tiff directory was the key one to sync (i.e. for each tiff in that category and child categories, the script finds files anywhere else with matching ARC and NAIL numbers). I can run through the top level parent using the same script and sniff out tif files more generally.

done Now running, see RecentChanges. I may halt and restart later today as I'm off to visit a gallery for some new exhibitions and would prefer to keep an eye on the script, at least for the first 1,000 or so changes. I am having an occasional erratic drop-out problem, probably related to my terrible TalkTalk noisy line, so I may delve into the fault handling a bit further in a day or two. They are the sort of Python modules handy to reuse, so worth pondering. --Fæ (talk) 09:59, 10 August 2013 (UTC)

Excellent work -- how many {{Uncat}} templates have you removed (you are removing them, yes?) Thanks! JesseW (talk) 01:41, 12 August 2013 (UTC)

This synchronization of categories has been challenged at User_talk:Fæ#Category_syncing_of_NARA_images, so I have halted the process until such a time as a there is a credible consensus to proceed. It would be possible for me to revert the changes made to date, should this be needed though to my knowledge this relatively passive change is neither disruptive to any volunteer project, nor damaging to the educational value of the images. Thanks --Fæ (talk) 07:29, 12 August 2013 (UTC)

Background of the objection: A number of users working on the NARA images have been putting the TIFs into Category:NARA TIF images with categorized JPGs to avoid overwhelming categories with duplicate images. Each TIF is linked from the corresponding JPG, as anyone working with these images will quickly notice, so they are readily findable and available for those who want to work on image enhancement, etc. We find this to be a workable and efficient system with no significant disadvantages, and indiscriminate category syncing undoes this effort.

The issue is primarily the usability of the category displays; flooding them with redundant images is not useful and makes the category displays harder to read and use and thereby makes the images harder to find and compare by visual search. Also, having apparent duplicates in the displays leads to erroneous deletion requests, which consume time and resources. (The principal reasons for using the jpgs rather than the tifs as the primary entry point are a) the jpgs are preferred for use in articles, and b)the full-resolution jpg can still be displayed in a browser (with scrolling) - not as good as the TIF for critical work but still useful and convenient for identifying details useful in categorization and refining descriptions, while the tifs must be downloaded to use at full resolution.) Dankarl (talk) 01:50, 13 August 2013 (UTC)

Dankar -- thanks for informing us of Category:NARA TIF images with categorized JPGs. That does seem like a really sensible way to arrange things. And I think Fæ's bot can still be of use, with only a small change: check both images, put the merged set of categories on the .jpg, and put the .tif in Category:NARA TIF images with categorized JPGs. It would probably be better to make a small template that informs people of the convention, and have that template used, instead of the bare category, to discourage people re-adding categories to the .tif versions. My main goal is to get all the .tifs out of {{Uncat}}, so this should work fine for that. If you and User:Closeapple agree, we can re-start the modified syncing soon. JesseW (talk) 03:06, 13 August 2013 (UTC)

I am happy to do the tweak, when there are a few nods. I'm travelling in a couple of days, so if a consensus takes that long implementing it may be in fits and starts. --Fæ (talk) 08:19, 13 August 2013 (UTC)

I'm fine with that; this was discussed at Category talk:NARA TIF images with categorized JPGs before when people started doing it. It should probably be mentioned somewhere else, but I'm not sure where. I hope the collaboration with NARA is still going on. --Closeapple (talk) 09:19, 13 August 2013 (UTC)

NARA catsync, revised spec

Here's what I think is the requirement for the sync of categories for NARA tiffs, please do comment on this specification if you think anything is missing. I plan to update the script and test it out shortly: --Fæ (talk) 11:38, 13 August 2013 (UTC)

1. The basics of finding existing alternates to a tiff image and all the categories is fine, that can continue.
2. Templates {{Check categories}} {{Uncategorized}} and {{Uncategorized-NARA}} should be removed if categories exist.
3. The sync changes to adding no new categories to tiffs, just to the jpg/jpeg/gif alternatives.
4. No existing categories should be removed from any image.
5. Any tiff file with jpgs found should be added to Category:NARA TIF images with categorized JPGs.
   • Note, based on a short passive preliminary run, this seems to generate quite a lot of matches. Example below.

One additional consideration - the approach is dependent on having the cross-refs between the TIF and JPG versions intact. These were added by the bot during the original upload and are mostly fine, but I have always manually checked for them before adding to Category:NARA TIF images with categorized JPGs. These links may be individual or may be elements of a gallery. If that link-check could be automated it would be a major help. Dankarl (talk) 14:46, 13 August 2013 (UTC)

I may be reading your comment wrongly, but I think you are assuming that I am using the other_versions parameter. My query is a bit smarter than this as I am using the API to call a general Commons id search for the NAIL and ARC numbers (in the image page text), if this succeeds in returning a list of file matches, these are then used as candidates to sync categories (often just returning the tiff and a jpg, but sometimes returning several matches with various titles). If the id search fails to return anything, I then specifically check for the same title using different extensions (tif, jpg, jpeg, JPG, gif) and if I get 2 or more matches, the sync carries on. Your expectations for a link-check may be interesting, perhaps you could explain that further as I don't really understand what is involved. --Fæ (talk) 15:19, 13 August 2013 (UTC)

Sorry to be unclear. I was not referring to your algorithm but to the whole approach of categorizing the JPG and linking the TIFs from there. If the other-versions links have been damaged or omitted somehow, then users might not be able to find the TIFs without a search. So a check for the continued integrity of the links is worthwhile, not to enable this synchronization process but to ensure usability of the result. I can't quote an example but I think i've had to fix one or two links after edit damage.

Unless I missed something that would make such a check redundant... Dankarl (talk) 16:04, 13 August 2013 (UTC)

I suggest we separate this as an improvement/housekeeping for another work request. I can imagine a bot helping to tidy up the other_versions lists (I did something similar in my LACMA uploads) and that does not have much to do with the category improvement so is better kept unbundled. --Fæ (talk) 16:13, 13 August 2013 (UTC)

New run started today using this spec. My access is likely to be limited for several days from tomorrow, so this pause will give an opportunity for any further improvements needed to be discussed before completing the run, probably continuing on Tuesday next week.

There is a backlog of tifs/jpgs that should link to each other. I will take a look at this next week and take care testing out any changes. --Fæ (talk) 07:20, 15 August 2013 (UTC)

Another problem: some of the TIFs you're tagging as having categorized JPGs don't seem to qualify. Some of the JPGs have only hidden categories and are tagged as {{Uncategorized-NARA}} images. Examples include this and this. - Eureka Lott 00:45, 23 August 2013 (UTC)

Thanks for picking that up. The categorization is more than half way through so I suggest that job is left to finish, but I can sort this out retrospectively. I can go back over the category, pick out the matching jpgs and count how many non-hidden categories each one has (I did something similar on Geograph). I can then re-template them with the NARA uncategorized template or stick them in a specific backlog category for attention. In essence, they probably do quality, as the intention is to have a category of tifs where there are jpgs that can have categories added rather than using the tif, they just have not yet had useful categories added; the alternative is to have no idea they exist, at least for those where the alternative_versions parameter has not been filled out. --Fæ (talk) 08:07, 23 August 2013 (UTC)

I have built in a visible/hidden category count which checks that photos are correctly marked with the Uncategorized-NARA template. At the moment this seems to be picking up very few incorrectly marked. I can use the same test to add a special backlog category, though these are already in the backlog at Category:Media from the National Archives and Records Administration needing categories and considering the mere handful of newly identified files, a category intersection would probably be sufficient if anyone wants to track these down. --Fæ (talk) 07:04, 25 August 2013 (UTC)

The NARA category synchronization completed successfully. I would like to revisit the cross-links in each other_versions parameter as many are missing or may not be both ways. As the title formats and layout is not consistent, this may take a bit of testing and jigging about so I am unlikely to get back to it until next month but it probably has value for other projects with duplicate issues (the US Department of Defense uploads from multiple sources come to mind). In the meantime I suggest this thread is archived as the original goals have been met. Thanks --Fæ (talk) 12:47, 10 September 2013 (UTC)

Just for the record - it's sufficient to link from original tif file to orginal jpg (or jpg made from original tif) but no need to install self-links on these image pages (as set up in the oiginal upload). If the original jpg is properly categorized and in sync with the tif, all cats from the tif should be removed and replaced with nara tif with categorized jpg category. --Denniss (talk) 19:10, 10 September 2013 (UTC)

Category:Photographs from Večer (741)

Since a recent update better resolution versions are available from this souce, could a bot do this? It would have to go to source page and find a link to original pic and use it to construct url to better resolution file; for File:12. mednarodni Mariborski slalom (11).jpg follow source link to http://www.podstresje.si/default.asp?kaj=1&id=508798 and find "<img src='podatki/CD-0385\00508798-300.jpg'" (extract 0385\00508798) and reupload the image from http://ris.vecer.com/RISStorage2/bor/vecer2000_pic/CD-0385/00508798f.jpg. --Sporti (talk) 06:40, 13 September 2013 (UTC)

For all of them? --Zhuyifei1999 (talk) 07:06, 13 September 2013 (UTC)

Well almost all (like 95%), for some reason few had high res originally. --Sporti (talk) 07:13, 13 September 2013 (UTC)

 Coding... (reupload all) --Zhuyifei1999 (talk) 07:19, 13 September 2013 (UTC)

 Coded Request submitted at Commons:Bots/Requests/YiFeiBot (7). --Zhuyifei1999 (talk) 10:10, 13 September 2013 (UTC)

Thanks, I see it has been completed. --Sporti (talk) 12:16, 26 September 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 10:38, 8 October 2013 (UTC)

Change sorting of subcategories

Change sorting of subcategories of Category:Volvo loaders to its modelname - e.g. L110E, L120C and so on. Thank you! --|EPO| ^da: 12:53, 16 September 2013 (UTC)

 Done manually.--Zhuyifei1999 (talk) 14:06, 16 September 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 10:38, 8 October 2013 (UTC)

Category:Pages with template loops

Currently filled with thousands of entries. If it doesn't resolve itself within some hours (doesn't seem so) then a nulledit run on all content is required to clean this up. Was obviously caused by someone frickling with {{Cultural Heritage Czech Republic}}. --Denniss (talk) 11:48, 7 October 2013 (UTC)

I would wait few days not few hours. This kink of automatic categories added by templates with large number of transclusions, can take a while to clear. --Jarekt (talk) 18:46, 7 October 2013 (UTC)

This section was archived on a request by: Zhuyifei1999 (talk) 10:38, 8 October 2013 (UTC)