Commons:Batch uploading/Brooklyn Museum

Brooklyn Museum

• Source to upload from:

Official website: only files citing the BY license or “no known copyright restrictions.”

• • Did you observe an URL pattern
  • Do you know whether the site has an API

Yes, they do

• • What else can ease uploading (is the site valid XHTML, WCM they use…)?
  • Did you contact the site owner?

Yes, they know about this and signed a deal with project WikiAfrica/Share Your Knowledge, and there is an OTRS ticket about this. They used to have a bot actually but it can't be accessed anymore.

• Describe the works to be uploaded in detail (audio files, images by …):

At first, we'd like to have the Objects section complete with descriptions, which means almost 4,000 of them, but actually each of them is associated with multiple shots from different angles and radiographs, so there might be around 10,000 items to upload. See some examples in the (hidden) destination category, which is Category:WikiAfrica_Brooklyn_Museum.

• Which license tag(s) should be applied?

Template:WikiAfrica/Brooklyn Museum.

• Is there a template that could be used on the file description pages? Do you think a special template should be created?

See the template Artwork as included in example files. --Elitre (talk) 20:48, 5 October 2012 (UTC)

Opinions

Ok, I will work on it now because the project WikiAfrica/Share Your Knowledge is ending. I got a api key and play around with. I guess it can up to a month to finish the job. But please @Elitre watch the page futhermore if I has questions. --Slick (talk) 17:37, 15 October 2012 (UTC)

Question: I see some objects with not a exact date, like early 20th century [1] or late 19th or early 20th centure [2]. What should happen with these values? Put this value as-is in the date field or is there a special a template for this 'diffuse' values (like the 'sharp' value in date field here)? --Slick (talk) 17:37, 15 October 2012 (UTC) (solved) --Slick (talk) 17:14, 16 October 2012 (UTC)

Question: Import all objects found with the africa* keyword (like your link) or import only objects that are in the 'Arts of Africa' Collections?--Slick (talk) 17:43, 15 October 2012 (UTC)

I crawl the collection and there are only 1568 objects with images (with the search 'africa*' as you suggest). Now I try to downloading the images and metadata with the api. --Slick (talk) 18:30, 15 October 2012 (UTC)

1487 Objects with images in search 'africa*' with a free licence. --Slick (talk) 19:13, 15 October 2012 (UTC)

I'd say, let's go with all the CC-BY and/or “no known copyright restrictions” pictures in the Objects section (please choose the path you find easier). Still, each object should conceal more related pictures, as explained above, and these should be uploaded as well. The template that should be used is linked above. --Elitre (talk) 14:39, 17 October 2012 (UTC)

Question: I suggest to import all available items with a free license, up to ~64000 items. (The africa objects first as requested). I can do it. Any opinions? Does the OTRS Ticket match all or only the africa objects? --Slick (talk) 18:03, 16 October 2012 (UTC)

Please see the answer above. If it is ok for you I'd prefer having the Objects first, so that the museum can furtherly evaluate our work. If everything runs smoothly, then we will proceed with other pictures, provided they have the aforementioned licenses. Can you make an upload test with a few images when you are ready, so we can check if everything is ok? Thanks! --Elitre (talk) 14:39, 17 October 2012 (UTC) PS: the main reason why I refer to African objects is that there are already many files by the BM here. African-related contents should not be on Commons yet, so we don't risk creating dupes. Also, if you find a way to completely exclude the risk, it might help you a lot.

Ok, will start some sample uploads after finish this job, I guess by next week. I writing a short documentation what I doing. --Slick (talk) 17:18, 17 October 2012 (UTC)

Thank you so much, we are so excited. And the how-to page is a real treat. --Elitre (talk) 12:38, 18 October 2012 (UTC) PS: Please notice, the license on their site should be BY, not BY-NC.

I will set the licence and the template like here. I guess thats the right one. --Slick (talk) 19:27, 23 October 2012 (UTC)

Question: Which (main) category / categories the uploads should go to? I can differ the images by Xray and black/white. Are there the wish to add additional categories for x-ray or black/white images? --Slick (talk) 178,17 October 2012 (UTC)

Hi, I'd suggest that in the meantime we use the same categories where previous files uploaded by m.casanova are in. I am no expert but there is a Category:X-rays, I am not sure whether it's ok, but adding more relevant categories is something we can decide after the upload, I can use cat-a-lot for this task. --Elitre (talk) 12:34, 18 October 2012 (UTC)

Trail uploads done. Please check it and give feedback. There is a private hidden category you can find all done. --Slick (talk) 17:45, 30 October 2012 (UTC)

You can see there are additional categories for X-rays and Black & white photographs. --Slick (talk) 17:47, 30 October 2012 (UTC)

BTW, the link to the "Share Your Knowledge" in the licence template is a empty page. Should checked. --Slick (talk) 17:56, 30 October 2012 (UTC)

Hi, we'll take a look ASAP. Thank you, --Elitre (talk) 18:47, 30 October 2012 (UTC)

I think it's perfect. Link corrected (missing w:). Thanks. --M.casanova (talk) 18:51, 30 October 2012 (UTC)

I'm impressed. I really don't know how to thank you, you did an amazing job. Please do go on! 151.42.9.250 09:30, 31 October 2012 (UTC) - Elitre

Sometimes the galleries of "Other_versions" contains broken images. (Example) This is because the other files can not upload because they are already on commons. I cant catch this with the bot, so please cleanup by hand if found. Remove it or or try to search the original name (found on the object website) on commons to find the file that is missing. This can happen too when one image contains more than one object and so it is part of more than one presentations, like this.--Slick (talk) 15:11, 31 October 2012 (UTC)

Maybe there is a solution to find the missing gallery images by script. Will try. Please do not remove the missing gallery images until I have a answer. --Slick (talk) 16:00, 31 October 2012 (UTC)

Done. 2294 images uploaded. (Hint: only pictures of objects that are in the search for 'africa*' in the object section, have the suggested licences and are in the 'Arts of Africa' collection. Cancel all others as requested.). Will work on the 'missing files in galleries' problem now. --Slick (talk) 16:33, 31 October 2012 (UTC)

Many thanks. --M.casanova (talk) 18:00, 31 October 2012 (UTC)

Ok, now there is a bot script working that replace the "other_versions" broken images by the right one. I think will processed all images 'tomorrow'. --Slick (talk) 21:29, 31 October 2012 (UTC)

New request: it is my understanding that there should be more _free_ images from collection Arts of Africa. If so, please run another upload test, we'd be interested in enriching the category. Thanks! --Elitre (talk) 18:04, 1 November 2012 (UTC)

I checked this page (and follow) for all free images. There are 1505 images (of 825 objects) to import. Then the Arts of Africa collection is complete (as far as possible). I think it is not necessary to run a test again, so I will import this if I am ready to start. Destination will be the same categories. --Slick (talk) 18:42, 1 November 2012 (UTC)

as far as the license is the same as above, you're free to go. 151.42.35.174 11:24, 2 November 2012 (UTC)

Done (only the fixup of the missing links in galleries (like in the first part) is still running, but you can work on the images if is necessary) --Slick (talk) 13:46, 2 November 2012 (UTC)

A great work. Many thanks. --M.casanova (talk) 14:06, 2 November 2012 (UTC)

Assigned to	Progress	Bot name	Category
Slick	done	Slick-o-bot	Category:African art in the Brooklyn Museum