User talk:Faidon Liambotis (WMF)

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search
Welcome to Wikimedia Commons, Faidon Liambotis (WMF)!

-- Wikimedia Commons Welcome (talk) 13:16, 29 April 2013 (UTC)[reply]

GWT throttling[edit]

Hi, looking at diff, I'm assuming that Ops have halted the job at this image. From my xml file for this final tranche, it looks like there are around 300 to 320 images left to upload (a very small number left now, out of the 11,000 total run :-)), barring any odd files that were previously skipped for any reason. Any suggestions on how to finish these, perhaps the issue is running these over the weekend?

It would be useful to have a comment about the issue with server stress from Operations, on the glamtools email list for the benefit of the user community, as the outcome here might be a clear understanding of what best practice has to be. -- (talk) 12:50, 11 May 2014 (UTC)[reply]

Hi ! Yes, it was causing issues including an outage again, I'm afraid, so I had to remove your jobs to protect the infrastructure. I actually found 7396 different NYPL unique filenames in the queue over multiple different jobs and I removed all of them. I've notified multimedia@ about my actions, and from what I understand you were previously in discussions with them on the glamtools list and elsewhere about this. I'm hoping that discussion can continue where you left it, with their involvement, as it involves fixing deficiencies with the code rather than just throwing more resources at it. Thanks!
No worries. I'll keep the xml file of the remaining images handy to re-run. I would not be surprised at 7,396 files having been uploaded (having 11,000-ish files in the upload project), but I would be if these were still outstanding for upload as I would only expect the above mentioned c.300 to be outstanding. I look forward to this being talked out on the email list. -- (talk) 14:02, 11 May 2014 (UTC)[reply]