Commons talk:Video2commons

	SpBot archives all sections tagged with {{Section resolved|1=~~~~}} after 10 days and sections whose most recent comment is older than 365 days. For the archive overview, see Special:PrefixIndex/Commons talk:Video2commons/Archive.

Before you file a report, please check whether the following list already includes the problem you have.

Known bugs and common errors

1. Subtitles are not imported https://github.com/toolforge/video2commons/issues/148

   Since circa 2020, subtitles have not been automatically imported even if the option is selected. Unknown cause, possibly bug in codes. Previous discussions: Commons_talk:Video2commons/Archive_2#Youtube_subtitle_not_imported Commons_talk:Video2commons/Archive_2#Not_importing_subtitles_from_youtube.--RZuo (talk) 17:04, 1 January 2023 (UTC)

Error: An exception occurred: APIError: b'toomanyvalues: Too many values supplied for parameter "url"

I get this error: Error: An exception occurred: APIError: b'toomanyvalues: Too many values supplied for parameter "url". The limit is 50.\n[limit: 50;\n lowlimit: 50;\n highlimit: 500;\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]'

I'm trying to import the audio from this YouTube video. Vera ^(talk) 20:28, 1 January 2023 (UTC)

@Vera: Evidently, this worked for you with the upload of File:De Internationale (oudste opname 1925).ogg using bigChunkedUpload 20:46, 1 January 2023.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 03:05, 27 December 2023 (UTC)

Bug 174 - Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)

Bug report: https://github.com/toolforge/video2commons/issues/174 .--RZuo (talk) 17:57, 2 December 2023 (UTC)

An exception occurred: DownloadError: b"ERROR: Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)"

Videos in which it occured:

• https://www.youtube.com/watch?v=ElX-cJtn2FU
• https://www.youtube.com/watch?v=Oz5nw6Xc9jI

RodRabelo7 (talk) 00:34, 1 May 2023 (UTC)

@RodRabelo7: try again now maybe? the code was recently updated.--RZuo (talk) 22:08, 2 June 2023 (UTC)

@RodRabelo7: I managed to upload those videos for you as File:AO VIVO - Presidente Lula assina atos com o governo chinês.webm and File:Lula fala com a imprensa na saída do hotel na China.webm.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 20:57, 11 December 2023 (UTC)

Got the same error too, on this video. – Illegitimate Barrister (talk • contribs), 17:19, 18 June 2023 (UTC)

@Illegitimate Barrister: I got https://www.youtube.com/watch?v=MmUp_2NFEy0 uploaded to File:Soviet Army Parade March "In Defense of the Motherland" (Viktor Runov, 1950) - Марш В защиту Родины.webm for you.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 03:54, 27 December 2023 (UTC)

@RodRabelo7: I got https://www.youtube.com/watch?v=ElX-cJtn2FU uploaded to File:Lula fala com a imprensa na saída do hotel na China.webm and https://www.youtube.com/watch?v=Oz5nw6Xc9jI uploaded to File:AO VIVO - Presidente Lula assina atos com o governo chinês.webm for you.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 00:47, 13 December 2023 (UTC)

Subtitle error, even when subtitles are unchecked

Bug report: https://github.com/toolforge/video2commons/issues/174

Getting this error message even though subtitles are unchecked: "An exception occurred: DownloadError: b"ERROR: Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)" – Illegitimate Barrister (talk • contribs), 11:05, 5 August 2023 (UTC)

I get this error repeatedly. Yann (talk) 19:38, 29 November 2023 (UTC)

YouTube videos that have a livestream chat attached cannot be uploaded

An exception occurred: DownloadError: b"ERROR: Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)"

Even when subtitles are turned off in upload settings, the error still happens. – Illegitimate Barrister (talk • contribs), 06:50, 14 October 2023 (UTC)

Discussion

if you want to download the video onto your devices and then upload, see Commons_talk:Video2commons/Archive_1#v2c_on_Windows_for_Dummies.--RZuo (talk) 17:57, 2 December 2023 (UTC)

@Yann: i tested using yt-dlp on my laptop. ytdlp can download video+audio tracks, no problem.

so now i guess the problem is v2c's setup about subtitles. i havent understood which part of the code handles subtitles and how. i'll investigate a few weeks later if the problem persists.

1 thing to note is, google search says, "JSONDecodeError: Expecting value: line 1 column 1 (char 0)".--RZuo (talk) 17:57, 2 December 2023 (UTC)

i might have found a solution https://github.com/toolforge/video2commons/pull/175#issuecomment-1837231635 . i pushed a fix. RZuo (talk) 20:11, 2 December 2023 (UTC)

@RodRabelo7 @Illegitimate Barrister can you plz try again now? RZuo (talk) 18:22, 11 December 2023 (UTC)

@RZuo: It got uploaded, but the lowest resolution SD version got uploaded even though it was an HD video. – Illegitimate Barrister (talk • contribs), 23:46, 11 December 2023 (UTC)

without links to your files it's hard to debug. RZuo (talk) 11:20, 12 December 2023 (UTC)

@RZuo: One example. – Illegitimate Barrister (talk • contribs), 20:44, 20 December 2023 (UTC)

Telegram group wmcloud

consider reporting potential problems of the servers to https://t.me/wmcloudirc in future. RZuo (talk) 22:18, 2 June 2023 (UTC)

Error: Stuck on "Loading..."

Error: Stuck on "Loading..." – Illegitimate Barrister (talk • contribs), 21:02, 5 June 2023 (UTC)

Care to elaborate? Hard to debug without more information. Chico Venancio (talk) 16:28, 9 June 2023 (UTC)

Can't upload at all. I go onto Video2Commons.toolforge and all I see is the spinning icon and "Loading..." – Illegitimate Barrister (talk • contribs), 16:31, 9 June 2023 (UTC)

Does the browser console show any errors? I certainly cannot reproduce that. Chico Venancio (talk) 16:32, 9 June 2023 (UTC)

Clearing cookies might help as well, since it will force you to re-authenticate with commons. Chico Venancio (talk) 16:37, 9 June 2023 (UTC)

Message: Content Security Policy: The page’s settings observed the loading of a resource at wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=wU1GQKrEoU9e-SQIAAL0 (“default-src”). A CSP report is being sent. – Illegitimate Barrister (talk • contribs), 16:55, 9 June 2023 (UTC)

CSP is set to [Report Only], so it should work. Are you behind any network proxies, by any chance? Proxies may not allow websocket connections to work. Chico Venancio (talk) 17:06, 9 June 2023 (UTC)

I don't think I'm using any proxies. I also get the message: Cookie “v2c-session” does not have a proper “SameSite” attribute value. Soon, cookies without the “SameSite” attribute or with an invalid value will be treated as “Lax”. This means that the cookie will no longer be sent in third-party contexts. If your application depends on this cookie being available in such contexts, please add the “SameSite=None“ attribute to it. – Illegitimate Barrister (talk • contribs), 17:08, 9 June 2023 (UTC)

Weird, all of a sudden it started working for me! Hopefully it stays working, I've got a huge backlog to get done now. – Illegitimate Barrister (talk • contribs), 14:03, 18 June 2023 (UTC)

I've been experiencing this issue for the past three days. File:차세대 미드필더 이승모의 첫 인터뷰!.webm successfully got through, but a different video I tried uploading a few minutes after that never made it. I haven't been able to get through the loading page since. ✗plicit 14:20, 27 June 2023 (UTC)

Stopped working again, darn. – Illegitimate Barrister (talk • contribs), 03:08, 29 June 2023 (UTC)

Huh, for some reason, V2C just won't upload [1]. It gets up to "Cleaning up..." and just gets stuck there. I had no problem uploading another video just moments after trying the aforementioned link. ✗plicit 11:25, 30 July 2023 (UTC)

@Explicit: I ran into a blacklisted filename "(오피셜) FC서울, 미드필더 이승모 영입" and Google Translated it to "(Official) FC Seoul recruits midfielder Seungmo Lee" instead to form File:(Official) FC Seoul recruits midfielder Seungmo Lee.webm.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 03:33, 27 December 2023 (UTC)

@Jeff G.: Thanks! I wonder what the blacklisted word is. I've had no issue with similarly titled videos before. ✗plicit 00:12, 28 December 2023 (UTC)

@Explicit: '(오피셜) FC서울, 미드필더 이승모 영입 An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'\\\'(1, <ExceptionInfo: TaskError(b\\\\\\\'pywikibot.Error: APIError: titleblacklist-forbidden-edit: The title "File:(\\\\\\\\xec\\\\\\\\x98\\\\\\\\xa4\\\\\\\\xed\\\\\\\\x94\\\\\\\\xbc\\\\\\\\xec\\\\\\\\x85\\\\\\\\x9c) FC\\\\\\\\xec\\\\\\\\x84\\\\\\\\x9c\\\\\\\\xec\\\\\\\\x9a\\\\\\\\xb8, \\\\\\\\xeb\\\\\\\\xaf\\\\\\\\xb8\\\\\\\\xeb\\\\\\\\x93\\\\\\\\x9c\\\\\\\\xed\\\\\\\\x95\\\\\\\\x84\\\\\\\\xeb\\\\\\\\x8d\\\\\\\\x94 \\\\\\\\xec\\\\\\\\x9d\\\\\\\\xb4\\\\\\\\xec\\\\\\\\x8a\\\\\\\\xb9\\\\\\\\xeb\\\\\\\\xaa\\\\\\\\xa8 \\\\\\\\xec\\\\\\\\x98\\\\\\\\x81\\\\\\\\xec\\\\\\\\x9e\\\\\\\\x85.webm" has been banned from creation. It matches the following disallowed titles list entry: " .*\\\\\\\\xec\\\\\\\\x98\\\\\\\\xa4\\\\\\\\xed\\\\\\\\x94\\\\\\\\xbc.*"' per the error on screen. Evidently, those are the two characters "오피" which Google Translate to "office".   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 00:19, 28 December 2023 (UTC)

The entire word is "오피셜", which is just Konglish for "official". ✗plicit 03:40, 28 December 2023 (UTC)

Stopped for me, too. Logging out and deleting a 0 byte cookie did not help. On a positive note, we now have transcodes for all four of my video uploads in the past three hours.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 22:31, 11 December 2023 (UTC)

My Chrome Console said the following:

Extended content

Navigated to https://video2commons.toolforge.org/ jquery.min.js:4 XHR finished loading: GET "https://video2commons.toolforge.org/api/csrf". send @ jquery.min.js:4 ajax @ jquery.min.js:4 n.<computed> @ jquery.min.js:4 loadCsrf @ video2commons.min.js:1 init @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 ready @ jquery.min.js:2 J @ jquery.min.js:2 /favicon.ico:1                          GET https://video2commons.toolforge.org/favicon.ico 500 (Internal Server Error) index.js:83 [Report Only] Refused to connect to 'wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=vo70RCXQr37VKmoYAAAT' because it violates the following Content Security Policy directive: "default-src 'self' 'unsafe-eval' 'unsafe-inline' blob: data: filesystem: mediastream: *.toolforge.org wikibooks.org *.wikibooks.org wikidata.org *.wikidata.org wikimedia.org *.wikimedia.org wikinews.org *.wikinews.org wikipedia.org *.wikipedia.org wikiquote.org *.wikiquote.org wikisource.org *.wikisource.org wikiversity.org *.wikiversity.org wikivoyage.org *.wikivoyage.org wiktionary.org *.wiktionary.org *.wmcloud.org *.wmflabs.org wikimediafoundation.org mediawiki.org *.mediawiki.org wss://video2commons.toolforge.org". Note that 'connect-src' was not explicitly set, so 'default-src' is used as a fallback. r.doOpen @ index.js:83 r.open @ index.js:83 r.probe @ index.js:83 r.onOpen @ index.js:83 r.onHandshake @ index.js:83 r.onPacket @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 r.onPacket @ index.js:83 n @ index.js:83 e.decodePayload @ index.js:83 r.onData @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 i.onData @ index.js:83 i.onLoad @ index.js:83 hasXDR.e.onreadystatechange @ index.js:83 XMLHttpRequest.send (async) i.create @ index.js:83 i @ index.js:83 o.request @ index.js:83 o.doPoll @ index.js:83 r.poll @ index.js:83 r.doOpen @ index.js:83 r.open @ index.js:83 r.open @ index.js:83 r @ index.js:83 r @ index.js:83 r.open.r.connect @ index.js:83 r @ index.js:83 r @ index.js:83 r @ index.js:83 checkStatusSocket @ video2commons.min.js:1 checkStatus @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 z @ jquery.min.js:4 (anonymous) @ jquery.min.js:4 load (async) send @ jquery.min.js:4 ajax @ jquery.min.js:4 n.<computed> @ jquery.min.js:4 loadCsrf @ video2commons.min.js:1 init @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 ready @ jquery.min.js:2 J @ jquery.min.js:2 index.js:83 XHR finished loading: GET "https://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=polling&t=OnR3G51". i.create @ index.js:83 i @ index.js:83 o.request @ index.js:83 o.doPoll @ index.js:83 r.poll @ index.js:83 r.doOpen @ index.js:83 r.open @ index.js:83 r.open @ index.js:83 r @ index.js:83 r @ index.js:83 r.open.r.connect @ index.js:83 r @ index.js:83 r @ index.js:83 r @ index.js:83 checkStatusSocket @ video2commons.min.js:1 checkStatus @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 z @ jquery.min.js:4 (anonymous) @ jquery.min.js:4 load (async) send @ jquery.min.js:4 ajax @ jquery.min.js:4 n.<computed> @ jquery.min.js:4 loadCsrf @ video2commons.min.js:1 init @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 ready @ jquery.min.js:2 J @ jquery.min.js:2 jquery.min.js:4 XHR finished loading: GET "https://video2commons.toolforge.org/api/iosession". send @ jquery.min.js:4 ajax @ jquery.min.js:4 n.<computed> @ jquery.min.js:4 (anonymous) @ video2commons.min.js:1 r.emit @ index.js:83 r.emit @ index.js:83 r.onconnect @ index.js:83 r.onpacket @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 r.ondecoded @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 a.add @ index.js:83 r.ondata @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 r.onPacket @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 r.onPacket @ index.js:83 n @ index.js:83 e.decodePayload @ index.js:83 r.onData @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 i.onData @ index.js:83 i.onLoad @ index.js:83 hasXDR.e.onreadystatechange @ index.js:83 XMLHttpRequest.send (async) i.create @ index.js:83 i @ index.js:83 o.request @ index.js:83 o.doPoll @ index.js:83 r.poll @ index.js:83 r.doOpen @ index.js:83 r.open @ index.js:83 r.open @ index.js:83 r @ index.js:83 r @ index.js:83 r.open.r.connect @ index.js:83 r @ index.js:83 r @ index.js:83 r @ index.js:83 checkStatusSocket @ video2commons.min.js:1 checkStatus @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 z @ jquery.min.js:4 (anonymous) @ jquery.min.js:4 load (async) send @ jquery.min.js:4 ajax @ jquery.min.js:4 n.<computed> @ jquery.min.js:4 loadCsrf @ video2commons.min.js:1 init @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 ready @ jquery.min.js:2 J @ jquery.min.js:2 index.js:83 XHR finished loading: GET "https://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=polling&t=OnR3G84&sid=vo70RCXQr37VKmoYAAAT". i.create @ index.js:83 i @ index.js:83 o.request @ index.js:83 o.doPoll @ index.js:83 r.poll @ index.js:83 r.onData @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 i.onData @ index.js:83 i.onLoad @ index.js:83 hasXDR.e.onreadystatechange @ index.js:83 XMLHttpRequest.send (async) i.create @ index.js:83 i @ index.js:83 o.request @ index.js:83 o.doPoll @ index.js:83 r.poll @ index.js:83 r.doOpen @ index.js:83 r.open @ index.js:83 r.open @ index.js:83 r @ index.js:83 r @ index.js:83 r.open.r.connect @ index.js:83 r @ index.js:83 r @ index.js:83 r @ index.js:83 checkStatusSocket @ video2commons.min.js:1 checkStatus @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 z @ jquery.min.js:4 (anonymous) @ jquery.min.js:4 load (async) send @ jquery.min.js:4 ajax @ jquery.min.js:4 n.<computed> @ jquery.min.js:4 loadCsrf @ video2commons.min.js:1 init @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 ready @ jquery.min.js:2 J @ jquery.min.js:2 index.js:83 XHR finished loading: POST "https://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=polling&t=OnR3GEb&sid=vo70RCXQr37VKmoYAAAT". i.create @ index.js:83 i @ index.js:83 o.request @ index.js:83 o.doWrite @ index.js:83 (anonymous) @ index.js:83 (anonymous) @ index.js:83 o @ index.js:83 (anonymous) @ index.js:83 (anonymous) @ index.js:83 e.encodePacket @ index.js:83 i @ index.js:83 i @ index.js:83 c @ index.js:83 e.encodePayload @ index.js:83 r.write @ index.js:83 r.send @ index.js:83 r.flush @ index.js:83 r.sendPacket @ index.js:83 r.write.r.send @ index.js:83 (anonymous) @ index.js:83 r.encode @ index.js:83 r.packet @ index.js:83 r.packet @ index.js:83 r.emit @ index.js:83 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 z @ jquery.min.js:4 (anonymous) @ jquery.min.js:4 load (async) send @ jquery.min.js:4 ajax @ jquery.min.js:4 n.<computed> @ jquery.min.js:4 (anonymous) @ video2commons.min.js:1 r.emit @ index.js:83 r.emit @ index.js:83 r.onconnect @ index.js:83 r.onpacket @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 r.ondecoded @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 a.add @ index.js:83 r.ondata @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 r.onPacket @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 r.onPacket @ index.js:83 n @ index.js:83 e.decodePayload @ index.js:83 r.onData @ index.js:83 (anonymous) @ index.js:83 r.emit @ index.js:83 i.onData @ index.js:83 i.onLoad @ index.js:83 hasXDR.e.onreadystatechange @ index.js:83 XMLHttpRequest.send (async) i.create @ index.js:83 i @ index.js:83 o.request @ index.js:83 o.doPoll @ index.js:83 r.poll @ index.js:83 r.doOpen @ index.js:83 r.open @ index.js:83 r.open @ index.js:83 r @ index.js:83 r @ index.js:83 r.open.r.connect @ index.js:83 r @ index.js:83 r @ index.js:83 r @ index.js:83 checkStatusSocket @ video2commons.min.js:1 checkStatus @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 z @ jquery.min.js:4 (anonymous) @ jquery.min.js:4 load (async) send @ jquery.min.js:4 ajax @ jquery.min.js:4 n.<computed> @ jquery.min.js:4 loadCsrf @ video2commons.min.js:1 init @ video2commons.min.js:1 (anonymous) @ video2commons.min.js:1 i @ jquery.min.js:2 fireWith @ jquery.min.js:2 ready @ jquery.min.js:2 J @ jquery.min.js:2 video2commons.toolforge.org/:1 Uncaught (in promise) Error: A listener indicated an asynchronous response by returning true, but the message channel closed before a response was received

  — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 22:36, 11 December 2023 (UTC)

Task is Pending

It looks like the tool is broken, as my uploads can't get past "task is pending". Elisfkc (talk) 15:36, 7 June 2023 (UTC)

Same. Says "Loading..." forever for me. – Illegitimate Barrister (talk • contribs), 20:06, 8 June 2023 (UTC)

Hard to debug without more information. When it happened? With what file? Was it from a URL or from local upload? Since we have ongoing uploads daily I'd say the tool is not (too) broken. Chico Venancio (talk) 16:31, 9 June 2023 (UTC)

I get the error message: index.js:83 [Report Only] Refused to connect to 'wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=bUNGulxKYfDkwhLOAAMf' because it violates the following Content Security Policy directive: "default-src 'self' 'unsafe-eval' 'unsafe-inline' blob: data: filesystem: mediastream: *.toolforge.org wikibooks.org *.wikibooks.org wikidata.org *.wikidata.org wikimedia.org *.wikimedia.org wikinews.org *.wikinews.org wikipedia.org *.wikipedia.org wikiquote.org *.wikiquote.org wikisource.org *.wikisource.org wikiversity.org *.wikiversity.org wikivoyage.org *.wikivoyage.org wiktionary.org *.wiktionary.org *.wmcloud.org *.wmflabs.org wikimediafoundation.org mediawiki.org *.mediawiki.org wss://video2commons.toolforge.org". Note that 'connect-src' was not explicitly set, so 'default-src' is used as a fallback. – Illegitimate Barrister (talk • contribs), 17:21, 9 June 2023 (UTC)

That issue seems to be fixed, but now I am getting "An exception occurred: AttributeError: b"module 'pywikibot.data.api' has no attribute 'APIError'"". Elisfkc (talk) 16:40, 13 June 2023 (UTC)

It indicates there was an API error with the upload (from mediawiki). I just fixed an issue so the error message will be more specific, like pywikibot.exceptions.UploadError: exists-normalized: File exists with different extension as or pywikibot.exceptions.UploadError: was-deleted. Chico Venancio (talk) 20:22, 13 June 2023 (UTC)

Ok, I'm now getting "An exception occurred: AttributeError: b"module 'pywikibot' has no attribute 'Error'"". I am trying to upload a video from YouTube at the moment, specifically this one. I am also trying to upload a couple of videos from Facebook, such as this one. Elisfkc (talk) 16:38, 14 June 2023 (UTC)

A problem with deploying changes resurrected that one. Should be fixed. Chico Venancio (talk) 22:29, 14 June 2023 (UTC)

Thanks, it works now! It does seem to not be uploading the captions that came with the YouTube video. Any way that can be fixed too? Elisfkc (talk) 04:13, 15 June 2023 (UTC)

@Elisfkc: You had File:President Biden Welcomes the Kansas City Chiefs to the White House.webm deleted?   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 20:29, 11 December 2023 (UTC)

File is at File:President Biden Welcomes the 2022 Kansas City Chiefs to the White House.webm Elisfkc (talk) 03:01, 15 December 2023 (UTC)

Weird, all of a sudden it started working for me too! Hopefully it stays working, I've got a huge backlog to get done now. – Illegitimate Barrister (talk • contribs), 14:03, 18 June 2023 (UTC)

I've had the same error for a couple of days, but it worked smooth in June. Weird! TaronjaSatsuma (talk) 18:04, 5 July 2023 (UTC)

@Elisfkc, Illegitimate Barrister, and TaronjaSatsuma: it's moving now again. RZuo (talk) 14:38, 7 July 2023 (UTC)

@Jeff G. I think it may have been a case of me trying to get the captions or something. I'll look later. Elisfkc (talk) 20:05, 14 December 2023 (UTC)

I'm having that "Your task is pending..." issue right now, trying to upload a quite short and small (40 MB) video. Uploading the video itself seems to work, then I can add the description, but it's getting stuck at "Your task is pending..." Gestumblindi (talk) 21:42, 20 July 2023 (UTC)

I see the same. Today and for last several days. Sneeuwschaap (talk) 11:53, 24 July 2023 (UTC)

To my surprise, video2commons actually finished my pending task now, and uploaded the file (File:Hsb brocken pfingsten 2023.webm) - more than a week later! Gestumblindi (talk) 19:34, 28 July 2023 (UTC)

"Something went terribly wrong"

Got another error:

Something went terribly wrong, and we failed to find the cause automatically. Please file an issue in GitHub.

Please file an issue in GitHub: Traceback (most recent call last): File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1519, in full_dispatch_request return self.finalize_request(rv) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1540, in finalize_request response = self.process_response(response) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1888, in process_response self.session_interface.save_session(self, ctx.session, response) File "/data/project/video2commons/www/python/src/../../../video2commons/frontend/redisession.py", line 89, in save_session self.redis.delete(self.prefix + session.sid) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 1567, in delete return self.execute_command('DEL', *names) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 901, in execute_command return self.parse_response(conn, command_name, **options) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 915, in parse_response response = connection.read_response() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/connection.py", line 756, in read_response raise response redis.exceptions.ResponseError: MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.

19:37, 30 June 2023 (UTC) – Illegitimate Barrister (talk • contribs), 19:37, 30 June 2023 (UTC)

Broken

Hi fellows! A friend is reporting that for at least 2 days the v2c in browser states "Your task is pending...". Could someone check this? Thanks! Ixocactus (talk) 21:02, 24 July 2023 (UTC)

I and others have noticed this as well, see above. It seems that this important tool is in a poor state and poorly mantained, as it seems to be broken more often than not... Gestumblindi (talk) 18:15, 27 July 2023 (UTC)

Ops. Thanks Gestumblindi, sorry for duplication. Now the tool is back. But I agree that this need more technical support. Cheers. Ixocactus (talk) 05:28, 28 July 2023 (UTC)

Was broken for me earlier but back again, hopefully it stays working. – Illegitimate Barrister (talk • contribs), 11:06, 5 August 2023 (UTC)

For me, it has once against been stuck on "Loading..." for a week now. I wonder why the tool works for some and not for others? Anyway, I'm curious about something to someone who has access to a functioning V2C. Would anyone be able to provide a direct link to the "Add task" function? I wonder if this could work as a loophole to get me past the loading page and somehow allow me to upload videos anyway. ✗plicit 00:18, 6 August 2023 (UTC)

Same above I got. It broke itself and failed to load after uploading a video. - The Harvett Vault | he/him | user | talk - 07:26, 12 August 2023 (UTC)

An exception occurred

DownloadError: b'ERROR: \r[download] Got error: HTTP Error 403: Forbidden. Giving up after 10 retries' Kelly The Angel (talk) 09:15, 16 August 2023 (UTC)

i dont understand, why File:A walk with the Tigress.webm could be imported from youtube today. mine from youtube gets this error for a few days now. RZuo (talk) 20:23, 18 August 2023 (UTC)

probably an error from ytdlp, similar to https://github.com/ytdl-org/youtube-dl/issues/3721 . RZuo (talk) 20:26, 18 August 2023 (UTC)

On uploading: this video with this URL, I got the error:

An exception occurred: DownloadError: b'ERROR: \r[download] Got error: HTTP Error 403: Forbidden. Giving up after 10 retries'

Noting, this is the same as above. JimKillock (talk) 12:50, 19 August 2023 (UTC)

YTDL is working for me for the videos failing here, so using that is a possible workaround, if far less convenient. Is there any way to check how up to date the YTDL version is that Video2commons is using? JimKillock (talk) 08:43, 20 August 2023 (UTC)

it was recently switched to ytdlp, so it's not ytdl anymore.

i'm having the same problem with https://www.youtube.com/watch?v=-y8G7ID9aM8 . i dont understand why some other videos from youtube could be uploaded in the mean time. RZuo (talk) 07:43, 26 August 2023 (UTC)

Do we know which version of YTDLP it is using? If we can compare with CMD line results and verify it is the same we can at least report the problem to YTDLP. Or, if YTDLP is working, we can ask for it to be updated here? JimKillock (talk) 12:19, 26 August 2023 (UTC)

@RZuo: I managed to get File:Barmont Maple in Huntsville prepares for maple syrup production.webm uploaded for you.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 19:58, 11 December 2023 (UTC)

@JimKillock: It appears that you already got this video uploaded as File:Michāēl coquus est - Mike is a cook - 60 Latin mini-stories -1.webm via https://tubulus.openlatin.org/videos/watch/cRGX31ijTWChUzn44uZeph .   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 03:48, 27 December 2023 (UTC)

Same problem, tried 5 different videos. – Illegitimate Barrister (talk • contribs), 09:33, 6 September 2023 (UTC)

Video2commons is broken more often than not, I think, and apparently, there's nobody available for the thorough fixing / revision this tool would need... Gestumblindi (talk) 17:57, 6 September 2023 (UTC)

For some reason this bug only applies to YouTube. This tool works perfectly with Archive.org, Aparat and Odnoklassniki. Kelly The Angel (talk) 04:47, 8 September 2023 (UTC)

It shows this error Download failed. creating YoutubeDL instance without local cache. However, youtube-dl currently doesn't seem to work anymore. Yt-dlp at the latest version still works fine and seems to be better anyway by now so maybe it should be swapped for yt-dlp?

Until that is done, you can download videos with yt-dlp using commands of uploads in this new cat: Category:Videos downloaded with yt-dlp with command included. Prototyperspective (talk) 16:57, 9 September 2023 (UTC)

afaicu, v2c has been using ytdlp since april 2023 https://github.com/toolforge/video2commons/pull/162 . RZuo (talk) 19:43, 9 September 2023 (UTC)

Thank you - if we know what version of YTDLP is used by v2c then we can check if it is a bug at YTDLP, tho, and ask someone to simply upgrade YTDLP here. YTDLP is in a constant cat and mouse game with YT shifting its formats, one would expect. Is anyone able to find this out? JimKillock (talk) 10:33, 10 September 2023 (UTC)

Just a note: if yt-dlp is used, then why did the error "..creating YoutubeDL instance.."? Prototyperspective (talk) 10:45, 10 September 2023 (UTC)

I expect that is just the message given by v2c and it hasn't been updated? As YTDL and YTDLP are forks of the same project they probably got swapped out behind the scenes with not too much work, and whatever messages v2c gives us at the frontend were perhaps not changed? Your code snippet linked seems to bear this out, the code references "ytdlp" (dl = yt_dlp.YoutubeDL(params)). JimKillock (talk) 10:49, 10 September 2023 (UTC)

I'm still getting the same error, though it seems there have been other successful uploads recently [2]. John P. Sadowski (NIOSH) (talk) 03:54, 22 September 2023 (UTC)

No recent successful uploads. This tool seems to be completely broken☹️ Kelly The Angel (talk) 13:20, 9 October 2023 (UTC)

I managed to upload some videos, however despite being HD they were uploaded in 144p (again, despite being UHD/HD). – Illegitimate Barrister (talk • contribs), 23:12, 9 October 2023 (UTC)

File:Inside a McDonald's restaurant in 1984.webm, for example? Transcode status on the page says "Error on 23:07, 9 October 2023"; maybe rather a Commons than a Video2commons issue in this case... Gestumblindi (talk) 09:50, 10 October 2023 (UTC)

@Illegitimate Barrister: I managed to add resetting the transcodes for two formats on that file to the job queue. I also managed to upload File:Inside a McDonald's restaurant in 1984 (larger).webm to replace it (this tool won't let me overwrite).   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 19:50, 11 December 2023 (UTC)

Error: Unable to download webpage

I wanted to upload a freely-licensed video (https://newsmediab.tasnimnews.com/Tasnim/Uploaded/Video/1402/03/02/1402030214310229727644641.mp4), but I got the following error:

Error: An exception occurred: DownloadError: b"ERROR: [generic] None: Unable to download webpage: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1123)> (caused by URLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1123)')))"

Is there anything I can do? HeminKurdistan (talk) 15:04, 28 September 2023 (UTC)

@HeminKurdistan: Did you try to report that to tasnimnews.com?   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 12:52, 13 February 2024 (UTC)

@Jeff G. No. Is the problem with them? HeminKurdistan (talk) 11:38, 23 February 2024 (UTC)

@HeminKurdistan: It appears so, they are responsible for their SSL certificate.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 08:07, 26 February 2024 (UTC)

Stalled

Hi, I imported 3 small videos yesterday (around 20s each), and I still get "Your task is pending". Any idea? Yann (talk) 12:45, 4 October 2023 (UTC)

I managed to upload some videos, however despite being HD they were uploaded in 144p (despite being UHD/HD). – Illegitimate Barrister (talk • contribs), 23:12, 9 October 2023 (UTC)

Same issues of Illegitimate Barrister from me. --A1Cafel (talk) 09:26, 15 October 2023 (UTC)

Stuck

Hello! I've been trying to upload some rather large videos for the past 2 days. They're 1.5gb ~20 min long. Well, it's just 1 video but I've tried uploading in all 3 different formats, trying to make it work. Nothing works. The tasks have been pending since forever and no progress is made no matter how much I wait. What could be going on? Should I maybe just wait even more? (I've tried waiting for longer than 24 hours.) Any help would be appreciated. - Klein Muçi (talk) 11:23, 5 October 2023 (UTC)

I managed to upload some videos, however despite being HD they were uploaded in 144p (despite being UHD/HD). – Illegitimate Barrister (talk • contribs), 23:12, 9 October 2023 (UTC)

Bug 173 - Youtube videos uploaded in bad resolution (often 144p)

Bug Report: https://github.com/toolforge/video2commons/issues/173

I uploaded some videos, however despite being HD they were uploaded in 144p (despite being UHD/HD). – Illegitimate Barrister (talk • contribs), 23:13, 9 October 2023 (UTC)

Same issues from me. --A1Cafel (talk) 09:25, 15 October 2023 (UTC)

Phew, at least it's not just me. ✗plicit 03:58, 18 October 2023 (UTC)

Same problem with File:Gone with the Wind and the Lies America Tells- Sarah Churchwell in conversation.webm Kelly The Angel (talk) 13:54, 27 October 2023 (UTC)

It has been fixed, but issues seem to be occurred again. --A1Cafel (talk) 15:57, 8 November 2023 (UTC)

Hi, I got this issue too with 2 videos: File:Popeye the Sailor - Aladdin and His Wonderful Lamp (1939) (Remastered HD).webm and File:POPEYE THE SAILOR MAN- Aladdin and His Wonderful Lamp (1939) (Remastered) (HD 1080p) - Margie Hines.webm. Yann (talk) 15:45, 25 November 2023 (UTC)

And this is not a one-time glitch, but a serious lasting issue. It happened again with the same video. Yann (talk) 18:04, 25 November 2023 (UTC)

Another example today. – Illegitimate Barrister (talk • contribs), 10:43, 30 November 2023 (UTC)

This is a recurrent issue, so I created Category:Videos with bug 173. Yann (talk) 12:30, 30 November 2023 (UTC)

i found the problem and wrote on github.

basically, youtube now has various Youtube Format IDs. our old default "vp9" now only refers to 144p.

someone needs to code up the solution. i dont have time for now.--RZuo (talk) 14:58, 30 November 2023 (UTC)

i gave a basic fix, pending commit. RZuo (talk) 15:23, 30 November 2023 (UTC)

Some videos can be uploaded, and the smaller the more chances they get through. Surprisingly, some long HR videos got uploaded, i.e. File:Beat the Devil (H. Bogart - G. Lollobrigida, 1953) HD.webm: 1 h 29 min 20 s, 1,280 × 720 pixels, 1.34 Mbps overall, file size: 855.16 MB. Yann (talk) 21:56, 1 December 2023 (UTC)

@Yann: Could that be because it came from dailymotion.com?   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 03:57, 2 December 2023 (UTC)

@Jeff G.: I also got one from YT: File:The Chase (1946) by Arthur Ripley.webm. Yann (talk) 10:51, 2 December 2023 (UTC)

Looks completely random AFAICT.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 11:14, 2 December 2023 (UTC)

@Yann err... the file has an intro by a modern guy, but no youtube cc licence or pd declaration. i think you need to cut it. RZuo (talk) 14:02, 2 December 2023 (UTC)

and for why it could be downloaded in high resolution. it doesnt have a vcodec of "vp9", so v2c chose the best video track possible (ID 137), i guess.

Extended content

[youtube] GSun8gB92es: Downloading webpage [youtube] GSun8gB92es: Downloading ios player API JSON [youtube] GSun8gB92es: Downloading android player API JSON [youtube] GSun8gB92es: Downloading m3u8 information [info] Available formats for GSun8gB92es: ID EXT RESOLUTION FPS CH | FILESIZE TBR PROTO | VCODEC VBR ACODEC ABR ASR MORE INFO --------------------------------------------------------------------------------------------------------------------- sb2 mhtml 48x27 0 | mhtml | images storyboard sb1 mhtml 80x45 0 | mhtml | images storyboard sb0 mhtml 160x90 0 | mhtml | images storyboard 233 mp4 audio only | m3u8 | audio only unknown [en] Default 234 mp4 audio only | m3u8 | audio only unknown [en] Default 139 m4a audio only 2 | 33.19MiB 49k https | audio only mp4a.40.5 49k 22k [en] low, m4a_dash 140 m4a audio only 2 | 88.08MiB 129k https | audio only mp4a.40.2 129k 44k [en] medium, m4a_dash 251 webm audio only 2 | 74.57MiB 110k https | audio only opus 110k 48k [en] medium, webm_dash 17 3gp 176x144 6 1 | 52.34MiB 77k https | mp4v.20.3 mp4a.40.2 22k [en] 144p 269 mp4 256x144 26 | ~140.35MiB 201k m3u8 | avc1.4D400C 201k video only 160 mp4 256x144 26 | 43.23MiB 64k https | avc1.4D400C 64k video only 144p, mp4_dash 230 mp4 640x360 26 | ~555.27MiB 797k m3u8 | avc1.4D401E 797k video only 134 mp4 640x360 26 | 167.47MiB 246k https | avc1.4D401E 246k video only 360p, mp4_dash 18 mp4 640x360 26 2 | 260.96MiB 375k https | avc1.42001E mp4a.40.2 44k [en] 360p 605 mp4 640x360 26 | ~450.23MiB 646k m3u8 | vp09.00.21.08 646k video only 22 mp4 1280x720 26 2 | 644.39MiB 925k https | avc1.64001F mp4a.40.2 44k [en] 720p 232 mp4 1280x720 26 | ~ 1.76GiB 2591k m3u8 | avc1.64001F 2591k video only 136 mp4 1280x720 26 | 541.82MiB 796k https | avc1.64001F 796k video only 720p, mp4_dash 270 mp4 1920x1080 26 | ~ 3.40GiB 5003k m3u8 | avc1.640028 5003k video only 137 mp4 1920x1080 26 | 1.04GiB 1561k https | avc1.640028 1561k video only 1080p, mp4_dash

RZuo (talk) 15:11, 2 December 2023 (UTC)

1. File:Gone with the Wind and the Lies America Tells- Sarah Churchwell in conversation.webm
2. File:POPEYE THE SAILOR MAN- Aladdin and His Wonderful Lamp (1939) (Remastered) (HD 1080p) - Margie Hines.webm
3. File:Suspect Tased After Attempting To Steal a Corvette From a Valet Parking Agent.webm

for these videos yall linked above, when you go to youtube and pick the quality (resolution), you will see an option "1080p premium". i guess we can assume all such videos will have this problem. videos without this dont have this problem (for now).

the problem is https://gist.github.com/MartinEesmaa/2f4b261cb90a47e9c41ba115a011a4aa#high-video-quality-of-video-only . nobody knows if they will roll this out to all videos.

i already gave a fix that will stop selecting video tracks based on vcodec (numbers like vp09.00.51.08), waiting for it to be committed on github. RZuo (talk) 14:13, 2 December 2023 (UTC)

Scope of damage

1. Affects other videos (not only 144p)

for https://www.youtube.com/watch?v=ZZOovh7cKSI , yt-dlp shows the best track with vcodec "vp9" is only 1280x720, but other tracks can go up to 2160p.

i uploaded File:Nobu Okada Interview 2019.webm on 7 July 2023. it's down from 1080p to 360p. maybe problem like this has been around for a while, but we might not have noticed if it's not so bad as 144p.--RZuo (talk) 06:50, 3 December 2023 (UTC)

https://commons.wikimedia.org/w/index.php?sort=create_timestamp_desc&search=filetype%3Avideo+fileheight%3A%3C222+youtube+incategory%3A%22Uploaded+with+video2commons%22

potentially affected videos (fileheight<222). RZuo (talk) 10:14, 3 December 2023 (UTC)

Right. The oldest I could find with this bug is File:Helicopter Footage Shows High-Speed Chase of Florida Man Wanted in Doctor's Stabbing.webm, uploaded on October 10th.--Yann (talk) 12:00, 3 December 2023 (UTC)

sadly, no. 😂

File:Rosie the Therapy Dog.webm

File:Pet therapy teams make a difference to Lakeview Hospice patients.webm

File:Nobu Okada Interview 2019.webm 7 July 2023

(╯°□°）╯︵ ┻━┻ --RZuo (talk) 12:13, 3 December 2023 (UTC)

OK, I added 2 in the category, but I don't see any higher resolution for File:Pet therapy teams make a difference to Lakeview Hospice patients.webm. Yann (talk) 12:24, 3 December 2023 (UTC)

youtube has 480p. here 360p. RZuo (talk) 12:33, 3 December 2023 (UTC)

Ah yes, right. I reuploaded this video, and it is now OK. Yann (talk) 13:12, 3 December 2023 (UTC)

Idem for File:Rosie the Therapy Dog.webm. Yann (talk) 13:27, 3 December 2023 (UTC)

thx a lot! you doing this merging page trick is much easier than if i do download and overwrite. RZuo (talk) 13:40, 3 December 2023 (UTC)

File:Nobu Okada Interview 2019.webm OK now. V2C works fine here, so the issue for these videos was a different one. Yann (talk) 14:15, 3 December 2023 (UTC)

it's the same problem. i wrote on github.

basically, the problem is, if the track that has vcodec=vp9 is inferior, v2c still picks it, because it's designed to prioritise in this order: codec > extension > resolution.

i think this certainly is not correct. we should prioritise resolution (quality), then codec and extension. RZuo (talk) 14:53, 3 December 2023 (UTC)

and v2c uploads them in highest resolution now, because all the tracks dont have vcodec=vp9 anymore, so it defaults to picking the best track as set by yt-dlp's parameter "bestvideo". RZuo (talk) 15:24, 3 December 2023 (UTC)

@Yann How did you do that? The merging trick, i mean. MilkyBoba (talk) 06:44, 11 December 2023 (UTC)

The process is 1. Deleting the destination name, 2. Renaming the file, 3. Undeleting the deleted file. Yann (talk) 09:20, 11 December 2023 (UTC)

@Yann So.. only an admin that is able to do that? MilkyBoba (talk) 10:33, 11 December 2023 (UTC)

Yes. You request a merge on Commons:History merging and splitting/Requests‎. Yann (talk) 10:43, 11 December 2023 (UTC)

@RZuo: I managed to upload https://www.youtube.com/watch?v=ZZOovh7cKSI to File:Cremyll Ferry, Plymouth, UK (4K, 60 FPS, 2023.04.07).webm for you.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 04:34, 27 December 2023 (UTC)

2. Problem intensified probably around Aug 2023

this problem might have become more common due to YouTube rolling out "‘enhanced’ 1080p for Premium subscribers" to desktop in aug 2023.--RZuo (talk) 12:13, 3 December 2023 (UTC)

References

Summary

Cause

A Youtube video typically has various video and audio tracks. For each track, there is a string called "VCODEC" or "VBR ACODEC".

The current way v2c selects which tracks to upload is:

        'bestvideo[vcodec={{vcodec}}][filesize<{max}]+'
        'bestaudio[acodec={{acodec}}]/'
        'bestvideo[ext={{vext}}][filesize<{max}]+'
        'bestaudio[ext={{aext}}]/'
        'bestvideo+bestaudio/best'

Assuming you choose the default "webm (VP9/Opus)". This means, the code will first select the best track with vcodec=vp9; only if no track has vcodec=vp9, will it select the best tract with ext=webm; and so on. Sometimes, tracks with vcoded=vp9 are not the best resolution, then v2c ends up uploading these worse tracks. (Sometimes, no track has vcodec=vp9, then v2c selects tracks based on the next criteria and uploads good tracks.)

Affected videos

This bug has affected youtube videos uploaded since Jul 2023 (earliest we have found so far). Many videos were uploaded in 144p, but the bug has also let videos be uploaded in less optimal resolutions but not 144p. See #Scope of damage for more details.

What you should do

I have pushed fixes on github, waiting for commit. If you can code, please help out on github. I am a novice in coding.

You can wait and not use v2c for now. We will notify you once this bug is fixed.

You can also use yt-dlp to check a video ( yt-dlp -F URL ). If no track, or the best track, has vcodec=vp9, you can safely use v2c.

For affected videos, append Category:Videos with bug 173 if not already done so. You can also fix it by yourself:

1. download from youtube to your device
2. overwrite the problematic file with the local file on your device (you might need User:Rillke/bigChunkedUpload.js).

--RZuo (talk) 08:08, 3 December 2023 (UTC)

@RZuoThanks a lot for the investigation and PR. I have merged and deployed it, on my tests it does seem to fix the issue. Chico Venancio (talk) 18:27, 11 December 2023 (UTC)

@Chicocvenancio thank you so much Chico for always getting v2c back to work! RZuo (talk) 18:32, 11 December 2023 (UTC)

@RZuo I can't overwrite my files, and i got "This file is bigger than the server is configured to allow." error; MilkyBoba (talk) 03:38, 2 January 2024 (UTC)

@MilkyBoba how big is your file? Commons:Maximum file size is 4 GiB (4,294,967,296 bytes). RZuo (talk) 06:45, 2 January 2024 (UTC)

Stuck in loading

It's been a few days that Video2commons gets stuck indefinitely in loading after I log in. Any such experience? HeminKurdistan (talk) 18:09, 26 October 2023 (UTC)

Audio cut off

I just uploaded this file using Video2commons:

File:ARRL 2023 CW Sweepstakes action movie.agr.webm

The video is fine but the audio cuts off after a few seconds. Is there any thing I needed to do differently? The audio is the whole point of the file.--agr (talk) 17:17, 23 November 2023 (UTC)

@ArnoldReinhold: there is sound throughout the video for me. can you check again? maybe it was because you just uploaded the video and commons servers were still transcoding it.--RZuo (talk) 17:57, 2 December 2023 (UTC)

It is working properly for me now. It didn’t occur to me that proceeding wasn’t finished. Thank you for your help. Easiest fix ever. —agr (talk) 13:00, 3 December 2023 (UTC)

MaybeEncodingError

Bug report: https://github.com/toolforge/video2commons/issues/176

Hi, I got this error while uploading [3]. This is a big file, but if the error is due to the size (it doesn't seem so from the message), there should be a warning before, instead of processing the file for 3 days and then failing. Yann (talk) 11:19, 5 December 2023 (UTC)

An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/debadae0b49d62d0/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/debadae0b49d62d0/dl.mp4.vp9.webm.log /srv/v2c/output/debadae0b49d62d0/dl.mp4.vp9.webm\\\\\\\\nExitcode: 153\\\')>, None)"\')'

@Yann: I don't think it's the size. Got this "MaybeEncodingError" today (see below) for a rather small (32 MB, 15 seconds) video from my device. Gestumblindi (talk) 17:48, 10 December 2023 (UTC)

I too got the same error. Have some 20 videos to upload but can't as it failed with the error

An exception occurred: MaybeEncodingError:

does that happen because of empty variables of the template? thanks QueerEcofeminist[they/them/their] 16:01, 14 December 2023 (UTC)

Unable to download JSON metadata

Bug report: https://github.com/toolforge/video2commons/issues/177

Hi, I got an error while downloading https://www.dailymotion.com/video/x5qb7u9 Yann (talk) 20:14, 8 December 2023 (UTC)

@Yann: I was able to upload https://www.dailymotion.com/video/x5qb7u9 to File:Georges Méliès- Le Voyage de la Famille Bourrichon (1913).webm for you. Please attend to the licensing.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 13:30, 13 February 2024 (UTC)

An exception occurred: DownloadError: b'ERROR: [dailymotion] x5qb7u9: Unable to download JSON metadata: HTTP Error 401: Unauthorized (caused by <HTTPError 401: Unauthorized>); please report this issue on https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using yt-dlp -U'

• It happens again with https://www.dailymotion.com/video/x7s00m2 Yann (talk) 14:49, 11 December 2023 (UTC)

• This one is probably because the video is too big. Yann (talk) 15:25, 11 December 2023 (UTC)

  Seems the fallback to server side upload in case of mediawiki api errors had a bug since the port to python 3. It should be fixed. Chico Venancio (talk) 18:08, 11 December 2023 (UTC)

  @Chicocvenancio: This one fails with "b'Failed to determine the path of the downloaded video. Is the video too large?'".   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 12:21, 13 February 2024 (UTC)

argument must be str, not bytes

Bug report: https://github.com/toolforge/video2commons/issues/178

Hi, I got this message while uploading God's Little Acre (1958) from YT. Yann (talk) 10:38, 9 December 2023 (UTC)

This has been fixed. Chico Venancio (talk) 19:02, 12 December 2023 (UTC)

An exception occurred: TypeError: b'write() argument must be str, not bytes'

It happened again with the same video. Yann (talk) 19:19, 10 December 2023 (UTC)

getting this today for https://www.youtube.com/watch?v=cpnOJaZlPaI . RZuo (talk) 21:11, 17 January 2024 (UTC)

@RZuo: The file was too large to upload directly, so I requested a server-side upload in phab:T357403 and File:City Driving 4K- Kraków Poland 2024.webm was uploaded. Please attend to the licensing.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 12:37, 13 February 2024 (UTC)

Sadly, I keep getting errors transcoding that file to VP9 1440P and Streaming 1440p (VP9) formats, no matter how many times I try to reset those transcodes.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 15:27, 14 February 2024 (UTC)

i reported the transcode bug to https://phabricator.wikimedia.org/T357545 . RZuo (talk) 16:13, 14 February 2024 (UTC)

@RZuo and Brooke Vibber: Thanks. Is it the same problem with the transcode to Streaming 1080p (VP9) format for that file, which started over 12 days, 19 hours ago? Also pinging TheDJ, who has activity on that task and this page.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 08:45, 26 February 2024 (UTC)

The transcodes are also erroring out on the highest-bitrate formats due to artificial estimates exceeding the 3GB limit at File:Holger Madsen - Towards The Light (Mod Lyset) 1919 4K Vintage Movie ENG DANSK.webm, see phab:T357184#9575518.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 04:49, 1 May 2024 (UTC)

Sadly, this is a copyvio until 2029.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 12:48, 29 April 2024 (UTC)

Hopeless case?

It seems that this tool is broken in so many ways and it's only a matter of a lot of luck if you manage to successfully upload a video. My most recent try today (uploading a moderately sized video of 15 seconds duration from my device) resulted in this cryptic error message:

An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/555119d3bac84652/dl.unknown_video -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/555119d3bac84652/dl.unknown_video.vp9.webm.log /srv/v2c/output/555119d3bac84652/dl.unknown_video.vp9.webm\\\\\\\\nExitcode: 137\\\')>, None)"\')'

Then I clicked on "Restart" and got "An exception occurred: OSError: b'[Errno 12] Cannot allocate memory'". It's sad that apparently no one is really maintaining that tool as it would be a great help with uploading videos to Commons (which is otherwise even more cumbersome). Gestumblindi (talk) 17:46, 10 December 2023 (UTC)

Server crashed

Hi, Now I get The connection to the server has failed. Please refresh this page or file an issue in GitHub. Yann (talk) 21:42, 11 December 2023 (UTC)

Large error messages were making the frontend be killed for large memory consumption. It has been fixed. Chico Venancio (talk) 19:04, 12 December 2023 (UTC)

@Chicocvenancio: I am getting this now.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 00:44, 13 December 2023 (UTC)

And now I am not. I restarted my five failed tasks (one of which had a huge error message), and now they are all "pending..."   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 00:58, 13 December 2023 (UTC)

Well, the conversion of one file "b'Failed to determine the path of the downloaded video. Is the video too large?'". Four remain (one uploading, one running, and two downloading).   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 12:31, 13 December 2023 (UTC)

This status has not changed in over eight hours (since my last post above). The files are:

• (오피셜) FC서울, 미드필더 이승모 영입 (Uploading...)
• Dixiana 1930 (colorised, 4k, 60FPS) (Downloading to /srv/v2c/output/4406a31893a4b14c/dl.mp4.part, 3%)
• God's Little Acre (Mann, 1958) — High Quality 1080p (Downloading to /srv/v2c/output/b87fa8eef23eb047/dl.f137.mp4.part, 40%)
• Georges Méliès- Le Voyage de la Famille Bourrichon (1913) (Running cmd: /mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/be4138031c008768/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -an -pass 1 -passlogfile /srv/v2c/output/be4138031c008768/dl.mp4.vp9.webm.log /dev/null)

  — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 20:59, 13 December 2023 (UTC)

@Jeff G.: I think I already uploaded these movies. Yann (talk) 21:10, 13 December 2023 (UTC)

@Yann: Ok, but that's no reason for the conversions to be stuck in those states.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 22:45, 13 December 2023 (UTC)

@Jeff G.: Right. I got a lot of issues, but never an upload stuck in the middle. Actually for Dixiana and God's Little Acre, I only got lower quality copies. Yann (talk) 22:52, 13 December 2023 (UTC)

Same situation, 56 hours in...   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 21:04, 15 December 2023 (UTC)

@Yann: I found File:Le Voyage de la Famille Bourrichon (1913) by Georges Méliès.webm in your uploads, so I tried to abort that task; now it "is being aborted..."   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 21:18, 15 December 2023 (UTC)

Same situation, 3 days in (aborting is 18+ hours in). Are any maintainers reading this?   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 16:11, 16 December 2023 (UTC)

@Jeff G.: It seems I run into this. Trying to upload 2 very short videos, 16s and 19s, and it takes ages. :( Yann (talk) 20:21, 16 December 2023 (UTC)

Paging @Chicocvenancio.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 20:24, 16 December 2023 (UTC)

Ages indeed. I'm now at 13 days.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 06:56, 26 December 2023 (UTC)

All of those tasks went away (not on the screen any more) by 03:05, 27 December 2023 (UTC). I was able to complete some, as documented in these edits. I have two uploads on task in pass 2 for Yann: https://www.youtube.com/watch?v=q8Q3bxHZZ00 as File:God's Little Acre (Mann, 1958) — High Quality 1080p.webm and https://player.pbs.org/viralplayer/3036869056/ as File:Lakeshore Classic Movies - The House on Haunted Hill (1959).webm.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 11:15, 27 December 2023 (UTC)

@Yann: Both files are now uploaded, please attend to the licensing.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 15:40, 27 December 2023 (UTC)

The 1080p transcodes on the former file errored out, I reset them.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 00:11, 28 December 2023 (UTC)

@Yann: I managed to upload https://www.youtube.com/watch?v=clI2zhCgB3s to File:Vallée de la Séveraissette, Hautes-Alpes.webm for you. You already uploaded https://www.youtube.com/watch?v=zQASfAc5iI0 to File:Montagne de Faraut et pic de l'Aiguille, Hautes-Alpes, France.webm.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 04:50, 27 December 2023 (UTC)

four.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 12:51, 18 December 2023 (UTC)

Five days I have been waiting for uploads, over two days for abort.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 13:42, 19 December 2023 (UTC)

These disappeared from the list of my tasks.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 12:57, 29 April 2024 (UTC)

WorkerLostError

Hi, I also got An exception occurred: WorkerLostError: b'Worker exited prematurely: signal 15 (SIGTERM) Job: 188.' and again An exception occurred: WorkerLostError: b'Worker exited prematurely: signal 15 (SIGTERM) Job: 18.' with https://player.pbs.org/viralplayer/3036869056/ Yann (talk) 22:04, 11 December 2023 (UTC)

Allowing uploads over deleted files

Hi, Right now V2C doesn't allow uploading a file over a deleted file. This is very inconvenient. Chico Venancio: Could it be fixed? Also upload will fail if the file already exists, but after the whole process which could take hours. Ideally, V2C should detect before if the name is available, and if not, proposes to rename the video. Yann (talk) 20:42, 12 December 2023 (UTC)

 Support.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 00:39, 13 December 2023 (UTC)

Pending tasks

I just updated my tool to call video2commons when mp4 files are to be uploaded.

My first attempts are stuck in "pending" state, I don't know if I did something wrong or if video2commons is down. The category is currently not updated, and the video Cloud VPS encoders (04,05,06) seem not busy.

@Chico Venancio can you please check if these tasks cause any problem to v2c?

- 651c8302-45e8-4154-9ec3-ecc4385ec1c7

- f5dc71ae-82ee-4566-96c3-a141a0f01029

Cheers, vip (talk) 20:33, 16 December 2023 (UTC)

@Chicocvenancio, Don-vip, Yann, and RZuo: v2c has not been used to facilitate an upload in two days.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 14:17, 17 December 2023 (UTC)

@Matanya maybe you can help too? vip (talk) 15:21, 17 December 2023 (UTC)

three.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 12:47, 18 December 2023 (UTC)

Found an error with the healthcheck script that should make things recover within 10 minutes now. There is still an issue that I have not been able to track down with exceptions including the full bytes of the video, consuming large amounts of memory and crashing redis and/or workers. This is causing legitimate errors to propagate into other jobs. Celery is a bit of a pain to debug, so I make no promises to be able to fix this soon. Chico Venancio (talk) 20:53, 18 December 2023 (UTC)

@Chicocvenancio: Thanks. Some people are getting uploads through.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 13:44, 19 December 2023 (UTC)

@DarwIn: You seem to be getting uploads through, what's your secret?   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 06:53, 26 December 2023 (UTC)

@Jeff G. I've no idea... But after Chico bug fix they have been generally working well, apart from some errors, mainly related to live chats on YouTube, and have been quite fast... Crossing my fingers that it stays this way 😬 Darwin ^Ahoy! 13:09, 26 December 2023 (UTC)

I too have a pending task since more than 12 hours now: 85b5ce9b-8c63-4f73-9c2a-10fbe5543bae I have never used the tool before, so I wonder whether this is normal. --Blahma (talk) 07:28, 18 December 2023 (UTC)

V2C down

Well, it was working again, but now I'm seeing a new error code.

Please file an issue in GitHub: Traceback (most recent call last): File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1519, in full_dispatch_request return self.finalize_request(rv) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1540, in finalize_request response = self.process_response(response) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1888, in process_response self.session_interface.save_session(self, ctx.session, response) File "/data/project/video2commons/www/python/src/../../../video2commons/frontend/redisession.py", line 101, in save_session self.redis.expire(self.prefix + session.sid, File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 1591, in expire return self.execute_command('EXPIRE', name, time) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 901, in execute_command return self.parse_response(conn, command_name, **options) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 915, in parse_response response = connection.read_response() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/connection.py", line 756, in read_response raise response redis.exceptions.ResponseError: MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.

✗plicit 14:15, 18 December 2023 (UTC)

Idem for me: https://github.com/toolforge/video2commons/issues/181

Please file an issue in GitHub: Traceback (most recent call last): File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1519, in full_dispatch_request return self.finalize_request(rv) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1540, in finalize_request response = self.process_response(response) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1888, in process_response self.session_interface.save_session(self, ctx.session, response) File "/data/project/video2commons/www/python/src/../../../video2commons/frontend/redisession.py", line 89, in save_session self.redis.delete(self.prefix + session.sid) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 1567, in delete return self.execute_command('DEL', *names) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 901, in execute_command return self.parse_response(conn, command_name, **options) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 915, in parse_response response = connection.read_response() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/connection.py", line 756, in read_response raise response redis.exceptions.ResponseError: MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.

Yann (talk) 15:47, 18 December 2023 (UTC)

@Yann: This is the same error reported above at #"Something went terribly wrong".   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 10:49, 1 March 2024 (UTC)

V2C should integrated into MW

Hi, I created a report. Please weight in phab:T353659. Yann (talk) 16:16, 18 December 2023 (UTC)

@511KeV what file did you try to upload that gave you the error https://commons.wikimedia.org/w/index.php?title=Commons:Video2commons&diff=prev&oldid=832213383 ? RZuo (talk) 17:46, 20 December 2023 (UTC)

Requested format is not available

Tracked in Phabricator
Task T236446

Bug report: https://github.com/toolforge/video2commons/issues/183

Hi, I got a new error while trying to upload [4]. Error: An exception occurred: DownloadError: b'ERROR: [youtube] iQj3Ztysw8A: Requested format is not available. Use --list-formats for a list of available formats' Yann (talk) 11:02, 31 December 2023 (UTC)

This is probably a more general issue, as I got the same with [5] and [6]. Yann (talk) 11:18, 31 December 2023 (UTC)

V2C is completely broken (again). All videos are rejected with this message. Yann (talk) 14:17, 31 December 2023 (UTC)

@Yann: I was able to upload https://www.youtube.com/watch?v=Kbgf7owbSOs to File:Ranger Brief- Avalanche Risk on Mount Rainier.webm and https://www.youtube.com/watch?v=Q5pASf6M1_Y to File:The Pyrenees by Drone - Breche de Roland - Avalanche-Cirque de Gavarnie - Ordesa in 4K.webm for you. Please attend to the licensing.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 11:49, 13 February 2024 (UTC)

According to phab:T236446, "YT has started to block downloads from video2commons again since around 2023-12-29 22:30." Yann (talk) 20:52, 31 December 2023 (UTC)

i wonder how those youtube downloader websites avoid getting caught by youtube. they must be downloading much more than v2c.

wonder if v2c could make use of similar techniques to go around evil google. :/ RZuo (talk) 01:13, 1 January 2024 (UTC)

If you know how GG blocks V2C (IP / software ID / something else...), we can certainly overcome the block. Yann (talk) 13:56, 1 January 2024 (UTC)

@Yann I understand they are blocking the Toolforge IPs, if we used our own or some kind of proxy it would probably work (or YT could block these too 😐). Darwin ^Ahoy! 17:01, 1 January 2024 (UTC)

I'm confused by the above: "V2C is completely broken (again). All videos are rejected with this message." … "YT has started to block downloads from video2commons" Is this problem specific to videos from YouTube, or a more general V2C problem? - Jmabel ! talk 03:36, 2 January 2024 (UTC)

@Jmabel: Just YouTube. All the conversions to uploads in the last three days have been from other sites.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 04:22, 2 January 2024 (UTC)

does anyone know how the block last time was lifted? like the ips are allowed to download again after a certain period (months?), or toolforge had new ips? RZuo (talk) 09:09, 2 January 2024 (UTC)

@Yann: I was able to upload https://www.youtube.com/watch?v=iQj3Ztysw8A to File:Partie 2 - Comment faire une recherche avalanche.webm for you. Please attend to the licensing.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 12:47, 13 February 2024 (UTC)

Certificate verify failed: certificate has expired

Hi, Now I get this while uploading https://vk.com/video-136471876_456242040 Yann (talk) 14:58, 1 January 2024 (UTC) An exception occurred: DownloadError: b"ERROR: [vk] Unable to download JSON metadata: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1056) (caused by CertificateVerifyError('[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1056)')); please report this issue on https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using yt-dlp -U"

@Chicocvenancio Ping. Darwin ^Ahoy! 17:02, 1 January 2024 (UTC)

@Yann, DarwIn, and Chicocvenancio: The certificate for *.vk.com does not expire until Tuesday, February 20, 2024 at 5:00:00 AM according to Chrome on my laptop.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 01:44, 2 January 2024 (UTC)

I'll look into it. This one might take a bit because it might need the OS to be upgraded and we don't yet have a functional way to recreate the nodes from scratch. Chico Venancio (talk) 15:42, 2 January 2024 (UTC)

@Yann @Jeff G. @DarwIn: Seems the OS upgrade isn't needed to fix this. It is a cloud-vps wide issue and it should be fixed soon. Chico Venancio (talk) 16:11, 3 January 2024 (UTC)

@Chicocvenancio Thank you very much for the heads up. Darwin ^Ahoy! 18:12, 3 January 2024 (UTC)

phab:T354295 is the immediate task. Chico Venancio (talk) 14:04, 9 January 2024 (UTC)

@Yann: I was able to upload the 1,920 × 1,080 version https://vk.com/video-136471876_456242040 to File:The Lion of the Moguls - Le Lion des Mogols (1924) dir. Jean Epstein.webm for you.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 05:05, 1 May 2024 (UTC)

Too many open files

OSError: b'[Errno 24] Too many open files' Kelly The Angel (talk) 15:17, 6 January 2024 (UTC)

Yes, I also get this error time to time. It seems the server is overloaded. It works after restarting some time later. Yann (talk) 15:23, 6 January 2024 (UTC)

MaybeEncodingError: PicklingError

Bug report: https://github.com/toolforge/video2commons/issues/184

Hi, Another error now :((( while trying to upload [7]. Yann (talk) 07:57, 11 January 2024 (UTC)

An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'\\\'(1, <ExceptionInfo: TaskError(b"pywikibot.Error: UploadError: exists-normalized: File exists with different extension as \\\\\\\'Z\\\\\\\\xc3\\\\\\\\xa9ro_de_conduite_(1933)_par_Jean_Vigo.jpg\\\\\\\'.")>, None)\\\'\')'

@Yann: this is coming from mediawiki itself pywikibot.Error: UploadError: exists-normalized . Changing the title so it doesn't match the image should let the upload through. ps: I wish these mediawiki errors were properly documented somewhere. Chico Venancio (talk) 13:18, 11 January 2024 (UTC)

The main problem is that comes after 8 hours running... :((( I renamed the file, it is much easier than starting the video process allover. Yann (talk) 16:12, 11 January 2024 (UTC)

@Yann: I was able to upload File:Zero De Conduite AKA Zero for Conduct (1933) (1080p) Jean Vigo.webm for you, please attend to the licensing.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 11:26, 13 February 2024 (UTC)

Never mind, we already have File:Zéro de conduite (1933) par Jean Vigo.webm, which is of higher resolution. Tagged for G7.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 12:43, 13 February 2024 (UTC)

Again while uploading https://archive.org/details/dixiana-4-k This is a big file (3.5 GB), but... Yann (talk) 14:39, 17 January 2024 (UTC) An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/bcd9bb16ad0148a1/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/bcd9bb16ad0148a1/dl.mp4.vp9.webm.log /srv/v2c/output/bcd9bb16ad0148a1/dl.mp4.vp9.webm\\\\\\\\nExitcode: 153\\\')>, None)"\')'

@Yann: For me too with the same file. Also, the tool appears not to be live updating the downloading percentages in my browser any more.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 08:20, 26 February 2024 (UTC) An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/e84f7ad87ff2e4f7/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/e84f7ad87ff2e4f7/dl.mp4.vp9.webm.log /srv/v2c/output/e84f7ad87ff2e4f7/dl.mp4.vp9.webm\\\\\\\\nExitcode: 153\\\')>, None)"\')'

@Yann And again. Live updating the downloading percentages in my browser is back.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 02:05, 29 February 2024 (UTC) An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/6cc7c2aa9169da83/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/6cc7c2aa9169da83/dl.mp4.vp9.webm.log /srv/v2c/output/6cc7c2aa9169da83/dl.mp4.vp9.webm\\\\\\\\nExitcode: 153\\\')>, None)"\')'

Now Running... Running cmd: /mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/7c576f571bca1cd4/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/7c576f571bca1cd4/dl.mp4.vp9.webm.log /srv/v2c/output/7c576f571bca1cd4/dl.mp4.vp9.webm   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 10:55, 2 March 2024 (UTC)

Still running at 4%.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 11:53, 6 March 2024 (UTC)

That task disappeared. Now running again with "z", up to 27%, but I kept getting spinners and needing to refresh.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 09:15, 14 March 2024 (UTC)

Ack, failed with An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/16b2b10195cac7a8/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/16b2b10195cac7a8/dl.mp4.vp9.webm.log /srv/v2c/output/16b2b10195cac7a8/dl.mp4.vp9.webm\\\\\\\\nExitcode: 153\\\')>, None)"\')'.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 20:20, 17 March 2024 (UTC)

Next, I got "An exception occurred: FileNotFoundError: b'[Errno 2] No such file or directory'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 01:51, 4 May 2024 (UTC)

Next, I got "An exception occurred: DownloadError: b"ERROR: \r[download] Got error: (<urllib3.connection.HTTPSConnection object at 0x7f63f2c41cc0>, 'Connection to ia803406.us.archive.org timed out. (connect timeout=20.0)'). Giving up after 10 retries"".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 10:27, 4 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/17ffa43b61bc9d42/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/17ffa43b61bc9d42/dl.mp4.vp9.webm.log /srv/v2c/output/17ffa43b61bc9d42/dl.mp4.vp9.webm\\\\\\\\nExitcode: 153\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 13:21, 6 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/0b7f8be23d00ce8b/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/0b7f8be23d00ce8b/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 13:38, 6 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/81aaf84973b719e5/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/81aaf84973b719e5/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 13:53, 6 May 2024 (UTC)

Next, retrying "Running cmd: /mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/419677851a73618d/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/419677851a73618d/dl.mp4.vp9.webm.log /dev/null".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 14:08, 6 May 2024 (UTC)

And "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/419677851a73618d/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/419677851a73618d/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 14:10, 6 May 2024 (UTC)

Yes, I keep retrying because I want to get this done. No, I don't like taking "no" for an answer without a good reason.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 14:12, 6 May 2024 (UTC)

And "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/0f238e4cf09bd37b/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/0f238e4cf09bd37b/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 14:29, 6 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/306e1a5dc54566e6/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/306e1a5dc54566e6/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'". Should I keep reporting the 137 exitcodes?   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 14:43, 6 May 2024 (UTC)

Continuing, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/a03ccdab663183d2/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/a03ccdab663183d2/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 15:03, 6 May 2024 (UTC)

And "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/a03ccdab663183d2/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/a03ccdab663183d2/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 15:05, 6 May 2024 (UTC)

And "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/046f694e4d6de266/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/046f694e4d6de266/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 15:20, 6 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/a645ccb91a631ccb/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/a645ccb91a631ccb/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 00:54, 7 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/313c581e31dc5f7a/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/313c581e31dc5f7a/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 10:34, 8 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/44e5d44e7a6f1cce/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/44e5d44e7a6f1cce/dl.mp4.vp9.webm.log /srv/v2c/output/44e5d44e7a6f1cce/dl.mp4.vp9.webm\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 18:53, 8 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/83c36f7ad441545d/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -an -pass 1 -passlogfile /srv/v2c/output/83c36f7ad441545d/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 21:51, 8 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/659500380e96aed6/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/659500380e96aed6/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 02:36, 9 May 2024 (UTC)

By "z", I mean again attempting to upload with filename File:Dixiana 1930 (colorized, 4k, 60FPS).webm to prefer Yann's ability to retry. We seem not to be getting progress percentages for ffmpeg pass 1.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 13:25, 6 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/d8157e1b3dc74b94/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/d8157e1b3dc74b94/dl.mp4.vp9.webm.log /srv/v2c/output/d8157e1b3dc74b94/dl.mp4.vp9.webm\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 12:07, 9 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/d26e801ae20fa92f/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -an -pass 1 -passlogfile /srv/v2c/output/d26e801ae20fa92f/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 13:45, 9 May 2024 (UTC)

Next, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/83a058bf994772d3/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/83a058bf994772d3/dl.mp4.vp9.webm.log /dev/null\\\\\\\\nExitcode: 137\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 13:01, 11 May 2024 (UTC)

One more. This is a very big file (3.37 GB), but the error message is completely useless. Yann (talk) 12:21, 8 March 2024 (UTC)

An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(b\\\'pywikibot.Error: APIError: missingresult: No result in status data.\\\\\\\\n[param: action=upload&filekey=1arh87f67h6o.i89yyb.1.webm&checkstatus=&assert=user&maxlag=5&format=json&token=ef04052bdfe31ebba854fd7011e5796165e8902f%2B%5C;\\\\\\\\n servedby: mw2306;\\\\\\\\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]\\\')>, None)"\')'

@Yann: I was able to upload https://www.youtube.com/watch?v=DRJEAVxY43w to File:D W Griffith - "True Heart Susie" - (1919) starring Lillian Gish, Robert Harron.webm for you, please attend to the licensing.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 08:53, 14 March 2024 (UTC)

@Jeff G.: Thanks, but I managed to upload it directly with Chunked Uploads: File:True Heart Susie (1919) by D. W. Griffith.webm. Please ask or check before uploading files. Yann (talk) 11:22, 14 March 2024 (UTC)

@Yann: You're welcome. I copied info from mine to yours and tagged mine g7.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 05:02, 15 March 2024 (UTC)

Why is file too big

https://video2commons.toolforge.org/static/ssu/Removing_our_Sea_cocks.webm 2.9 gb

https://video2commons.toolforge.org/static/ssu/City_Driving_4K-_Krak%C3%B3w_Poland_2024.webm 3.9 gb

they are less than 4 gb? how come v2c asks me to make server side upload phab tickets? RZuo (talk) 13:04, 28 January 2024 (UTC)

i wonder if it will be beneficial to use special:upload to directly upload videos, so as to avoid making server side upload requests? https://commons.wikimedia.org/w/index.php?title=MediaWiki_talk:Copyupload-allowed-domains&oldid=846513475#Allowlist_request_-_toolforge.org RZuo (talk) 14:52, 28 January 2024 (UTC)

after the domain is whitelisted, i've tried special:upload, url2commons, openrefine on paws, which all failed to transfer the files from toolforge.org to commons. i guess server side upload must be performed. RZuo (talk) 10:35, 29 January 2024 (UTC)

bigchunkedupload also fails, even for the 2.9 gb file. RZuo (talk) 11:47, 29 January 2024 (UTC)

@RZuo: With my uploads and attempts of uploading files that big via bigchunkedupload, I found that if I kept trying, I would get an assortment of errors to document, and sometimes successful uploads. Please be aware of a current task about this, phab:T355433, and a local conversation about this with MikhasikRV at User talk:MikhasikRV#About your problem with uploading.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 13:14, 29 January 2024 (UTC)

File:Митинг 23 января в Москве - в центре событий от первого лица.webm

File:200226 MCND 캐슬제이X빅X민재X휘준X윈 포토타임 (데뷔앨범 쇼케이스).webm

File:USC v Palmwoods – 2021-22 Sunshine Coast Cricket Association Division 6 Semi Final (1).webm

these are all giant files recently uploaded with v2c. i dont get it. RZuo (talk) 14:08, 29 January 2024 (UTC)

Video2commons basically tries to upload and sends the ServerSideUpload message if the upload fails and is over 1GB. We could try to improve error handling in the upload function but this likely needs significant work. Chico Venancio (talk) 14:22, 1 February 2024 (UTC)

Blacklist error

Got this error: An exception occurred: TaskError: b'b\'pywikibot.Error: APIError: titleblacklist-custom-space: \\xe2\\xa7\\xbctitleblacklist-custom-space\\xe2\\xa7\\xbd\\n[param: b\\\'--===============4857578388613790518==\\\\nContent-Type: text/plain\\\\nMIME-Version: 1.0\\\\nContent-disposition: form-data; name="action"\\\\n\\\\nupload\\\\n--===============4857578388613790518==\\\\nContent-Type: text/plain\\\\nMIME-Version: 1.0\\\\nContent-disposition: form-data; name="token"\\\\n\\\\n77a4691b21bb56ea5503d289bbba8ce565ccd6de+\\\\\\\\\\\\n--===============4857578388613790518==\\\\nContent-Type: text/plain\\\\nMIME-Version: 1.0\\\\nContent-disposition: form-data; name="text"\\\\n\\\\n==Summary==\\\\n{{Information\\\\n|description= when trying to upload this video. – Illegitimate Barrister (talk • contribs), 15:08, 14 February 2024 (UTC)

@Illegitimate Barrister: That's weird, I got it to upload to File:A-Rippler - One Step Medley 1916 - Arr. Edwin E. Wilson - Read Description!.webm. Please attend to the licensing.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 15:18, 14 February 2024 (UTC)

@Illegitimate Barrister: It was deleted by Krd because you did not do that.   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 08:09, 26 February 2024 (UTC)

Audio being erroneously removed

Tracked in Phabricator
Task T358368

I just tried to upload four video files with Video2commons. 1, 2, 3, 4. In at least the first one, after I uploaded it, everything seemed to work, but when I checked back a few minutes later, the audio had gone silent. For the others, they didn't have any audio when I tested after uploading. Any idea what bug is happening here and how to fix it? Sdkb ^talk 06:44, 22 February 2024 (UTC)

Hmm, and when I click on "original file," e.g. here, the sound is still there. Sdkb ^talk 06:48, 22 February 2024 (UTC)

hmm, someone reported something similar https://commons.wikimedia.org/w/index.php?title=Commons:Village_pump/Technical&oldid=854496524#How_to_solve_the_problem_that_videos_uploaded_using_video2commons_lack_normal_audio .

checking your example #1, clicking the mediaplayer plays the video without audio. now if you select the resolution, you will find out that all but "source" have no sound.

looks like a bug of the player, selecting all video-only streams. RZuo (talk) 11:30, 22 February 2024 (UTC)

Hello, I had the same issue with 1, 2 and the 3 extracted with the VideoCutTool (1, 2 and 3). Thanks, Erick Soares3 (talk) 19:09, 24 February 2024 (UTC)

PS: The VideoCutTool player recognizes the audio without any issue. Erick Soares3 (talk) 19:11, 24 February 2024 (UTC)

Transfer from YT works again

HI, Transfer from YT works again, i.e. File:Fake News in the 18th Century - Collection in Focus - British Library.webm. See discussion above. Yann (talk) 11:26, 28 February 2024 (UTC)

@Yann: Thanks, great news!   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 01:52, 29 February 2024 (UTC)

Something is wrong with the tool, causing a Python error

I got an error message after clicking/tapping a link or typing a URL while trying to upload another animation-related video. Did it happen to anyone to file an issue report?

Please file an issue in GitHub: Traceback (most recent call last): File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1519, in full_dispatch_request return self.finalize_request(rv) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1540, in finalize_request response = self.process_response(response) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1888, in process_response self.session_interface.save_session(self, ctx.session, response) File "/data/project/video2commons/www/python/src/../../../video2commons/frontend/redisession.py", line 89, in save_session self.redis.delete(self.prefix + session.sid) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 1567, in delete return self.execute_command('DEL', *names) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 901, in execute_command return self.parse_response(conn, command_name, **options) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 915, in parse_response response = connection.read_response() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/connection.py", line 756, in read_response raise response redis.exceptions.ResponseError: MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.

THV | ♂ | U | T - 14:53, 29 February 2024 (UTC); edited: 15:03, 29 February 2024 (UTC)

Yes, same from here. Arlo James Barnes 06:26, 1 March 2024 (UTC)

@The Harvett Vault and Arlo Barnes: This is the same error reported above at #"Something went terribly wrong".   — 🇺🇦Jeff G. ツ _{please ping or talk to me}🇺🇦 10:50, 1 March 2024 (UTC)

I didn't see that one earlier. It won't be a long time until it gets resolved to work. - THV | ♂ | U | T - 13:07, 1 March 2024 (UTC)

I got it too. – Illegitimate Barrister (talk • contribs), 18:42, 1 March 2024 (UTC)

An exception occurred: TypeError: b"'NoneType' object is not iterable"

Hi,

I just got this error while trying to import a file from a Google drive.

What does it means exactly (Commons:video2commons#Standard errors says "?" ) and more importantly, how can I fix it?

(@Chicocvenancio: maybe? sorry, not sure who to ping)

Cheers, VIGNERON (talk) 11:27, 6 March 2024 (UTC)

MaybeEncodingError

An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'\\\'(1, <ExceptionInfo: TaskError(b\\\\\\\'pywikibot.Error: APIError: titleblacklist-custom-space: \\\\\\\\xe2\\\\\\\\xa7\\\\\\\\xbctitleblacklist-custom-space\\\\\\\\xe2\\\\\\\\xa7\\\\\\\\xbd\\\\\\\\n[param: action=upload&text=%3D%3D%7B%7Bint%3Afiledesc%7D%7D%3D%3D%0A%7B%7BInformation%0A%7Cdescription%3D%7B%7Bfa%7C1%3Dhttps%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D3oTTPxrI-nA++%E2%9A%9C%D8%A7%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85+%D8%A8%DB%8C%D8%B4%D8%AA%D8%B1%DB%8C%D9%86+%D8%AA%D8%B9%D8%AF%D8%A7%D8%AF+%D8%A8%D8%A7%D8%B2%D8%AF%DB%8C%D8%AF+%D8%B1%D8%A7+%D8%A7%D8%B2+%D8%B7%D8%B1%D9%81+%D9%85%D8%AE%D8%A7%D8%B7%D8%A8%D8%A7%D9%86+%D8%AF%D8%A7%D8%B4%D8%AA%D9%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D11-2m0qIb6A++%E2%9A%9C%D8%A7%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85+%D8%A8%DB%8C%D8%B4%D8%AA%D8%B1%DB%8C%D9%86+%D8%AA%D8%B9%D8%AF%D8%A7%D8%AF+%D9%84%D8%A7%DB%8C%DA%A9+%D8%B1%D8%A7+%D8%A7%D8%B2+%D8%B7%D8%B1%D9%81+%D9%85%D8%AE%D8%A7%D8%B7%D8%A8%D8%A7%D9%86+%D8%AF%D8%A7%D8%B4%D8%AA%D9%87%0A%0A%F0%9F%94%B4%D8%A8%D8%B1%D8%A7%DB%8C+%D8%AA%D9%85%D8%A7%D8%B4%D8%A7%DB%8C+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%A8%DB%8C%D9%86%D8%B8%DB%8C%D8%B1+%DA%A9%D9%84%DB%8C%DA%A9+%DA%A9%D9%86%DB%8C%D8%AF%0A%D8%B3%D8%A7%D8%A8%D8%B3%DA%A9%D8%B1%D8%A7%DB%8C%D8%A8+%DA%A9%D9%86%DB%8C%D8%AF%0A%0AThis+is+the+only+official+channel+for+FilmFarsi+on+Youtube.+FilmFarsi+is+Dedicated+to+the+Cinema+of+Iran+Pre-revolution.+All+rights+are+reserved+and+Films+are+DMCA+protected.+%0A%0A%D8%A8%D9%87%D8%AA%D8%B1%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D9%86%D8%A7%D8%B5%D8%B1+%D9%85%D9%84%DA%A9+%D9%85%D8%B7%DB%8C%D8%B9%DB%8C%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvoE_Y-Gu_rg8uM7hnD2_doq%0A%D8%A8%D9%87%D8%AA%D8%B1%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%B4%D9%87%D9%86%D8%A7%D8%B2+%D8%AA%D9%87%D8%B1%D8%A7%D9%86%DB%8C+%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvqxxN1wJ_Wy_Vvk5Lx_XTBQ%0A%D8%A8%D9%87%D8%AA%D8%B1%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%AF%D9%87%D9%87+%D9%BE%D9%86%D8%AC%D8%A7%D9%87+%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvraKAcNSVUOlgNtZt0CFKc2%0A%D9%BE%D9%86%D8%AC+%D8%B3%DA%A9%D8%A7%D9%86%D8%B3+%D8%A8%D8%B1%D8%AA%D8%B1+%D8%B3%DB%8C%D9%86%D9%85%D8%A7%DB%8C+%D8%A7%DB%8C%D8%B1%D8%A7%D9%86+%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvryRfQk3air1dMsb_hRmYBi%0A%0A%F0%9F%91%87Top+watched+playlists%3A%F0%9F%91%87%0A%0A%D8%A8%D9%87%D8%AA%D8%B1%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%A8%D9%87%D9%85%D9%86+%D9%85%D9%81%DB%8C%D8%AF++%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvptSr4Y8TUh2EnXSQObg0Mn%0A%D8%A8%D9%87%D8%AA%D8%B1%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D9%BE%D9%88%D8%B1%DB%8C+%D8%A8%D9%86%D8%A7%DB%8C%DB%8C%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvqMYxR8JxgNcdqg8l9gCjhq%0A%D9%81%DB%8C%D9%84%D9%85+%D9%81%D8%A7%D8%B1%D8%B3%DB%8C+%D9%82%D8%AF%DB%8C%D9%85%DB%8C%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvrlDlAPk6T9J4EPhDCQNYO-%0A%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D9%82%D8%AF%DB%8C%D9%85%DB%8C+%DA%A9%D9%85%D8%AF%DB%8C%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvqx3KWtbro1s_Gq69XWUZgo%0A%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%A8%D9%87%D8%B1%D9%88%D8%B2+%D9%88%D8%AB%D9%88%D9%82%DB%8C%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvq5AWWWQ8nBilSyyxVODFky%0A%D8%A8%D9%87%D8%AA%D8%B1%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%B1%D8%B6%D8%A7+%D8%A8%DB%8C%DA%A9+%D8%A7%DB%8C%D9%85%D8%A7%D9%86%D9%88%D8%B1%D8%AF%DB%8C%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvpSDjp6mV6aHlU8fhH5ro_0%0A%D8%A8%D9%87%D8%AA%D8%B1%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%B4%D9%87%D9%84%D8%A7+%D8%B1%DB%8C%D8%A7%D8%AD%DB%8C%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvpcHyEAfTUkrmwDHj0W4PJ1%0A%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D9%84%DB%8C%D9%84%D8%A7+%D9%81%D8%B1%D9%88%D9%87%D8%B1%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvqTlkzdILEzeVGmN7cC82z2%0A%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%DA%AF%D9%88%DA%AF%D9%88%D8%B4%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvqtktJVOpISiOSpS7-WmkUz%0A%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D9%86%D8%B5%D8%B1%D8%AA+%D8%A7%D9%84%D9%84%D9%87+%D9%88%D8%AD%D8%AF%D8%AA%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvrrts-gAO8zQd6ewFmyiP9O%0A%D8%A8%D9%87%D8%AA%D8%B1%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%B9%D9%84%DB%8C+%D9%85%DB%8C%D8%B1%DB%8C%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvon4knByiTQrdkbFk1iuAsk%0A%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D9%82%D8%AF%DB%8C%D9%85%DB%8C+%D8%A7%DB%8C%D8%B1%D8%A7%D9%86%DB%8C%F0%9F%91%87%0Ahttps%3A%2F%2Fwww.youtube.com%2Fplaylist%3Flist%3DPLkvFABnKzzvqzX6bfKqwJQh0lb6TJePFi%0A%0A%F0%9F%8C%90+Facebook%3A+https%3A%2F%2Fwww.facebook.com%2Ffilmefarsi%0A%0A%F0%9F%91%8D%E2%9C%A8+%D9%81%DB%8C%D9%84%D9%85%D9%81%D8%A7%D8%B1%D8%B3%DB%8C+%D8%A7%D8%B5%D8%B7%D9%84%D8%A7%D8%AD%DB%8C+%D8%A7%D8%B3%D8%AA+%DA%A9%D9%87+%D8%AF%D8%B1+%D9%85%D9%88%D8%B1%D8%AF+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%A7%DB%8C%D8%B1%D8%A7%D9%86%DB%8C+%D9%82%D8%AF%DB%8C%D9%85%DB%8C%D8%8C+%D9%81%DB%8C%D9%84%D9%85+%D9%81%D8%A7%D8%B1%D8%B3%DB%8C+%D9%88+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7%DB%8C+%D8%B3%DB%8C%D9%86%D9%85%D8%A7%DB%8C+%D8%B9%D8%A7%D9%85%D9%87%E2%80%8C%D9%BE%D8%B3%D9%86%D8%AF+%D8%A7%DB%8C%D8%B1%D8%A7%D9%86+%D8%A8%D9%87+%DA%A9%D8%A7%D8%B1+%D8%A8%D8%B1%D8%AF%D9%87+%D8%B4%D8%AF.+%D8%A7%DB%8C%D9%86+%D9%81%DB%8C%D9%84%D9%85%E2%80%8C%D9%87%D8%A7+%D8%A8%D8%A7%D8%B2%DB%8C%DA%AF%D8%B1%D8%A7%D9%86+%D8%AA%D9%88%D8%A7%D9%86%D9%85%D9%86%D8%AF%DB%8C+%DA%86%D9%88%D9%86+%D9%81%D8%B1%D8%AF%DB%8C%D9%86%D8%8C+%D9%87%D9%85%D8%A7%DB%8C%D9%88%D9%86%D8%8C+%D8%AA%D9%82%DB%8C+%D8%B8%D9%87%D9%88%D8%B1%DB%8C%D8%8C+%D9%85%D9%87%D8%AF%DB%8C+%D9%81%D8%AE%DB%8C%D9%85%E2%80%8C%D8%B2%D8%A7%D8%AF%D9%87%D8%8C+%D9%86%D8%A7%D8%B5%D8%B1+%D9%85%D9%84%DA%A9+%D9%85%D8%B7%DB%8C%D8%B9%DB%8C%D8%8C+%D8%B3%D9%BE%DB%8C%D8%AF%D9%87%D8%8C+%D8%A7%DB%8C%D8%B1%D8%AC+%D9%82%D8%A7%D8%AF%D8%B1%DB%8C%D8%8C+%D8%A7%D9%86%D8%AA%D8%B8%D8%A7%D9%85%DB%8C%D8%8C+%D8%B4%D9%87%D9%84%D8%A7+%D8%B1%DB%8C%D8%A7%D8%AD%DB%8C%D8%8C+%DA%A9%D8%B4%D8%A7%D9%88%D8%B1%D8%B2%D8%8C+%D8%AC%D9%85%D8%B4%DB%8C%D8%AF+%D9%85%D8%B4%D8%A7%DB%8C%D8%AE%DB%8C%D8%8C+%D9%81%D8%AE%D8%B1%DB%8C+%D8%AE%D9%88%D8%B1%D9%88%D 💚Kelly The Angel (Talk to me)💚 06:19, 14 March 2024 (UTC)

@Kelly The Angel: I tried to remove the custom space by replacing all the spaces in the filename. I was able to upload https://www.youtube.com/watch?v=3oTTPxrI-nA to File:Filme Farsi Yek Chamedan Sex - فیلم ف رسی ی چمدان - گر ا رئوفی پ وین م کوتی.webm for you, please attend to the licensing.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 08:44, 14 March 2024 (UTC)

Thanks! All Iranian audiovisual works released before the year of 1993 are in the public domain 💚Kelly The Angel (Talk to me)💚 10:40, 14 March 2024 (UTC)

@Kelly The Angel: You're welcome! Thanks for adding {{PD-Iran}} and categorizing. I made Category:Videos of films in Persian from 1971 for you.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 10:13, 26 March 2024 (UTC)

missingresult: No result in status data.

@Chicocvenancio: I have been trying to upload 3.78 GB https://www.youtube.com/watch?v=C7BQf3W5dgA to File:Holger Madsen - Towards The Light (Mod Lyset) 1919 4K Vintage Movie ENG DANSK.webm for over a week. I have gotten a bunch of failures, which boil down to 'pywikibot.Error: APIError: missingresult: No result in status data.' Yann wrote "it failed for me both on V2C and with Chunked Uploads". Gory details at User talk:Jeff G.#Big videos. https://commons.wikimedia.org/wiki/Special:UploadStash/file/1at0wrq1en5w.n29kk.122116.webm (which should be "55 min 31 s, 3,032 × 2,160 (3.84 GB)") gives me "Internal Server Error" and "Cannot serve a file larger than 1048576 bytes."   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 10:04, 26 March 2024 (UTC)

Next, I got "An exception occurred: WorkerLostError: b'Worker exited prematurely: signal 15 (SIGTERM) Job: 239.'"   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 12:38, 31 March 2024 (UTC)

Then, I got "An exception occurred: WorkerLostError: b'Worker exited prematurely: signal 9 (SIGKILL) Job: 87.'"   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 23:12, 3 April 2024 (UTC)

Then, I got "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(b\\\'pywikibot.Error: APIError: missingresult: No result in status data.\\\\\\\\n[param: action=upload&filekey=1atvxm9e7uwc.af612.122116.webm&checkstatus=&assert=user&maxlag=5&format=json&token=b01767114f69a0ec19cdb70bac4f1ccd660de323%2B%5C;\\\\\\\\n servedby: mw1491;\\\\\\\\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 15:00, 7 April 2024 (UTC)

Are you there, @Chicocvenancio (WMF)? It's me, Jeff.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 15:04, 7 April 2024 (UTC)

And again: "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(b\\\'pywikibot.Error: APIError: missingresult: No result in status data.\\\\\\\\n[param: action=upload&filekey=1au74x4fo4dk.ksj7po.122116.webm&checkstatus=&assert=user&maxlag=5&format=json&token=e7ac1796dda692f0b16d43aee54815176612b5af%2B%5C;\\\\\\\\n servedby: mw1493;\\\\\\\\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]\\\')>, None)"\')'".   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 00:22, 9 April 2024 (UTC)

And again: "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(b\\\'pywikibot.Error: APIError: missingresult: No result in status data.\\\\\\\\n[param: action=upload&filekey=1aubebzxc2s8.3kv10p.122116.webm&checkstatus=&assert=user&maxlag=5&format=json&token=378dca57cf7d4984fb1e218293e5fbed66148b4c%2B%5C;\\\\\\\\n servedby: mw1410;\\\\\\\\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]\\\')>, None)"\')'". Should I keep trying?   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 20:05, 10 April 2024 (UTC)

And again: "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(b\\\'pywikibot.Error: APIError: missingresult: No result in status data.\\\\\\\\n[param: action=upload&filekey=1augz5dunj5s.uxy0g2.122116.webm&checkstatus=&assert=user&maxlag=5&format=json&token=12cc58031e38d25eaa0266ad9995d5b36616f204%2B%5C;\\\\\\\\n servedby: mw1427;\\\\\\\\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]\\\')>, None)"\')'"   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 10:23, 15 April 2024 (UTC)

And again: "An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(b\\\'pywikibot.Error: APIError: missingresult: No result in status data.\\\\\\\\n[param: action=upload&filekey=1auv1qdpm3i0.oqbmg1.122116.webm&checkstatus=&assert=user&maxlag=5&format=json&token=5ca79758bfbbcaf0604a99384ac478e1661d00b8%2B%5C;\\\\\\\\n servedby: mw1400;\\\\\\\\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]\\\')>, None)"\')'" (sorry, this is a late report because my browser died)   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 02:08, 28 April 2024 (UTC)

@Yann: I am happy to report that this was fixed due to elimination of the "request_terminate_timeout = 201" settings as highlighted in phab:T358308, and I have uploaded https://www.youtube.com/watch?v=C7BQf3W5dgA to File:Holger Madsen - Towards The Light (Mod Lyset) 1919 4K Vintage Movie ENG DANSK.webm. Please attend to the licensing.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 12:46, 29 April 2024 (UTC)

Black videos

With video2commons back on track, I have successfuly been able to upload several dozens of videos today. However, 8 of them have been uploaded completely black (no visible frame?):

- a8257ac3-6435-487d-874a-27dfe888bfe4 - 2024-03-31 21:46:30.416701 - File:Chandrayaan 3 Pragyan turn (53163361031).webm

- d4b0caa7-4dd2-4b8b-9334-a8debd063538 - 2024-03-31 21:45:27.446026 - File:Perseverance drilling operation on Sol 923 (53214667681).webm

- 34335a48-2c96-4a55-a9e8-1169388719c6 - 2024-03-31 21:45:37.782471 - File:Perseverance drilling operation on Sol 923 (53215060114).webm

- 3bff9640-3eec-4514-a3ff-e0a973fb3c2f - 2024-03-31 21:47:02.148309 - File:Perseverance abrasion operations on Sol 858 (53077007146).webm

- 3be47306-fff6-4954-9ed2-8c76708c8274 - 2024-03-31 21:47:12.749224 - File:Perseverance drilling operations on Sol 749 (53077009311).webm

- dad35c91-2e30-45ed-9cf6-96227fcf405d - 2024-03-31 21:47:23.258057 - File:Perseverance drilling operations on Sol 863 (53077202019).webm

- 3f9307f0-2805-49e0-ad71-4eb0b9a2e44e - 2024-03-31 21:47:33.493983 - File:Perseverance drilling operations on Sol 863 (53077202089).webm

- 1903a41a-9127-47f1-98c3-d6bc902c5e50 - 2024-03-31 21:47:43.950239 - File:Perseverance abrasion operations on Sol 858 (53077417225).webm

Was it a temporary problem, or is it a bug when trying to convert these specific files? The jobs "succeeded" without any visible error from my side. vip (talk) 00:40, 1 April 2024 (UTC)

Large uploads smoother

https://phabricator.wikimedia.org/T358308

thanks to User:CGoubert-WMF, User:HNowlan (WMF) and User:Bawolff, large uploads are now probably smoother. maybe v2c also benefits from this? how's your experience recently? RZuo (talk) 21:13, 27 April 2024 (UTC)

I should mention that I'm still aware of at least two issues that might affect big uploads (interuption during deployments, and false positives when scanning for bad files) however both should happen a lot less then the previous issue that was recently fixed, so hopefully things are working smoother now even if not perfect. Bawolff (talk) 22:53, 27 April 2024 (UTC)

File:Discovering Tenggol- Aerial Views and Submerged Delights in 4K.webm 3.28 gb, successful in 1 try. RZuo (talk) 11:51, 28 April 2024 (UTC)

File:Data Center Tour & Technical Deep Dive into the Power, Data and Cooling Infrastructure!.webm 3.31 gb success in 1 try. RZuo (talk) 14:42, 28 April 2024 (UTC)

@Bawolff: Hi, I got a message An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'Sorry, but files larger than 4GB can not be uploaded even with server-side uploading. This task may need manual intervention.\\\')>, None)"\')'. However the MP4 file is only 1.252 GB. So how is it possible to get larger than 4 GB here? Thanks, Yann (talk) 10:45, 14 May 2024 (UTC)

Its hard to know without looking at the file (and possibly knowing more about mp4 internals then i do), but for some files there can be transcoding options that well normally work well might work terribly for some specific file. As an aside as far as 4gb limit goes on video2commons, i submitted [8] but its waiting on one of the video2commons maintainers to review it (i think that is @Zhuyifei1999 ) Bawolff (talk) 20:43, 14 May 2024 (UTC)

@Bawolff: Thanks for your answer. It is not the only problem. See the screenshot I posted below. Yann (talk) 22:10, 14 May 2024 (UTC)

The problems below all sound like variations on out-of-memory errors (the cannot allocate memory error very obviously looks like OOM, but the errors related about processes being killed sound like they could also be OOM related errors). I don't know enough how video2commons works to say more than that. Perhaps the tool in question needs to be modified to do less things in parallel. Bawolff (talk) 00:19, 15 May 2024 (UTC)

@Bawolff: I wonder if I should open bug reports, and with what information? Yann (talk) 08:15, 15 May 2024 (UTC)

File already exists. Please choose another name.

What if I'm trying to repair an upload using the tool? There should be an "I actually mean to do this" checkbox when setting up a task. Arlo James Barnes 20:36, 30 April 2024 (UTC)

@Arlo Barnes: I agree. This problem is also discussed above at #Task is Pending, #Allowing uploads over deleted files, and #MaybeEncodingError: PicklingError.   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 04:38, 1 May 2024 (UTC)

WorkerLostError (again)

Hi, I got this error while uploading File:Paths to Paradise (1925) by Clarence G. Badger.webm (1.2 GB): An exception occurred: WorkerLostError: b'Worker exited prematurely: signal 9 (SIGKILL) Job: 621. Yann (talk) 17:43, 7 May 2024 (UTC)

Still failing half of the time

Hi, I have a number of videos now running, but after a few successful uploads, I got several fails, with different error messages: the PicklingError already reported (x3), An exception occurred: OSError: b'[Errno 12] Cannot allocate memory' (x2), and fails without a meaningful error message. None of them are more than 1.5 GB. So still very far from working properly. Yann (talk) 16:50, 11 May 2024 (UTC)

General failure

It seems V2C completely crashed. Yann (talk) 15:46, 14 May 2024 (UTC)

@Yann: That is unfortunate. Did you request SSU for The Blot?   — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 09:06, 15 May 2024 (UTC)

Yes. I restarted the failed tasks. Yann (talk) 09:09, 15 May 2024 (UTC)