Emulator Coder
Joined: 3/9/2004
Posts: 4588
Location: In his lab studying psychology to find new ways to torture TASers and forumers
New version of TVCMan (v1.3) has been uploaded. What's New:
  • Version number is now displayed in output, so you know which version you have.
  • Libraries updated (Fixes against new TLS attacks).
  • Switched to new SQL library (cleaner code).
  • Path parsing now looks for / and \ instead of platform specific slash, to ensure various custom scripts work well.
  • MD5 hashing now displays a progress bar.
  • Windows builds displays hash/upload progress in title bar.
Warning: Opinions expressed by Nach or others in this post do not necessarily reflect the views, opinions, or position of Nach himself on the matter(s) being discussed therein.
Emulator Coder
Joined: 3/9/2004
Posts: 4588
Location: In his lab studying psychology to find new ways to torture TASers and forumers
New version of TVCMan (v1.4) has been uploaded. What's New:
  • Fixed Windows builds incorrectly registering 4GB+ file sizes.
Warning: Opinions expressed by Nach or others in this post do not necessarily reflect the views, opinions, or position of Nach himself on the matter(s) being discussed therein.
Emulator Coder
Joined: 3/9/2004
Posts: 4588
Location: In his lab studying psychology to find new ways to torture TASers and forumers
New version of TVCMan (v1.5) has been uploaded. What's New:
  • Increased file read buffer size. Should speed up hashing on some systems.
Warning: Opinions expressed by Nach or others in this post do not necessarily reflect the views, opinions, or position of Nach himself on the matter(s) being discussed therein.
Post subject: Site Update
Emulator Coder
Joined: 3/9/2004
Posts: 4588
Location: In his lab studying psychology to find new ways to torture TASers and forumers
The encoders site now supports videos up to 64GB in size.
Warning: Opinions expressed by Nach or others in this post do not necessarily reflect the views, opinions, or position of Nach himself on the matter(s) being discussed therein.
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11492
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
I've been uploading 7GB with tvcman for a whole day, the uploader tells it's finished, but PHP is unavailable. And the site shows only... 600MB uploaded! https://encoders.tasvideos.org/status.html
MD5: 802173f8b99d69ba92ce155ae6359f08
Continuation ID: 245
 7760770756/7760770756 [*************************] 100% 104.379 KB/s  0:00:00:00
Apache available but PHP is not, retrying in 30 seconds...
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.
Emulator Coder
Joined: 3/9/2004
Posts: 4588
Location: In his lab studying psychology to find new ways to torture TASers and forumers
And which version of TVCMan are you using?
Warning: Opinions expressed by Nach or others in this post do not necessarily reflect the views, opinions, or position of Nach himself on the matter(s) being discussed therein.
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11492
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
TASVideos Channel Manager v1.5 Copyright (C) Nach 2012-2013
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.
Emulator Coder
Joined: 3/9/2004
Posts: 4588
Location: In his lab studying psychology to find new ways to torture TASers and forumers
What did you see after the 30 seconds?
Warning: Opinions expressed by Nach or others in this post do not necessarily reflect the views, opinions, or position of Nach himself on the matter(s) being discussed therein.
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11492
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
Nothing (blinking cursor). It's still on, I'm afraid if I close it, the upload will also stop.
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.
Emulator Coder
Joined: 3/9/2004
Posts: 4588
Location: In his lab studying psychology to find new ways to torture TASers and forumers
Well, it still appears to be uploading. My guess is there was a problem server side which the client side didn't properly detect till the end, and the continuation post completion stops updating the progress bar. So yes, leave it open, and it'll probably close when the upload is complete. I'll look into this, thanks for the report.
Warning: Opinions expressed by Nach or others in this post do not necessarily reflect the views, opinions, or position of Nach himself on the matter(s) being discussed therein.
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11492
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
Successfully uploaded.
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.
Emulator Coder
Joined: 3/9/2004
Posts: 4588
Location: In his lab studying psychology to find new ways to torture TASers and forumers
Yes, I figured it would. Thanks for the update. The code is pretty resilient in terms of the networking it does. However I see I need to put more work into the UI aspect.
Warning: Opinions expressed by Nach or others in this post do not necessarily reflect the views, opinions, or position of Nach himself on the matter(s) being discussed therein.
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11492
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
Upload "encode_youtube.mkv fa1a4f567b7732f1ca6671644539ba86 36.77 GB" won't be resumed, I found a bug, will send a fixed version.
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11492
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
Uh, 266dc7c87d56e2621a95df353c277f7a was also wrong.
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11492
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
I also have a feature request: logging continuation IDs along with start date/size/hashsum. Allows to not rehash something that was interrupted, like a crash, or manual stop. Even when stopping manually, it's not always possible to look up the continuation ID above, because for me, each time it wants to update the line where it tells the uploaded size and stuff, it starts a new line. 8430059520/39565396408 [*****--------------------] 21% 106.666 KB/s 3:07:10:54 8430059520/39565396408 [*****--------------------] 21% 106.666 KB/s 3:07:10:54 8430075904/39565396408 [*****--------------------] 21% 106.666 KB/s 3:07:10:54 8430075904/39565396408 [*****--------------------] 21% 106.666 KB/s 3:07:10:54 8430092288/39565396408 [*****--------------------] 21% 106.666 KB/s 3:07:10:53 8430092288/39565396408 [*****--------------------] 21% 106.666 KB/s 3:07:10:53 8430108672/39565396408 [*****--------------------] 21% 106.666 KB/s 3:07:10:53 8430108672/39565396408 [*****--------------------] 21% 106.666 KB/s 3:07:10:53 So it makes scrolling up to see the continuation ID impossible.
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.
Guga
He/Him
Joined: 1/17/2012
Posts: 838
Location: Chile
@echo off
tvcman --list
PAUSE
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11492
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
Oh! Cool. Added tvcman-log.bat to the package, will release soon.
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.
AntyMew
It/Its
Encoder, Player (35)
Joined: 10/22/2014
Posts: 425
feos wrote:
Uh, 266dc7c87d56e2621a95df353c277f7a was also wrong.
Bump Also, I accidentally deleted a831bffab0395a853af27f76b7ff21b3 from the directory I was uploading from, and apparently tvc manager doesn't retry when that happens EDIT: Oh, nvm, I guess when the hash is the same a new upload overwrites the old one. Neat
Just a Mew! 〜 It/She ΘΔ 〜
Post subject: TVCMan 1.6 released
Emulator Coder
Joined: 3/9/2004
Posts: 4588
Location: In his lab studying psychology to find new ways to torture TASers and forumers
New version of TVCMan (v1.6) has been uploaded. What's New:
  • Now limits upload chunk size to 10MB to adhere to new limitation being enforced.
  • Switched to faster MD5 hash implementation.
  • Libraries updated (Fixes against new TLS attacks).
New versions of PHP allow for the server to be easily DoS'd if large chunks are processed by it. Therefore, I'm going to be enforcing a new length limit, and this version will be required to upload any encode greater than 10MB in size. Please test this new version as soon as possible so I can ensure the site changes aren't problematic.
Warning: Opinions expressed by Nach or others in this post do not necessarily reflect the views, opinions, or position of Nach himself on the matter(s) being discussed therein.
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11492
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
Here's the lack of newline that I mentioned some time earlier. Even if it's already fixed, just posting the pic for clarity:
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.