*** tpb has joined #timvideos | 00:00 | |
*** tija has joined #timvideos | 00:53 | |
* CarlFK rages at youtube lack of error handling | 00:56 | |
CarlFK | LeeS: did you write a youtube uploader? | 00:59 |
---|---|---|
CarlFK | someone did, wondering how they handle this: | 00:59 |
techman83 | I wrote one, but it's rudimentary and in perl | 01:00 |
techman83 | and requires a monkey patched version of LWP::Authen::Oauth2 | 01:00 |
CarlFK | https://github.com/CarlFK/veyepar/blob/master/dj/scripts/youtube_v3_uploader.py#L137 | 01:00 |
tpb | Title: veyepar/youtube_v3_uploader.py at master · CarlFK/veyepar · GitHub (at github.com) | 01:00 |
CarlFK | return build(YOUTUBE_API_SERVICE_NAME, YOUTUBE_API_VERSION, http=credentials.authorize(httplib2.Http())) | 01:01 |
techman83 | (now that I'm a maintainer for LWP::Authen::Oauth2 I should fix that) | 01:01 |
CarlFK | which calls into some code supplied by google (I guess) | 01:01 |
CarlFK | File "/usr/lib/python2.7/httplib.py", line 1033, in getresponse | 01:01 |
CarlFK | raise ResponseNotReady() | 01:01 |
*** tvCommitBot has joined #timvideos | 01:02 | |
tvCommitBot | [gst-switch] mithro closed pull request #171: Fix lint - indentation (master...indent_fix) http://git.io/8_Mw3w | 01:02 |
*** tvCommitBot has left #timvideos | 01:02 | |
CarlFK | http://paste.ubuntu.com/9790135/ | 01:02 |
tpb | Title: Ubuntu Pastebin (at paste.ubuntu.com) | 01:02 |
CarlFK | techman83: how did you handle ... ummm... stuff like that? | 01:03 |
techman83 | Still absorbing my coffee | 01:03 |
techman83 | But I didn't actually hit anything like that | 01:04 |
techman83 | http://stackoverflow.com/questions/3231543/python-httplib-responsenotready | 01:04 |
tpb | Title: http - Python httplib ResponseNotReady - Stack Overflow (at stackoverflow.com) | 01:04 |
techman83 | Being a rudimentary script, I uploaded each file independently | 01:05 |
techman83 | just a did a for loop in each directory | 01:05 |
mithro | CarlFK / xfxf: can I send an email to Patrick saying he can have his machine back? | 01:06 |
CarlFK | mithro: sec.. let me get this file uploaded. should take under 5 min | 01:08 |
CarlFK | techman83: did you ever see errors that you wern't sure what to do about, so just try again and it works? | 01:09 |
CarlFK | that's what I bump into. not sure how a program should deal with them | 01:09 |
techman83 | Well I created the video first, with meta data - so on success you get an id, then I did a chunked upload against that | 01:13 |
techman83 | but any failures I deleted and re-did them | 01:13 |
CarlFK | deleted by hand using the web UI? | 01:16 |
techman83 | yeah, ugly I know. But it was 1 or 2 at the time, wasn't worth expending the effort to work out what the issue was. | 01:16 |
techman83 | In recent uploads I didn't see any issues at all | 01:17 |
techman83 | Uploaded ~500 historic videos with no problems late last year | 01:17 |
CarlFK | weird. any idea why the problem went away? | 01:18 |
techman83 | probably something I was doing wrong initially | 01:19 |
techman83 | Certainly not rate limiting, I was sitting on the back of a 10G link :P | 01:23 |
CarlFK | were all on the 10g, or just the historic that didn't error? | 01:25 |
techman83 | All | 01:26 |
CarlFK | huh. | 01:26 |
CarlFK | my guess is unstable connection hiccups cause the error. whatever that means ;) | 01:26 |
techman83 | Possibly | 01:26 |
techman83 | I've not pondered how to do it better yet | 01:27 |
CarlFK | I know of two kinds of problems | 01:28 |
CarlFK | 1. something that needs to be fixed before it won't error, like invalid chars in the title, or title too long | 01:29 |
techman83 | Ahh, I have logic for handling long titles | 01:30 |
CarlFK | 2. connection problems (or whatever) that can be retried and it will prolly work | 01:30 |
CarlFK | mithro: Upload: 12% ||||| | Time: 0:00:41 1.62 MB/s | 01:31 |
CarlFK | then peter can have his box | 01:31 |
CarlFK | techman83: how confidant are you that you have covered all of the cases? ;) | 01:31 |
CarlFK | cuz I keep discovering new ones, like > and < are not allowed. | 01:32 |
techman83 | Not very :P | 01:32 |
CarlFK | so looping will fix the connection problems, but not the "invalid title" like stuff. | 01:32 |
CarlFK | I am guessing it can be sorted out, but ... its hard | 01:33 |
techman83 | Since really their edge cases, I'd likely build some sort of upload queue | 01:35 |
techman83 | and have a failed queue | 01:35 |
CarlFK | so if something errors once, it gets held up till a human looks at it? | 01:37 |
techman83 | Well to start with, but you wouldn't want it retrying too many times without human interaction | 01:38 |
techman83 | Code around the common issues | 01:38 |
techman83 | Wonder if they ever fixed the license bug in the API | 01:39 |
CarlFK | that sounds familiar | 01:40 |
CarlFK | mithro: progress is progressing, but the ETA is going in the other direction: Upload: 65% |||||||||||||||||||||||||| | Time: 0:02:05 2.75 MB/s | 01:41 |
CarlFK | mithro: peter can have his box back | 01:54 |
mithro | Peter or patrick? | 02:01 |
CarlFK | um.. who's ever box it is | 02:11 |
tija | mithro: how much did your small monitors cost you (I guess they are 7 inch)? | 02:48 |
mithro | tija: about $80 USD | 02:48 |
tija | mithro: and from where did you buy them? | 02:49 |
mithro | tija: Deal Extreme | 02:49 |
*** hyades has joined #timvideos | 03:16 | |
mithro | MaZderMind / LeeS: now we need to figure out why "make integration" fails on travis sometimes.... | 03:58 |
LeeS | Yay fun for us | 04:12 |
*** Niharika has joined #timvideos | 05:09 | |
CarlFK | http://youtu.be/S2iJB4KRJac 1h of empty lectern, then someone shows up. | 05:20 |
tpb | Title: Open Hardware Miniconf - YouTube (at youtu.be) | 05:20 |
CarlFK | lol @ "You can just do upside-down floor division:" http://stackoverflow.com/questions/14822184/is-there-a-ceiling-equivalent-of-operator-in-python | 05:23 |
tpb | Title: Is there a ceiling equivalent of // operator in Python? - Stack Overflow (at stackoverflow.com) | 05:23 |
*** tija has quit IRC | 06:53 | |
*** hyades has quit IRC | 07:25 | |
*** f15h has joined #timvideos | 08:07 | |
*** LeeS has quit IRC | 08:12 | |
*** slomo has joined #timvideos | 08:13 | |
*** slomo has joined #timvideos | 08:13 | |
*** LeeS has joined #timvideos | 08:18 | |
*** f15h has quit IRC | 08:23 | |
*** Niharika has quit IRC | 08:33 | |
*** tvCommitBot has joined #timvideos | 09:13 | |
tvCommitBot | [gst-switch] leesdolphin opened pull request #174: Added Python 3 support (master...python-3-support) http://git.io/h1o47Q | 09:13 |
*** tvCommitBot has left #timvideos | 09:13 | |
*** Niharika has joined #timvideos | 09:42 | |
*** Niharika has quit IRC | 09:47 | |
MaZderMind | CarlFK: re yt-uploader - we're using this (it couples into our recording tracking system but should be fairly readable: https://github.com/voc/scripts/blob/master/c3tt-publishing/youtube_client.py | 10:59 |
tpb | Title: scripts/youtube_client.py at master · voc/scripts · GitHub (at github.com) | 10:59 |
MaZderMind | we also have this to link to conference organisators, so they can authorize us to push videos to their channel without us doing much: https://github.com/voc/youtube-oauth | 10:59 |
tpb | Title: voc/youtube-oauth · GitHub (at github.com) | 10:59 |
MaZderMind | deleting on re-release was a issue for us, too, this year :) | 11:01 |
MaZderMind | mithro: I'll write down my DBus findings/problems soon, just wanted to be sure that I'm not just holding it wrong. | 11:23 |
MaZderMind | Also I have a possible fix that I want to test before discussing if we want it | 11:23 |
MaZderMind | re travis: I'll have a look but it's the first time I'm working with travis, too | 11:23 |
LeeS | RE: travis - I have taken the build environment and tried to build gst-switch using it and it runs fine. So I'm thinking it's the fact that Travis runs it in a VM. So I'm just installing a VM to try it. | 11:25 |
LeeS | Either that or it is some horrible race condition and I just want to cry | 11:26 |
*** Niharika has joined #timvideos | 11:32 | |
thaytan | LeeS, in a VM you may not have an Xv port | 11:36 |
thaytan | the UI uses that for display | 11:36 |
MaZderMind | you're talking about https://travis-ci.org/timvideos/gst-switch/jobs/47472775 ? | 11:38 |
tpb | Title: Travis CI - Free Hosted Continuous Integration Platform for the Open Source Community (at travis-ci.org) | 11:38 |
MaZderMind | that looks like the srv is not (fast enough?) opening its preview-ports for given sources | 11:38 |
LeeS | I am talking about that log; it looks like that could with be the point | 11:41 |
*** Niharika has quit IRC | 11:41 | |
*** f15h has joined #timvideos | 11:43 | |
*** Niharika has joined #timvideos | 12:17 | |
*** Niharika has quit IRC | 12:22 | |
*** slomo_ has joined #timvideos | 12:25 | |
*** slomo_ has joined #timvideos | 12:25 | |
*** f15h has quit IRC | 12:28 | |
*** slomo has quit IRC | 12:29 | |
*** Niharika has joined #timvideos | 12:32 | |
*** diadara has joined #timvideos | 13:03 | |
LeeS | So the GStreamer outputs do not appear inline; they are read from the logs. Do you know if there would be a way to tell the server to output to stdout or stderr | 13:06 |
LeeS | MaZderMind: I think you are right; I've got the debug inline in this build(https://travis-ci.org/leesdolphin/gst-switch/jobs/47646486#L1532) and it looks like video on port 3004 is not starting until after we run the checks. | 14:55 |
tpb | Title: Travis CI - Free Hosted Continuous Integration Platform for the Open Source Community (at travis-ci.org) | 14:55 |
LeeS | Maybe we should wait 1 or 2 seconds before checking it. | 14:55 |
LeeS | ping mithro | 14:56 |
*** slomo_ has quit IRC | 15:08 | |
*** slomo has joined #timvideos | 15:08 | |
*** slomo has joined #timvideos | 15:08 | |
*** Niharika has quit IRC | 15:14 | |
*** tariq786 has quit IRC | 15:41 | |
*** tariq786 has joined #timvideos | 15:42 | |
*** Niharika has joined #timvideos | 15:46 | |
*** slomo_ has joined #timvideos | 16:32 | |
*** slomo_ has joined #timvideos | 16:32 | |
*** slomo_ has joined #timvideos | 16:33 | |
*** slomo_ has joined #timvideos | 16:33 | |
*** slomo_ has quit IRC | 17:01 | |
*** slomo has quit IRC | 18:29 | |
*** Niharika has quit IRC | 18:35 | |
*** slomo has joined #timvideos | 18:39 | |
*** slomo has joined #timvideos | 18:39 | |
*** puck has quit IRC | 20:35 | |
*** puck has joined #timvideos | 20:44 | |
*** slomo has quit IRC | 21:16 | |
*** diadara has quit IRC | 22:06 | |
*** puck has quit IRC | 23:14 | |
mithro | heyo | 23:18 |
*** puck has joined #timvideos | 23:18 | |
mithro | LeeS / MaZderMind: I'm back at work and will doing a coding sprint there, so my time is going to be limited | 23:18 |
mithro | MaZderMind: a temporary work around for the dbus issue is to just poll rather than get notified | 23:19 |
*** puck has quit IRC | 23:21 | |
*** puck has joined #timvideos | 23:21 | |
MaZderMind | mithro: yes, sure, bit I want to make things better - not worse :) And also if I change it later, I have to rewrite the polling-code as well | 23:23 |
MaZderMind | LeeS: can you add this sleep and we'll see how/if travis changes its behaviour? | 23:24 |
mithro | MaZderMind: sometimes an imperfect solution is better then a perfect one :) | 23:40 |
Generated by irclog2html.py 2.13.1 by Marius Gedminas - find it at mg.pov.lt!