*** tpb has joined #timvideos | 00:00 | |
*** springermac has joined #timvideos | 00:35 | |
*** springermac has quit IRC | 00:36 | |
*** springermac has joined #timvideos | 00:40 | |
*** futarisIRCcloud has joined #timvideos | 00:41 | |
*** hozer has quit IRC | 03:05 | |
*** rohitksingh_work has joined #timvideos | 03:50 | |
thaytan | mithro, webm, cool | 04:41 |
---|---|---|
gsmalik | Anyone willing to have a chat about the webm encoder? Please let me know. Shifting to a webm will be especially useful if we want some AI overlays later on(Automatic text reads,language conversion etc) | 04:50 |
thaytan | gsmalik, why will webm help with those? | 04:51 |
gsmalik | Potentially smaller input->better onchip weight storage->faster realtime CNN compute. I work in the field of FPGA based AI for my PhD and the biggest bottleneck is always not being able to store everything onchip(BRAM) | 04:54 |
thaytan | can you do the CNN on encoded data though? | 04:56 |
thaytan | what input does the CNN need? | 04:57 |
thaytan | gsmalik^ | 05:02 |
gsmalik | CNN should be, in theory, be trainable on encoded data. CNN would need the weights(after learning) and an input video frame as input | 05:14 |
gsmalik | The input video frame can be encoded, to the best of my knowledge. | 05:15 |
thaytan | gsmalik, encoded video frames aren't independent entities though | 05:17 |
thaytan | most of them are deltas from some previous (or future) frames | 05:17 |
thaytan | webm doesn't do out-of-order encoding, so at least all the encoded frames are in the original order | 05:17 |
futarisIRCcloud | Don't you mean VP8, VP9 or AV1 codec? I think licensing may be an issue. I think you can only get the gateware source if you are a semiconductor company. | 05:23 |
gsmalik | thaytan: Thanks for the info. Since they are deltas, in my opinion, which could be wrong, that could be just adding the delta to the current frame in the BRAM if needed. This should ideally make the CNN compute even faster :P | 05:26 |
gsmalik | I could be totally wrong here. I will need to learn about webm more before being sure. What do you think? | 05:26 |
thaytan | I am dubious that a CNN could extract useful information from an encoded webm | 05:27 |
gsmalik | Even if no AI, do you think moving to webm would be helpful(As part of my gsoc project)? | 05:27 |
thaytan | I think moving to webm can be useful for reducing the bandwidth used getting video to/from capture devices | 05:27 |
thaytan | and certainly for direct streaming if webm is the target format for upload | 05:27 |
gsmalik | thaytan: http://www.rle.mit.edu/eems/wp-content/uploads/2016/02/eyeriss_isscc_2016.pdf | 05:28 |
gsmalik | I am working with these people and I think they use encoded data. Ill ask them in the next meeting(This Thursday) | 05:28 |
thaytan | gsmalik, I see a mention of using Run Length Encoding for compression from RAM | 05:31 |
thaytan | which is a simple linear compression | 05:31 |
thaytan | and can be decompressed in a stream | 05:32 |
thaytan | I can see something like JPEG working though | 05:32 |
thaytan | since each frame is independent, and macroblocks can be decoded in streaming fashion | 05:33 |
thaytan | if the CNN is set up to processing 8 rows at a time | 05:33 |
gsmalik | I see. OK. Let me think about this. This was really fun! | 05:36 |
*** f15h has joined #timvideos | 07:19 | |
*** Akhil_singh has joined #timvideos | 08:54 | |
*** akhil_singh has joined #timvideos | 08:55 | |
*** akhil_singh has quit IRC | 09:07 | |
*** f15h has quit IRC | 09:14 | |
*** futarisIRCcloud has quit IRC | 09:19 | |
*** rohitksingh_work has quit IRC | 12:36 | |
*** rohitksingh has joined #timvideos | 13:25 | |
*** f15h has joined #timvideos | 13:40 | |
*** rohitksingh has quit IRC | 13:52 | |
*** rohitksingh has joined #timvideos | 13:55 | |
*** fumblehool has joined #timvideos | 13:58 | |
*** rohitksingh1 has joined #timvideos | 14:06 | |
*** rohitksingh1 has quit IRC | 14:28 | |
*** f15h has quit IRC | 14:30 | |
*** rohitksingh1 has joined #timvideos | 14:44 | |
*** rohitksingh has quit IRC | 14:44 | |
*** rohitksingh has joined #timvideos | 15:24 | |
*** akhil_singh has joined #timvideos | 15:27 | |
*** rohitksingh has quit IRC | 15:35 | |
akhil_singh | Hello everyone, I am interested in doing spectrum sensing using FPGA. Is any mentor interested in mentoring me for the same. For introduction i have published a paper on Cooperative spectrum sensing of OFDM signals. But that was done using matlab. Now as a part of my GSOC project this year i really want to implement spectrum sensing using FPGA which will be a real fun. So is their any mentor available for guiding me for the same | 15:50 |
*** f15h has joined #timvideos | 15:56 | |
CarlFK | akhil_singh: I can't help you but I am going to fwd this onto someone who may be interested | 15:56 |
akhil_singh | CarlFK : Thanks. | 15:58 |
*** f15h has quit IRC | 15:59 | |
*** f15h has joined #timvideos | 15:59 | |
*** f15h_ has joined #timvideos | 16:00 | |
*** f15h has quit IRC | 16:03 | |
*** f15h_ has quit IRC | 16:05 | |
*** rohitksingh has joined #timvideos | 16:05 | |
*** rohitksingh has quit IRC | 16:27 | |
*** rohitksingh has joined #timvideos | 16:29 | |
*** rohitksingh has quit IRC | 16:40 | |
*** rohitksingh has joined #timvideos | 16:40 | |
*** f15h_ has joined #timvideos | 16:50 | |
*** rohitksingh has quit IRC | 17:04 | |
*** rohitksingh has joined #timvideos | 17:08 | |
*** rohitksingh has quit IRC | 17:10 | |
*** rohitksingh has joined #timvideos | 17:12 | |
*** f15h_ has quit IRC | 17:32 | |
*** samsagaz has joined #timvideos | 17:38 | |
*** rohitksingh has quit IRC | 17:43 | |
*** rohitksingh has joined #timvideos | 17:52 | |
*** rohitksingh1 has quit IRC | 18:13 | |
*** rohitksingh1 has joined #timvideos | 18:38 | |
*** rohitksingh has quit IRC | 18:40 | |
*** rohitksingh1 has quit IRC | 18:44 | |
*** rohitksingh has joined #timvideos | 18:47 | |
*** fumblehool has quit IRC | 18:58 | |
*** akhil_singh has quit IRC | 19:13 | |
*** rohitksingh has quit IRC | 19:47 | |
*** f15h has joined #timvideos | 21:00 | |
*** f15h has quit IRC | 21:19 | |
*** suhdood has joined #timvideos | 22:56 | |
*** suhdood has quit IRC | 23:11 | |
*** futarisIRCcloud has joined #timvideos | 23:26 |
Generated by irclog2html.py 2.13.1 by Marius Gedminas - find it at mg.pov.lt!