Replies: 2 comments 21 replies
-
|
It seeems a bug RPI kernel and/or broadcom firmware. Don't update it without needs |
Beta Was this translation helpful? Give feedback.
-
|
@svpcom which hardware do you suggest (airunit & gs)? I expect ~30ms - 50ms lantency no more than 80ms(I think) Of course, I need wfb_ng software features :) |
Beta Was this translation helpful? Give feedback.
-
|
The most of latency are from camera, video codec, video decoder and monitor. wfb-ng layer adds only ~5ms of latency itself. |
Beta Was this translation helpful? Give feedback.
-
camera 720p@60 16ms x 2 total: [32+5+cc-16+dd (+16)]ms So which cc(codec) & dd(decoder) hardware do you think is best for entry level try of wfb_ng? |
Beta Was this translation helpful? Give feedback.
-
|
Please note that all elements of this pipeline can be NOT in sync between each other (for example camera with rolling shutter can buffer one or two frames inside and the same can be for h264 decoders/encoders). For my experiments the best hardware can be RPI3 or jetson with MIPI cameras. For x86 the minimum latency I got with sw codec x264enc/dec (with zerolatency profile) and intel video cards (xvimagesink). But for example intel hw vaapi codecs add a lot of latency. Also you need to disable double/triple video buffers in X11 settings. But unversal rule of thumb to reduce latency - use maximum camera fps that is available, because this is only way to reduce latency which depends from some number of buffered frames |
Beta Was this translation helpful? Give feedback.
-
Currently, I'm testing with RPI 3b+ for airunit. And I noticed that 1280x720@60FPS, takes about 107M memory. If I use RPI Zero 2W( 512MB， half of the RPI3b+) camera + RPI3b+（ground station）, which I'll get: @svpcom so I can't get 50ms latency @fps60 right? Or should I have to use PI4, what do you recommend?
|
Beta Was this translation helpful? Give feedback.
-
The image will suddenly stop for a while when fps60, and latency is really NOT good compared to fps30. So what I have missed here? AirUnit: PC side: fps60, with a pause, and latency really highfps60.mp4fps30 latency 140 - 160 - 180fps30.mp4 |
Beta Was this translation helpful? Give feedback.
-
There is no packet lost and need fec correction. And there is link to test videos.
|
Beta Was this translation helpful? Give feedback.
-
|
Replace core2 duo with more recent cpu family (like i3 or i7). For example I use lenovo x230 laptop (i7, >10 years old) |
Beta Was this translation helpful? Give feedback.
-
|
lenovo SL410 [Mobility Radeon HD 4530 should support H264 hardware decoder. Why the gstream use CPU instead??? The above output suggests "have a "hybrid graphics" system, with an iGP (integrated graphics processor inside the CPU) and a dedicated GPU. "
|
Beta Was this translation helpful? Give feedback.
-
|
gstreamer is just collection of blocks that you can combine into pipeline. You can edit default wfb-ng pipeline and replace avdec_h264 with hw-accelerated decoder available on your hadrware. But for my case (intel i7 with vaapi) vaapih264dec add > 100ms latency |
Beta Was this translation helpful? Give feedback.
-
|
I think amd driver is NOT supporting ubuntu 20.04 any more. Hummm,,, really old computer, 10years :)
|
Beta Was this translation helpful? Give feedback.
-
Pre-condition:
sudo apt update && sudo apt upgradesudo ./dkms-install.shQuestion
Why 1280 x 720 @60fps get stucked?
When I try "framerate=60/1", video stream got stucked, use "framerate=30/1" it's ok.
when video stream get stucked, I can't use the camera anymore. It should be rebooted.
Beta Was this translation helpful? Give feedback.
All reactions