todonext UNFIXABLE BUGS - sshfs is flakey, and sometimes hangs forever - And sometimes it just dies - Sometimes /dev/video0 goes away. We can switch, but I think that video crashes as well, etc, etc, until there is nothing let by /dev/video10, which I think is something else (not the webcam), which then hangs forever.
VERSION 2
Expose over HTTP, to massively improve the speed - The FileSystemAPI appears to be entirely in serial? OR SSHFS is entirely in serial? - We will need to secure it, but... that shouldn't be impossible. - Ugh... we need HTTPS, whic his annoying, but... I guess we can do that... - Support PUT, and make it expose FileSystemAPI - Add a button beside "Change Video Folder" and "Select Folder", to "set URL"
Re-encode video after finding activity - Will greatly reduce the size, allowing us to play the video at a much higher rate
RTP streaming - WebRTC (S)RTP / DTLS - SRTP eats the DTLS connection, like websockets do, which makes things difficult - ALTHOUGH, maybe this means we don't have to implement MOST of DTLS, so we could implement it ourself? - We COULD try to find a SRTP server. Apparently gstreamer handles is? - And... the web connections is extremely particular and wants us to pre-load it with session ids, ice credentials?, etc. - We could try it without them? - We MIGHT be able to craft a static SDP - TRY to get it working with GSTREAMER. - Apparently whipclientsink might do what we want? - https://claude.ai/chat/7da8d224-01b6-4700-b793-de6729fe8bf9 - We'll need a real cert as well, so... we'll need a letsencrypt loop, etc. Probably just a screen, which creates a new cert every week. - We can setup the DNS manually, the IP won't change often
Browser video/file caching? - We should be able to store 1GB easily - Maybe... 1GB per speed (this will mean higher speeds will be able to cache ALL the video)
Display connected to main raspberry pi, which shows the live video?
4K camera + split to emit 4K@1fps and 1080p@15fps? - We MIGHT want to just get a pi 5, as 4K probably needs software encoding for 4K anyways
Maybe nice to have Lower latency live stream - Read more often? - Read the actively writing file, up to a keyframe, and play that? Cloud storage - Mostly for sped up video, which we will have a LOT less of (especially at 100X speed? Although with only keyframes maybe we need 1000X speed)
Folder grid toggle - In video, replace video player with a grid of images, sampled based on the playback rate - And infinitely scroll up/down - Can change size of grid - One it gets below 4 images, we will just show a single image, and scrolling moves entirely to the next one (otherwise scrolling is annoying) - Still moves trackbar, ALTHOUGH, also adds a range to the trackbar, to represent the images being shown - Which, as the trackbar is relative to playback rate, means it always have a constant size on the trackbar (absent rounding), likely between 50% and 10% - Hotkey navigation works - Arrows is a full row, single frame is a single frame - Easy toggle back to video
Version 2 - Just a page of events - Ongoing events can be watched live - Time based breakdown, with cascading time selector - Defaulting to show today, with activity count (both # and time) in the time selector - Video player trackbar DOES NOT shot absolute time, but instead show events - Size is relative to event time - If events are too small, they get combined - If there are too sparse, they can get enlarged with a special UI - Each event has different playback rates per event - With files chunking if the event is too long - At a high enough playback rate we just have 1 frame - IF we reduce the frame count too low, we pick high activity frames! - Playback chains events together explicitly - An event will always get 1 frame, no matter the playback rate - Automatically choose an underlying playback rate based on the requested playback rate, so the user can just increase by 2X as long as they want, and we fudge between files with clientside playback rate, switching once we read the next file rate. - AND, live view, which just shows WebRTC streamed video. - ALSO, high quality and low quality video - If we take a 4K picture every... 30 seconds, we can actually make a high quality video. BUT, it will be slow to load, so we don't always want that... - Still have slideshow view - Highlight with the event they came from
NOTE2 this command will backup the pi sd (IF THE DRIVE IS CORRECT, run diskpart then list disk to know) dd if=\.\PhysicalDrive9 of=D:\repos\camera3\pi.img bs=4M", NOTE3 this command will restore the pi sd
Manually have to run these steps...
diskpart
list disk
select disk 9
clean
Then in an admin terminal
dd of=\\.\PhysicalDrive9 if=D:\repos\camera3\pi.img bs=4M",
TEST g-streamer commands gst-launch-1.0 -vv -e v4l2src device=/dev/video0 num-buffers=100 ! capsfilter caps="image/jpeg,width=1920,height=1080,framerate=30/1" ! multifilesink location="frame%d.jpeg"
time gst-launch-1.0 multifilesrc location="frame%d.jpeg" index=1 caps="image/jpeg,framerate=30/1, width=1920, height=1080" ! jpegdec ! videoconvert ! x264enc ! filesink location="output.h264" && stat output.h264
time gst-launch-1.0 multifilesrc location="frame%d.jpeg" index=1 caps="image/jpeg,framerate=30/1, width=1920, height=1080" ! jpegdec ! videoconvert ! openh264enc ! filesink location="output.h264" && stat output.h264
time gst-launch-1.0 multifilesrc location="frame%d.jpeg" index=1 caps="image/jpeg,framerate=30/1, width=1920, height=1080" ! jpegdec ! videoconvert ! openh264enc bitrate=2000000 rate-control=2 gop-size=30 ! filesink location="output.h264" && stat output.h264
time gst-launch-1.0 multifilesrc location="frame%d.jpeg" index=1 caps="image/jpeg,framerate=30/1, width=1920, height=1080" ! jpegdec ! videoconvert ! v4l2h264enc output-io-mode=4 extra-controls="encode,video_bitrate_mode=2,h264_level=11;" ! 'video/x-h264,level=(string)4,profile=main' ! filesink location="output.h264" && stat output.h264
time gst-launch-1.0 multifilesrc location="frame%d.jpeg" index=1 caps="image/jpeg,framerate=30/1, width=1920, height=1080" ! jpegdec ! videoconvert ! v4l2h264enc output-io-mode=4 extra-controls="encode,video_bitrate_mode=2,h264_level=11,video_bitrate=5000000" ! 'video/x-h264,level=(string)4,profile=main' ! h264parse ! mp4mux ! filesink location="output.mp4" && stat output.mp4
gst-launch-1.0 --no-fault -e v4l2src device=/dev/video0 ! capsfilter caps="image/jpeg,width=1280,height=720,framerate=30/1" ! jpegdec ! videoconvert ! video/x-raw,format=I420,width=1280,height=720 ! clockoverlay time-format="%D %H:%M:%S" ! v4l2h264enc output-io-mode=4 extra-controls="encode,video_bitrate_mode=2,h264_level=11,video_bitrate=5000000" ! "video/x-h264,level=(string)4,profile=main" ! multifilesink location="/media/video/output/frames_%03d.nal" next-file=key-frame
time gst-launch-1.0 multifilesrc location="frame%d.jpeg" index=1 caps="image/jpeg,framerate=30/1, width=1920, height=1080" ! jpegdec ! videoconvert ! openh264enc bitrate=2000000 rate-control=2 gop-size=30 ! filesink location="output.h264" && stat output.h264
SETUP
MAKE SURE TO IMAGE WITH "quent" (or the same as your user), otherwise there are issues...
Find the inital ip nmap -p22 10.0.0.0/24 | grep -B 4 "open" | grep "scan report" | cut -d " " -f 5
Assuming the usb is "/dev/sda1" (if it isn't, use lsblk to find the sda value)
sudo apt update sudo apt install -y screen nodejs npm gstreamer1.0-tools gstreamer1.0-plugins-base gstreamer1.0-plugins-good gstreamer1.0-plugins-bad gstreamer1.0-plugins-ugly gstreamer1.0-libav sudo npm install --global yarn
(crontab -l 2>/dev/null; echo "@reboot bash /home/quent/startup.sh") | crontab - echo "gpu_mem=512" | sudo tee -a /boot/firmware/config.txt mkdir -p /home/quent/camera3 mkdir -p /home/quent/camera3/src
sudo nmcli connection modify preconfigured ipv4.addresses 10.0.0.192/24 sudo nmcli connection modify preconfigured ipv4.gateway 10.0.0.1 sudo nmcli connection modify preconfigured ipv4.dns 8.8.8.8 sudo nmcli connection modify preconfigured ipv4.method manual sudo nmcli connection down preconfigured && sudo nmcli connection up preconfigured && sudo reboot
(this command "hangs", because it changes the nextwork config, so... detach after this)
Now video is at /media/video, and the ip is 10.0.0.192, video memory is 512
The first bash deploy.sh will require a manual yarn install
bash update.sh can update the commands after that
pmount LABEL=video
mkdir -p test_folder for i in $(seq 1 74); do mkdir -p "test_folder/folder_$i" for j in $(seq 1 1000); do mkdir -p "test_folder/folder_$i/subfolder_$j" done done time find . -type d | wc -l
0.265 in ext4 0.273 in ntfs
2.236s on FAT, BUT, creation took FOREVER
Hmm... I think we WEREN'T using the drive even, so... shit.
pumount sda1 pmount sda1
crontab @reboot /usr/bin/pmount /dev/sda1 video @reboot bash /home/quent/startup.sh
sudo mkfs.vfat -F 32 -s 64 /dev/sda1 sudo chown $USER:$USER /media/sda1
sudo mkfs.ext4 -F /dev/sda1 sudo chown $USER:$USER /media/sda1
sudo mkfs.ntfs -Q -f -c 65536 /dev/sda1 sudo chown $USER:$USER /media/sda1
sudo blockdev --flushbufs /dev/sda1
lsblk -f
iostat -d -x 1
dmesg --ctime | grep -i "sdb" dmesg --ctime | grep -i "sda"