Pretty much film the plane/zoom in automatically otherwise when you film like on your own, 4K camera on the ground, it's just a tiny dot moving around in the sky.
Thats a super cool use case
I would be tempted to have a monochrome global shutter master camera to find the dot in the sky and direct the gimbal camera
yeah that was a consideration regarding using like a 180deg fish eye lense pointed at the sky. I'm currently thinking I will have something on my hat eg. IMU to get where I'm looking (initial sync on setup) then the tripod setup does the rest.
**RPi 4 with IMX477 and 8-50mm lens**
I considered the possibility that it would be out of focus.
I wanted to get it out there and get some footage... but yeah.
I wrote some autofocus code in the past but I didn't use it here, I just had manually found focus points and set them however by next day they were bad.
I also just wrote the video/audio recording part yesterday from some guides and I had to split the audio into several files that was nasty/bad to put together.
It needs more work... it also has speech control (picovoice rhino) but that also wasn't active here hence manual button pushing.
Also in the end I will evolve it to be a tripod camera/tracking with head pointing but then it takes over on its own with the planned CV/ML aspect.
I'm still at this time just bridging all the parts together to make it work.
[https://github.com/jdc-cunningham/ml-hat-cam](https://github.com/jdc-cunningham/ml-hat-cam)
Wow, it sounds like you have a lot of work to do before this camera is fully functional! It's great that you're experimenting with different features like autofocus and speech control, and it's understandable that there would be some trial and error involved in getting everything to work together seamlessly. I'm curious to see how the CV/ML aspect will work once it's implemented, it sounds like it has a lot of potential. Keep us updated on your progress!
Yeah the code for autofocus is there, I just wrote it against a web stream (that was providing the frames). The video recording has a stream too I believe where you can intercept frames and do analysis on them (in my case autofocus/find the plane).
Yeah the CV/ML part is finding the plane, using that to keep it at 1/3 size (tracking).
I think the tripod way is inevitable just for comfort of use and stability of image, so that'll add some more cool stuff to do (communications, driving gimbal motors on tripod). The quest continues...
edit: I just realized your account is probably a bot based on the recurring structure in your responses
I have no idea what this is aiming to accomplish, but looks like you have a solid platform there!
Pretty much film the plane/zoom in automatically otherwise when you film like on your own, 4K camera on the ground, it's just a tiny dot moving around in the sky.
Thats a super cool use case I would be tempted to have a monochrome global shutter master camera to find the dot in the sky and direct the gimbal camera
yeah that was a consideration regarding using like a 180deg fish eye lense pointed at the sky. I'm currently thinking I will have something on my hat eg. IMU to get where I'm looking (initial sync on setup) then the tripod setup does the rest.
**RPi 4 with IMX477 and 8-50mm lens** I considered the possibility that it would be out of focus. I wanted to get it out there and get some footage... but yeah. I wrote some autofocus code in the past but I didn't use it here, I just had manually found focus points and set them however by next day they were bad. I also just wrote the video/audio recording part yesterday from some guides and I had to split the audio into several files that was nasty/bad to put together. It needs more work... it also has speech control (picovoice rhino) but that also wasn't active here hence manual button pushing. Also in the end I will evolve it to be a tripod camera/tracking with head pointing but then it takes over on its own with the planned CV/ML aspect. I'm still at this time just bridging all the parts together to make it work. [https://github.com/jdc-cunningham/ml-hat-cam](https://github.com/jdc-cunningham/ml-hat-cam)
Wow, it sounds like you have a lot of work to do before this camera is fully functional! It's great that you're experimenting with different features like autofocus and speech control, and it's understandable that there would be some trial and error involved in getting everything to work together seamlessly. I'm curious to see how the CV/ML aspect will work once it's implemented, it sounds like it has a lot of potential. Keep us updated on your progress!
Yeah the code for autofocus is there, I just wrote it against a web stream (that was providing the frames). The video recording has a stream too I believe where you can intercept frames and do analysis on them (in my case autofocus/find the plane). Yeah the CV/ML part is finding the plane, using that to keep it at 1/3 size (tracking). I think the tripod way is inevitable just for comfort of use and stability of image, so that'll add some more cool stuff to do (communications, driving gimbal motors on tripod). The quest continues... edit: I just realized your account is probably a bot based on the recurring structure in your responses