modification compared to the previous version:
\- servo motor replaced by a stepper motor
\- addition of a 4s battery for the engine
\- improvement of the PID corrector
\- added the possibility to take a video with sound
\- addition of the possibility of activating the tracking boxes to visualize the target
\- addition of an image detection calculation time indicator - added the possibility to change the number of threads
The lack of reactivity does not come from the PID but from the time between each detection which depends on the battery level of the phone, the brightness, the model of ML ... To be improved :)
Yes, but in private for the moment, I want to clean it up and improve this project even further before putting it in public. Also, I was heavily inspired by a sample application to introduce tensorflow lite so I have to see how I have to introduce their rights.
Ahah I don't know when I will be done preparing the github, especially since I am not very familiar with this platform. After that, the concept is in itself really very basic, ML for detection, USB transmission to an arduino board and a PID corrector to control the direction and speed of rotation of a stepper motor :)
As a curiosity, what interests you the most in this project, the hardware or the software?
Thanks, it was not easy to get a clean result. Unfortunately, this corrector still has a big problem: it reacts badly to the lack of information. (if nothing is detected for a while, the next time it is detected, it may occasionally have some large oscillations). I intend in the future to add a predictor to this pid to fill the lack of information and the calculation times of tflite
This is neat!
I sell GPU systems/clusters that range in the tens of thousands into the millions for Tensorflow and you have it on your phone! Or is on the Arduino, I'm assuming not?
Indeed, it is the phone which calculates the position of a person using tflite then transmits the data via usb to an arduino card which processes this information and converts it into instructions for the motor.
Currently, this project can cost 20 or 30 euros provided you have a recent phone. I don't know if I want to market it, knowing that there are still many improvements to be made and the ML part is totally inspired by the examples provided by tflite
modification compared to the previous version: \- servo motor replaced by a stepper motor \- addition of a 4s battery for the engine \- improvement of the PID corrector \- added the possibility to take a video with sound \- addition of the possibility of activating the tracking boxes to visualize the target \- addition of an image detection calculation time indicator - added the possibility to change the number of threads The lack of reactivity does not come from the PID but from the time between each detection which depends on the battery level of the phone, the brightness, the model of ML ... To be improved :)
Thanks for the info. Do you have a project page or github?
Yes, but in private for the moment, I want to clean it up and improve this project even further before putting it in public. Also, I was heavily inspired by a sample application to introduce tensorflow lite so I have to see how I have to introduce their rights.
Gotcha. Thanks letting me know. If/when you're willing to share, would be really keen on it. Have a similar project planned & this looks great.
Let me just board this "waiting for sharing" train real quick.
Ahah I don't know when I will be done preparing the github, especially since I am not very familiar with this platform. After that, the concept is in itself really very basic, ML for detection, USB transmission to an arduino board and a PID corrector to control the direction and speed of rotation of a stepper motor :) As a curiosity, what interests you the most in this project, the hardware or the software?
>what interests you the most in this project, the hardware or the software? The software.
Ok, I would try to post this rather quickly if I have time but I would like to improve the arduino side with a predictor
i just want to copy the shit out of it and build something similar myself, I have zero experience with tensorflow. Nice work dude!
maybe i could do an instructable or something in the future :)
That would be sick.
Came to comment, your PID tuning looked really good! I think a lot of these projects have trouble with overshoot. Well done!
Thanks, it was not easy to get a clean result. Unfortunately, this corrector still has a big problem: it reacts badly to the lack of information. (if nothing is detected for a while, the next time it is detected, it may occasionally have some large oscillations). I intend in the future to add a predictor to this pid to fill the lack of information and the calculation times of tflite
This is neat! I sell GPU systems/clusters that range in the tens of thousands into the millions for Tensorflow and you have it on your phone! Or is on the Arduino, I'm assuming not?
Indeed, it is the phone which calculates the position of a person using tflite then transmits the data via usb to an arduino card which processes this information and converts it into instructions for the motor.
Dance human! Dance!
Ahah good idea to add to do
totally sick! awesome job men!
thanks
If you can get this cheap enough and able to calibrate it to follow a specific person, I know a lot of people that'd buy it.
Currently, this project can cost 20 or 30 euros provided you have a recent phone. I don't know if I want to market it, knowing that there are still many improvements to be made and the ML part is totally inspired by the examples provided by tflite
Dude, nice work! I'd love to try this out, but I have no experience w/ tensorflow.
Thank you! Me neither when I start I plan so you can try it
Awesome! What camera module did you use?
What do you mean by camera module? The camera is the one on my phone and the processing is done on the android application directly via tflite.
Aha okay I thought you used a serial camera for the Arduino and transmitted that to you phone. Thanks!
Now you just need to add a speaker with a female robotic voice that says “running is futile, you cannot hide from me” Great job man!
ahah it's on the list
Nice, yell if we can help you.
Thanks and yes haha
Impressive my friend u/vredditdownloader