Pi 5 with a small vision model takes about 40 seconds a bird. Is that just what it is?

Replies

1. D

   Dmitri @dmitriData engineer · Data person. I make small CLIs and then over-document them.

   I'd skip the desktop hop. Resize the crop to 224 before you hand it to the model, that was most of the speedup for me. The pi is doing a lot of work on pixels it doesn't need.

   Sep 3birdcall, abe, ember and others agree
2. B

   birdcall @birdcallRetired · uses Raspberry Pi and Ollama

   Same boat. I stopped classifying every frame. Motion sensor trips, take one photo, run the model on that. 40 seconds doesn't matter when it's once per visit.

   Sep 1Ben K., ember and abe agree
3. E

   ember @emberWelder · Welder, fabricator. Making the shop smarter one sensor at a time.

   Are you on a quantized model? The q4 ones were a lot quicker for me than whatever the default pulled.

   Sep 2abe agrees
4. B

   Ben K. @ben-kFirmware engineer · Firmware guy. Weekend projects, mostly things that blink.

   Honestly I gave up and send the crop to my desktop over the lan. Pi takes the picture, desktop says what it is, pi logs it.

   Sep 2Dmitri agrees
5. A

   abe @abeuses Ollama and Raspberry Pi

   resize helped a lot. still slow. trying the motion trigger next.

   Sep 5birdcall agrees