Progress
Yesterday I managed to implement in my open-source driver all the remaining operations so the SSDLite MobileDet model can run on Rockchip's NPU in the RK3588 SoC.
Performance is pretty good at 30 frames per second when using just one of the 3 cores that the NPU contains.
I uploaded the generated video to YouTube at:
You can get the source code at my branch here.
Next steps
Now that we got to this level of usefulness, I'm going to switch to writing a kernel driver suited for inclusion into the Linux kernel, to the drivers/accel subsystem.
There is still lots of work to do, but progress is going pretty fast, though as I write more drivers for different NPUs I will have to split my time among them. At least, until we get more contributors! :)