Several months have passed since the last update. This has been in part due to the summer holidays and a gig doing some non-upstream work, but I have also had the opportunity to continue my work on the NPU driver for the VeriSilicon NPU in the NXP i.MX 8M Plus SoC, thanks to my friends at Ideas on Board.
CC BY-NC 4.0 Henrik Boye |
With this, as of yesterday, one can accelerate models such as SSDLite MobileDet on that SoC with only open source software, with the support being provided directly from projects that are already ubiquitous in today's products, such as the Linux kernel and Mesa3D. We can expect this functionality to reach distributions such as Debian in due time, for seamless installation and integration in products.
With this milestone reached, I will be working on expanding support for more models, with a first goal of enabling YOLO-like models, starting with YOLOX. I will be working as well on performance, as currently we are not fully using the capabilities of this hardware.
What has changed since the driver was upstreamed to Mesa?
ReplyDeletehttps://blog.tomeuvizoso.net/2024/01/etnaviv-npu-update-15-we-are-upstream.html
Is it just some work on the kernel side?
Sorry, I just got it. It's specific to NXP i.MX 8M Plus SoC...
Delete