Coral TPU PCI Passthrough
-
@Niall-Con Thank you! I'll take a look to that and will ping you to test on real hardware. Just need to find time (in the middle of storm right now), so it'll take one or two weeks most probably.
-
@andSmv Any news on a test build with the patch? I'm wondering if this issue is related and would love to be able to test.
-
Also ended up here while researching/troubleshooting this hardware; Has there been any additional movement on this topic?
-
Reping @andSmv
-
Hey, sorry guys. Didn't have time to advance on that. I promise will put something to test during november.
-
@andSmv @olivierlambert Mid-December circle back.
Anything promising for us to test before the new year?
If not; happy non-denominational holiday and new year.
-
@firereverie Sorry, these last few weeks was very-very busy. So I REALLY hope will do something on this before the december end and come back to you.
-
Sorry guys. This one is harder than expected, basically the marek patch addresses only MSI-X Vector Table (and which has some emulation support included in Xen). MSI-x PBA related stuff is a different - so I will try to see how I can get the actual device to fix this one
-
@andSmv
I definitely think it would be nice with support even though i repurposed my M2 Coral for other uses.
But one thing to keep in mind regarding resources is that the product would appear to be heading to https://killedbygoogle.com
coral.ai redirects to their new NPU offering and no updates have been made from google to the driver since 2022... Mouser still has plenty of stock though.Frigate.nvr which is one of the popular uses for the Coral do not recommend it for new installs either.
-
@redakula said in Coral TPU PCI Passthrough:
Frigate.nvr which is one of the popular uses for the Coral do not recommend it for new installs either.
Frigate updated their recommendations because of the Google decision to sunset the device and because there are alternative options available to frigate for image inferencing. The coral is still supported though, and frigate is not the only use case or platform that can benefit from an accelerator.
At the end of the day if you've already got the hardware, and it's efficient enough to run, then not using it is a waste or resources that could be allocated to other VMs.
