• Transient Punk@sh.itjust.works
      link
      fedilink
      arrow-up
      6
      ·
      7 months ago

      SR-IOV allows you to share your GPU among many virtual machines in much the same way that you are able to share a single CPU among many VMs

        • Owljfien@iusearchlinux.fyi
          link
          fedilink
          arrow-up
          4
          ·
          edit-2
          7 months ago

          Not really ai specifically but VMs. Maybe you want a Windows vm for gaming with a gpu, just give it a slice and it’s fine. Maybe you want lots of VMs for all various different office clients, split off sections of the gpu and you can have a bunch of hardware accelerated thin clients

        • Transient Punk@sh.itjust.works
          link
          fedilink
          arrow-up
          4
          ·
          7 months ago

          For me, I would love to have a single GPU in my server that I can split up for use in transcoding videos for Plex in one VM, and another VM running something like Blue Iris with AI video analysis.

          The potential use cases are many and varied, including some gaming use cases. You could have a single GPU in your Linux desktop, and be able to pass that through to a Windows VM to get native performance gaming in a VM. This is technically already possible, but you need two GPUs. With SR-IOV you could get away with only having one