Cuda is Nvidia’s GPU programming toolkit. It has become the de facto standard for machine learning and AI work as well as various other workloads in which running the program on the graphics card is faster than doing so on the cpu.

Edit: There is more that it does, I am just giving a simplified explanation.