We have a replacement for CUDA, it is called C++17 parallel algorithms. It has vendor support for running on the GPU by Intel, AMD and NVIDIA and will also run on all your cores on the CPU. It uses the GPU vendors compiler to convert your C++ to something that can natively run on the GPU. With unified memory support, it becomes very fast to run computations on heap allocated memory using the GPU, but implementations also support non-unified memory
Vendor support:
- https://www.intel.com/content/www/us/en/developer/articles/g...
- https://rocm.blogs.amd.com/software-tools-optimization/hipst...
- https://docs.nvidia.com/hpc-sdk/archive/20.7/pdf/hpc207c++_p...