GPU Computing

Libraries | Languages | Compilers | APIs 

Language/API/Compilers for GPU

CUDA   (c/c++) (nvidia -> nvcc):-It is a programming language for Cuda architecture licensed to Nvidia .It is compiled by nvcc compler of NVIDIA.

OpenCL:-It is a free source language for Cuda architecture.It is platform independent.

Intel cilk plus

C++ AMP (Microsoft)

Direct Compute (Microsoft)

OpenACC

OpenHMPP

PGI CUDA (c/c++)

PGI Accelarator (C)

OpenGL

WebCL

WebGL

API/compilers for CUDA with other languages:

PGI CUDA (Fortran)

PGI Accelarator (Fortran)

CUDA Fortran (Portland group)

PyCUDA (Python)

alea.cuBase (.net + CUDA)

CUDA enabled libraries:

CUDA Math Library

CUFFT

CUSP

CUBLAS:-It is a linear algebra library used for algebra operations used in cuda programming.It is equalant to  BLAS which is used for linear algebra operations in normal C/C++ programming.

          Thrust:-Thrust is library in-built in cuda language .It is used to pass CPU vector to the GPU using a      raw -pointer.

CULA:-Cula is third party tool which is used for linear algebra library operations like SVD,SV in Cuda programming .It is equalant to LAPACK library which used in C/C++ programming for the same opearations.

CURAND:-It is used for the random number generation in Cuda programming and equalant to rand function of normal C/C++ programming .

CUSPARSE

MAGMA

          FLAME 

Jacket for MATLAB

ArrayFire

NPP (Nvidia Performance Primitives)

IMSL Fortran Numerical Library

GPU Debuggers

cugdb:-cugdb capable of handling thousands of threads running simultaneously on each GPU in the system.  CUDA-GDB delivers a seamless debugging experience that allows you to debug both the CPU and GPU portions of your application simultaneously.

          Nvidia Nsight:-is the ultimate development platform for heterogeneous computing. Work with powerful           debugging and profiling tools that enable you to fully optimize the performance of the CPU and   GPU.
 Not only do these feature-rich tools optimize performance, they help you gain a better understanding of your                  code - identify and analyze bottlenecks and observe the behavior of all system activities.

Total View

Performance analysis

nVidia NSIGHT

nVidia Visual Profiler