Computing and GPUs

How to choose appropriate hardware for your compute needs? Should you compute in the cloud or using your own GPUs?