Computing and GPUs
How to choose appropriate hardware for your compute needs? Should you compute in the cloud or using your own GPUs?
Computing and GPUS - Infrastructure and Tooling
- If you go with the GPU round, there are a lot of NVIDIA cards to choose from (Kepler, Maxwell, Pascal, Volta, Turing).
- If you go with a cloud provider, Amazon Web Services and Google Cloud Platform are the heavyweights, while startups such as Paperspace and Lambda Labs are also viable options.
- If you work solo or in a startup, you should build or buy a 4x recent-architecture PC for model development. For model training, if you run many experiments, you can either buy shared server machines or use cloud instances.
- If you work in a large company, you are more likely to rely on cloud instances for both model development and model training, as they provide proper provisioning and infrastructure to handle failures.
Last modified 2yr ago