I want to perform distributed training on Amazon SageMaker. The code is written with TensorFlow and similar to the following code where I think CPU instance should be enough:
Can Horovod with TensorFlow work on non-GPU instances in Amazon SageMaker?
Yeah you should be able to use both CPU’s and GPU’s with Horovod on Amazon SageMaker. Please follow the below example for the same
Answered By – Arun Lokanatha