“We trained our models using TensorFlow (Abadi et al., 2016) on clusters containing 16-32 Tesla K40 GPUs” https://arxiv.org/pdf/1701.06538.pdf
So they did it before they implement Tensorflow hardware or didn’t use it.
Current price of such Tesla cluster is around 50-100 K USD
“We trained our models using TensorFlow (Abadi et al., 2016) on clusters containing 16-32 Tesla K40 GPUs” https://arxiv.org/pdf/1701.06538.pdf
So they did it before they implement Tensorflow hardware or didn’t use it.
Current price of such Tesla cluster is around 50-100 K USD