Back in 2016, Google revealed their custom built Tensor Processing Unit chips that were explicitly designed for machine learning tasks, and just last year, they started renting out cloud-based access to updated versions of that AI hardware. These monster ASICs are squarely aimed at ML training...