Show HN: Transformers Calculator

1 point by spstoyanov 1 year ago | 0 comments
The other day, I was wondering how big of a model I can train on a single GPU in one month. I found this great blog post and I thought it would be cool to make a simple calculator: https://medium.com/@dzmitrybahdanau/the-flops-calculus-of-la...