I've been doing this for some time now. I'm excited to know I'm not the only one.
Monsieurmouche
joined 2 years ago
Good point. But considering the frequent retraining, the environmental impacts can only be spread on a finite number of queries.
Is this for inferencing only? Do you include training?
20, approximately