EndOfLine@lemmy.world to Lemmy Shitpost@lemmy.worldEnglish · 3 months agoMight not be efficient, but at least it... Uhhh, wait, what good does it provide again?lemmy.worldimagemessage-square87linkfedilinkarrow-up11.26Karrow-down113
arrow-up11.24Karrow-down1imageMight not be efficient, but at least it... Uhhh, wait, what good does it provide again?lemmy.worldEndOfLine@lemmy.world to Lemmy Shitpost@lemmy.worldEnglish · 3 months agomessage-square87linkfedilink
minus-squarelovely_reader@lemmy.worldlinkfedilinkarrow-up4·3 months agoNo. “In practice, inference [which is to say, queries, not training] can account for up to 90% of the total energy consumed over a model’s lifecycle.” Source.
No. “In practice, inference [which is to say, queries, not training] can account for up to 90% of the total energy consumed over a model’s lifecycle.” Source.