The energy bill hiding in model design

AI energy use is often discussed as a data-centre problem, but many watts are committed much earlier in model design. Context length, architecture,...