There’s plenty of room for improvement in the theory and application of any type of LLM. I think we’re closer to a plateau than people want to admit. The power and water needs scale wildly upward for slight performance increases. We need to go about this wildly differently for it to be sustainable.