Hint: Look at the performance delta between the last 3 generatons of nvidia gpus, keeping the TDP fixed. Current accelerators have nice tricks like reducing precision, adding more tensor multipliers etc but thats it. ALl they can do afte r these optimisations is scaling down the feature sizes which will eventually be limited by physics in a few generations. Then what? A fundamentally diferent approach is required