The next major breakthrough will branch out at a much lower level than deep learning model architecture. It will be a new approach. A better model architecture can lead to incremental data efficiency & generalization gains, but it won't fix the fundamental issues of the parametric learning paradigm.
#### Rohan Paul
@rohanpaul_ai · 18h ago
Sam Altman just said in his new interview, that a new AI architecture is coming that will be a massive upgrade, just like Transformers were over Long Short-Term Memory. And also now the current class of frontier models are powerful enough to have the brainpower needed to help us research these ideas.
His advice is to use the current AI to help you find that next giant step forward.
---
From 'TreeHacks' YT Channel (link in comment)
00:30
104
68
693
517.4K
65 Replies
35 Retweets
582 Likes
80.5K Views