There have been some concerns that pre-training on text is hitting a wall in AI model development, and there might be structural reasons why this could be happening. Recently, Yann LeCun, the Chief AI ...