So what the JEPA (Joint-Embedding Predictive Architecture) system when it’s being trained is trying to do, is extract as much information as possible from the input, but yet only extract information that is relatively easily predictable. – Yann LeCun
This conversation features a conversation between Yann LeCun, the Chief AI