Meta, has unveiled a new AI model called "JEPA" (Joint Embedding Predictive Architecture)

 Meta, the company formerly known as Facebook, has unveiled a new AI model called "JEPA" (Joint Embedding Predictive Architecture)


Meta: a new AI model called "JEPA"


Meta, the company formerly known as Facebook, has unveiled a new AI model called "JEPA" (Joint Embedding Predictive Architecture)
that aims to surpass existing generative AI models like ChatGPT in terms of their resemblance to human intelligence. The model is spearheaded by French researcher Yann LeCun, who is in charge of AI at Meta. According to Meta, JEPA is designed to overcome the limitations of today's most advanced AI systems.


Unlike models like GPT or Google's PaLM2, which rely on massive databases and simulate reasoning without truly understanding the texts they generate, JEPA takes a different approach. It compares abstract representations of images or sounds instead of aggregating large amounts of human-created data. This allows the AI to develop an internal model of the external world, similar to how the human brain functions. By analyzing a multitude of data unconsciously, the model can comprehend the surrounding world and work with abstract concepts rather than just word sequences.


The goal of Meta's approach is for the AI model to genuinely understand the data it receives, rather than relying on the most probable word sequence to guess user queries. Theoretically, JEPA should not "hallucinate" or generate factually incorrect information, which is a common issue with generative AI models. These models often struggle to conceive certain elements, such as human hands or ears, because they lack a true understanding of the subject matter.


According to Yann LeCun, JEPA also stands out from other large language models in terms of its efficiency. Meta claims that AI does not require significant computational resources to function, unlike more resource-intensive systems like GPT.


Meta believes that generative methods focus too much on details rather than capturing overall concepts, unlike their new system. Yann LeCun even predicts that generative AI models will eventually disappear as better alternatives emerge. Meta has made the entire code of JEPA available to researchers, following its open-source strategy to encourage further research and adoption of the technology.



Next Post Previous Post
No Comment
Add Comment
comment url