Meet Orca, Microsoft’s New Open Source AI Model
Microsoft, in collaboration with OpenAI, has been slowly incorporating AI capabilities into its products and services, as well as developing smaller case-specific models. Microsoft Research has announced Orca, a new AI model that learns by emulating huge language models. Orca is intended to circumvent the limits of smaller models by emulating the reasoning processes of large foundation models such as GPT-4, according to the research article.
Language models like Orca can be taught using big language models like GPT-4 and optimised for specific needs. Orca uses fewer computational resources to execute and operate due to its lower size. Researchers can tune their models based on their needs and run them individually without relying on a massive data centre.
Orca, a 13 billion parameter-powered AI model based on Vicuna, can copy and learn from huge language models like GPT-4, according to the research article. With the help of GPT-4, which is said to have over one trillion parameters, it can learn explanations, step-by-step thought processes, and other complex instructions.
(With inputs from Shikha Singh)
You need to login in order to Like
