Tech | Visa | Scholarship/School | Info Place

Opera allows users to download and use LLM locally

Web browser company Opera announced today that it will now allow users to download and use large language models (LLMs) natively on their computers. The feature is rolling out first to Opera One users who get the developer stream update and allows users to choose from more than 150 models in more than 50 series.

These models include Llama from Meta, Gemma and Vicuna from Google. This feature will be open to users as part of Opera’s AI feature delivery plan, allowing users to use some AI features as early as possible.

The company said it is using the Ollama open source framework in a browser to run the models on computers. Currently, all available models are subsets of the Ollama library, but in the future, the company hopes to include models from different sources.

Image Source: opera

The company mentioned that each variant takes up more than 2GB of space on your local system. Therefore, you should use the available space carefully to avoid running out of storage space. It’s worth noting that Opera doesn’t do anything to save storage space when downloading models.

“For the first time, Opera now offers the option to access a wide range of third-party local LL.M.s directly in the browser. As they become more specialized in the task at hand, we expect them to may be reduced in size.

Image Source: opera

This feature is useful if you plan to test various models locally, but if you want to save space, there are many online tools (such as Quora’s Poe and HuggingChat) to explore different models.

Opera has been experimenting with AI-powered features since last year. The company launched a sidebar-based assistant called Aria last May and brought it to iOS in August. In January, Opera said it was building an AI-powered browser for iOS with its own engine, as the European Union’s Digital Markets Act (DMA) requires Apple to drop mandatory WebKit engine requirements for mobile browsers.

#Opera #users #download #LLM #locally

Leave a Reply

Your email address will not be published. Required fields are marked *