NVIDIA announced the Chat with RTX feature that allows artificial intelligence (AI) to run directly on a PC equipped with RTX 30 and RTX 40 series graphics cards. For those interested in trying it yourself, you should make sure there is enough space in the computer's SSD first.
According to a Windows Central report, 105GB of storage space is required to run Chat with RTX. A total of 35GB is required for the Chat with RTX software while another 70GB is required for the AI Mistral 7B and LLaMA 2 models. This is the challenge faced to run the built-in AI on the device without the need for an internet connection. The storage size taken is equivalent to the size of an open world video game on PC.
On smartphones for example, the AI model. the smallest such as the Gemini Nano is used due to its more compact size. Optimizing the model is the biggest challenge to offer built-in AI according to YJ Kim, Head of the AI Team at Samsung in an interview with us last January. this is the reason why some of the AI features on the Galaxy S24 series such as Circle to Search still require an internet connection.