Install and Run Locally DeepSeek-R1 AI Model on Windows
19 hours
0 Views
Category:
Description:
- In this machine learning and AI tutorial, we explain how to install and run DeepSeek-R1 model locally on Windows Computer.
- DeepSeek-R1 belongs to the class of reasoning models. Reasoning models perform better at complex reasoning problems and tasks compared to the classical large language models. Complex reasoning problems are problems that appear in mathematics, science, and coding.
- According to the information given on GitHub page of DeepSeek, the performance of DeepSeek-R1 is comparable to the performance of OpenAI-o1. However, DeepSeek-R1is released under the MIT license, which is a very liberal license allowing even for commercial use.
- To run the full DeepSeek-R1 model locally, you need more than 400GB of disk space and a significant amount of CPU, GPU, and RAM resources! This might be prohibitive on the consumer-level hardware.
- However, DeepSeek has shown that it is possible to reduce the size of the original DeepSeek-R1 model, and at the same time preserve the performance (of course, not completely). Consequently, DeepSeek has released a number of compressed (distilled) models whose size varies from 1.5-70B parameters. To install these models you will need from 1 to 40 GB of disk space.
- In this tutorial, we will explain how to install and run distilled models of DeepSeek-R1.