Run Tsinghua open source language model ChatGLM-6B on your own computer

Original link: https://blog.frytea.com/archives/779/

Some people say that AIGC took 2 years to complete the 10-year journey of the Internet, because what everyone sees is that AI-centric products have sprung up like mushrooms recently, but what you can’t see is that big players in various fields have already started related research a few years ago. layout.

In the past period of time, the competition in the AIGC market was extremely fierce, and major manufacturers offered their own big prediction models. In this domestic AI chaos, the open source general language model released by Tsinghua University on March 28, 2023-ChatGLM- 6B is very different because it is an open source language model.

ChatGLM-6B uses technology similar to ChatGPT, optimized for Chinese Q&A and dialogue. After about 1T identifiers of Chinese-English bilingual training, supplemented by supervision and fine-tuning, feedback self-help, human feedback reinforcement learning and other technologies, ChatGLM-6B with 6.2 billion parameters has been able to generate answers that are quite in line with human preferences.

Everyone can download the source code and model to run on their own computer. This may be the correct way to open up AI in the future, and avoid a monopoly caused by a single company.

I tried to run the model on my MacBook Air M1 and a Linux virtual machine platform, and recorded the running process and final effect.

For details, please see: https://skybyte.me/74.html

This article is transferred from: https://blog.frytea.com/archives/779/
This site is only for collection, and the copyright belongs to the original author.