Awesome Chinese LLM

URL: https://github.com/HqWu-HITCS/Awesome-Chinese-LLM
Category: Themed Directories
Tags: ai, llm, open-source

Overview

Awesome Chinese LLM is a curated, "awesome-style" directory of open-source Chinese large language model resources. It emphasizes smaller-scale models that are feasible for private deployment and lower-cost training, and aggregates base models, domain-specific fine-tunes, applications, datasets, and tutorials related to Chinese LLMs.

Features

1. Focus and Scope

• Concentrates on Chinese-language LLMs and related tooling.
• Prioritizes smaller-scale models that:
  • Can be run by individuals or small teams.
  • Are suitable for private deployment.
  • Have lower training and deployment costs.
• Includes resources across the full ecosystem:
  • Base / foundation models.
  • Domain-specific fine-tuned models.
  • Applications built on top of LLMs.
  • Datasets for training and evaluation.
  • Tutorials and learning materials.

2. Base Model Overview Table

Provides a comparative overview of commonly used base models, including:

• ChatGLM family

  • Variants: ChatGLM / ChatGLM2 / ChatGLM3 / ChatGLM4 (Base & Chat)
  • Parameters: ~6B
  • Training tokens: ~1T / 1.4T
  • Max sequence length: 2K / 32K
  • Commercial use: Allowed

• LLaMA family

  • Variants: LLaMA / LLaMA2 / LLaMA3 (Base & Chat)
  • Parameters: 7B / 8B / 13B / 33B / 70B
  • Training tokens: ~1T / 2T
  • Max sequence length: 2K / 4K
  • Commercial use: Partially allowed (depends on version/license)

• Baichuan

  • Variants: Baichuan / Baichuan2 (Base & Chat)
  • Parameters: 7B / 13B
  • Training tokens: ~1.2T / 1.4T
  • Max sequence length: 4K
  • Commercial use: Allowed

• Qwen (通义千问)

  • Variants: Qwen / Qwen1.5 / Qwen2 / Qwen2.5 (Base, Chat, VL)
  • Parameters: 7B / 14B / 32B / 72B / 110B
  • Training tokens: ~2.2T / 3T / 18T
  • Max sequence length: 8K / 32K
  • Commercial use: Allowed

• BLOOM

  • Variants: BLOOM