whatisgithub

What is stopwords?

goto456/stopwords — explained in plain English

Analysis updated 2026-06-26

5,518Audience · dataComplexity · 1/5Setup · easy

In one sentence

A collection of four Chinese stopword text files from different research institutions, ready to drop into any Chinese text processing pipeline to filter out common low-meaning words before analysis or search.

Mindmap

mindmap
  root((stopwords))
    What it is
      Chinese word lists
      Plain text files
      No code included
    Word lists
      General Chinese list
      Harbin Institute list
      Baidu stopwords
      Sichuan University list
    Use cases
      Text classifiers
      Search indexing
      NLP pipelines
    Audience
      Data engineers
      NLP researchers
      ML practitioners
Click or tap to explore — scroll the page freely

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Filter common Chinese words out of text before running sentiment analysis or topic classification.

USE CASE 2

Load one or more word lists into a search index to improve Chinese full-text search relevance.

USE CASE 3

Use the Harbin or Baidu stopword list as a baseline for training a Chinese NLP or language model.

USE CASE 4

Combine multiple lists to build a comprehensive Chinese stopword set for a data cleaning pipeline.

How does it compare?

goto456/stopwordsayn2op/discordodushixiang/next-terminal
Stars5,5185,5195,519
LanguageGoTypeScript
Setup difficultyeasymoderatehard
Complexity1/52/54/5
Audiencedatadeveloperops devops

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 5min
No explicit license is stated in the repository.

So what is it?

This repository is a collection of Chinese stopword lists in plain text format. Stopwords are common words that text-processing systems typically filter out before analyzing or searching content. In English, words like "the", "and", and "is" are typical stopwords. In Chinese, the equivalent are short, high-frequency words that carry little meaning on their own. The repository contains four separate word lists, each from a different source. One is a general Chinese stopword list. A second comes from the Harbin Institute of Technology, a well-known source for Chinese natural language processing research. A third is Baidu's stopword list. The fourth is from the machine intelligence lab at Sichuan University. Each list is a separate text file, so you can pick the one that fits your project or use them in combination. The README is minimal and consists mainly of a table mapping each list name to its filename. There is no code in this repository, no installation instructions, and no usage examples. You would typically use these files by loading them into a text processing pipeline, a search index, or a machine learning data-cleaning step that needs to strip common words from Chinese text before further analysis. This kind of resource is useful for anyone building search tools, text classifiers, or language models that process Chinese content.

Copy-paste prompts

Prompt 1
I'm building a Chinese text classifier in Python. Show me how to load the Harbin Institute stopword list from this repo and use it to filter tokens before training.
Prompt 2
Help me compare the four stopword lists in this repo and decide which one to use for a Baidu search-related project versus an academic NLP task.
Prompt 3
I want to index Chinese product reviews in Elasticsearch. Show me how to configure a custom stopword filter using one of these text files.
Prompt 4
Write a Python script that loads all four stopword list files from this repo, deduplicates them, and saves a combined master list.
Prompt 5
Explain what stopwords are to a non-technical PM and why filtering them matters before running AI analysis on Chinese customer feedback.

Frequently asked questions

What is stopwords?

A collection of four Chinese stopword text files from different research institutions, ready to drop into any Chinese text processing pipeline to filter out common low-meaning words before analysis or search.

What license does stopwords use?

No explicit license is stated in the repository.

How hard is stopwords to set up?

Setup difficulty is rated easy, with roughly 5min to a first successful run.

Who is stopwords for?

Mainly data.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.