albertaworlds/japanese-text-cleaner — explained in plain English
Analysis updated 2026-05-18
Paste or upload messy Japanese text and get a standardized, cleaned version back
Batch-clean multiple text files by dragging them in and exporting the results as a zip
Call the API from an AI or NLP pipeline to clean Japanese text before analysis or translation
Prepare Japanese text data for AI model training with consistent formatting
| albertaworlds/japanese-text-cleaner | ayangabryl/ngx-digit-flow | moonpiesheldon1337/mobsf-fail-app | |
|---|---|---|---|
| Stars | 30 | 30 | 30 |
| Language | TypeScript | TypeScript | TypeScript |
| Setup difficulty | easy | easy | moderate |
| Complexity | 2/5 | 2/5 | 3/5 |
| Audience | developer | developer | developer |
Figures from each repo's GitHub metadata at analysis time.
Japanese Text Cleaner is a web application that automatically tidies up messy Japanese text. Japanese text often arrives from different sources in inconsistent formats, mixed full-width and half-width characters, inconsistent quotation marks, unusual line breaks, HTML tags, and encoding problems (Japanese text can be stored in several different character encodings like UTF-8, Shift-JIS, or EUC-JP). This tool standardizes all of that automatically. It runs a 16-step pipeline over the text: normalizing the Unicode representation, converting character widths, standardizing punctuation and brackets, removing unwanted control characters, fixing quote pairings, and reformatting line breaks so that each sentence sits on its own line. There are three cleaning modes, deep, standard, and light, depending on how aggressively you want to transform the text. You can paste text directly, drag and drop multiple text files for batch processing, and export the results as a zip archive. It also exposes an API endpoint so AI tools or natural language processing pipelines can send text for cleaning programmatically. This is useful for anyone preparing Japanese text data for analysis, translation, or AI training.
A web app and API that automatically standardizes messy Japanese text through a 16-step cleaning pipeline, fixing character widths, punctuation, line breaks, and encoding issues.
Mainly TypeScript. The stack also includes TypeScript, Web app, REST API.
Setup difficulty is rated easy, with roughly 5min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.