small, safe, and great commonmark (optionally gfm, mdx) compliant markdown parser
#自然语言处理#Developer friendly Natural Language Processing ✨
CommonMark compliant markdown parser in Rust with ASTs and extensions
Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
mdast utility to parse markdown
snapdragon is an extremely pluggable, powerful and easy-to-use parser-renderer factory.
#自然语言处理#NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.
#自然语言处理#A pythonic wrapper for Stanford CoreNLP.
Tokenize2 is a plugin which allows your users to select multiple items from a predefined list or ajax, using autocompletion as they type to find each item. You may have seen a similar type of text ent...
Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.
on a mission to fund every open source project. Tokenize and trade GitHub repos
Extract JavaScript code comments from a string or glob of files.
bKash payment gateway integration in flutter
A token based HTML Document parser and minifier written in PHP. Extract attribute values and text using CSS selectors.
Lexers, tokenizers, parsers, compilers, renderers, stringifiers... What's the difference, and how do they work?
A Python library for interacting with TI-(e)z80 (82/83/84 series) calculator files
#自然语言处理#Korean text data preprocess toolkit for NLP
Uses babel to extract JavaScript code comments from a string. Returns an array of comment objects, with line, column, index, comment type and comment string.
Uses snapdragon to tokenize a single JavaScript block comment into an object, with description, tags, and code example sections that can be passed to any other comment parsers for further parsing.