Skip to main content

@phughesmcr/happynodetokenizer@7.1.0

😄 HappyNodeTokenizer A basic Twitter aware tokenizer for Javascript environments. A Typescript port of HappyFunTokenizer.py by Christopher Potts and HappierFunTokenizing.py by H. Andrew Schwartz.

Works with
This package works with Bun
It is unknown whether this package works with Cloudflare Workers
This package works with Node.js
This package works with Deno
This package works with Browsers
JSR Score
100%
Published
3 months ago

! HappyNodeTokenizer

A basic Twitter-aware tokenizer.

Help to make this better: https://github.com/phughesmcr/happynodetokenizer

Based on: HappyFunTokenizer.py by Christopher Potts (C) 2011 and HappierFunTokenizing.py by H. Andrew Schwartz (www.wwbp.org)

Add Package

deno add @phughesmcr/happynodetokenizer

Import symbol

import * as mod from "@phughesmcr/happynodetokenizer";

Add Package

npx jsr add @phughesmcr/happynodetokenizer

Import symbol

import * as mod from "@phughesmcr/happynodetokenizer";

Add Package

yarn dlx jsr add @phughesmcr/happynodetokenizer

Import symbol

import * as mod from "@phughesmcr/happynodetokenizer";

Add Package

pnpm dlx jsr add @phughesmcr/happynodetokenizer

Import symbol

import * as mod from "@phughesmcr/happynodetokenizer";

Add Package

bunx jsr add @phughesmcr/happynodetokenizer

Import symbol

import * as mod from "@phughesmcr/happynodetokenizer";