Skip to main content

😄 HappyNodeTokenizer A basic Twitter aware tokenizer for Javascript environments. A Typescript port of HappyFunTokenizer.py by Christopher Potts and HappierFunTokenizing.py by H. Andrew Schwartz.

This package works with Node.js, Deno, Bun, BrowsersIt is unknown whether this package works with Cloudflare Workers
It is unknown whether this package works with Cloudflare Workers
This package works with Node.js
This package works with Deno
This package works with Bun
This package works with Browsers
JSR Score
100%
Published
a year ago (7.1.0)

! HappyNodeTokenizer

A basic Twitter-aware tokenizer.

Help to make this better: https://github.com/phughesmcr/happynodetokenizer

Based on: HappyFunTokenizer.py by Christopher Potts (C) 2011 and HappierFunTokenizing.py by H. Andrew Schwartz (www.wwbp.org)

Add Package

deno add jsr:@phughesmcr/happynodetokenizer

Import symbol

import * as happynodetokenizer from "@phughesmcr/happynodetokenizer";

---- OR ----

Import directly with a jsr specifier

import * as happynodetokenizer from "jsr:@phughesmcr/happynodetokenizer";

Add Package

npx jsr add @phughesmcr/happynodetokenizer

Import symbol

import * as happynodetokenizer from "@phughesmcr/happynodetokenizer";

Add Package

yarn dlx jsr add @phughesmcr/happynodetokenizer

Import symbol

import * as happynodetokenizer from "@phughesmcr/happynodetokenizer";

Add Package

pnpm dlx jsr add @phughesmcr/happynodetokenizer

Import symbol

import * as happynodetokenizer from "@phughesmcr/happynodetokenizer";

Add Package

bunx jsr add @phughesmcr/happynodetokenizer

Import symbol

import * as happynodetokenizer from "@phughesmcr/happynodetokenizer";