tokenizer2 Not imported
tokenize any text stream given some basic regex rules to match tokens
Import to Registry
This package is not yet in the greenflagged registry. Import it to start the review process.
2.0.1
Latest Version
MIT
License
7
Published Versions
1
Dependencies
Maintainers
farskipper
Keywords
tokenizerthroughstream
Dependencies
| Package | Constraint |
|---|---|
| through2 | ^2.0.0 |
Published Versions
| Version |
|---|
| 2.0.1 |
| 2.0.0 |
| 1.2.1 |
| 1.2.0 |
| 1.1.0 |
| 1.0.1 |
| 1.0.0 |