bnlp_toolkit_v1.1.0

sagorbrur released this 01 Dec 07:09

38dee89

Improvement

NLTK Sentence Tokenization bengali punctuation problem improved

Addition

Version Checking Added

>>import bnlp
>>bnlp.__version__

Basic Tokenizer Tool Added

from bnlp.basic_tokenizer import BasicTokenizer
basic_t = BasicTokenizer(False)
raw_text = "আমি বাংলায় গান গাই।"
tokens = basic_t.tokenize(raw_text)
print(tokens)

Assets 2