You will need no less than a naive stemming algorithm (test the Porter stemmer; there is certainly obtainable, free code for most languages) to method text 1st. Retain this processed text as well as preprocessed text in two different Area-break up arrays. If you want far more thorough explanation