Skip to content

hunter/ferret_tokenizer

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

== Overview
A string tokenizer based on Ferret::Analysis::StandardAnalyzer. I made some improvements for better text analysis.

== Install

sudo gem sources -a http://gems.github.com   (you only have to do this once)
sudo gem install feedbackmine-ferret_tokenizer

== Usage

require 'ferret_tokenizer'
t = FerretTokenizer.new '@feedbackmine, I LOVE this!!! :-)'
while (tok = t.next)
  p tok
end

== Follow us on twitter

http://twitter.com/feedbackmine

About

A string tokenizer based on Ferret::Analysis::StandardAnalyzer.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C 94.7%
  • Ruby 5.3%