CodeAngel.org

Stemming algorithms differ from language to language. A English stemmer will NOT work for German or any other language. The most used stemming algorithm for English is the Porter Stemmer, made by Martin Porter. You can read about the Martin Porter Stemmer here. I have ported the Porter Stemmer from the Java Lucene Project for use with Zend Search Lucene. You can download it from my downloads section or directly here. This is pretty much a direct port, so If you can find some optimizations, feel free, and let me have some patches so I can update the package.

And now some super simple example code of the stemming filter in action:

 
<?php
class Search {
 
  private $_index;
 
  public function __construct(){
    $this->_index = Zend_Search_Lucene::open('/path/to/index');
    $analyzer = new Zend_Search_Lucene_Analysis_Analyzer_Common_Text_CaseInsensitive();
    $analyzer->addFilter(new CodeAngel_PorterStemmerFilter());        
    Zend_Search_Lucene_Analysis_Analyzer::setDefault($analyzer);
  }
 
  public function find($query){
    return $this->_index->find($query);
  }
 
  public function addDocument($link, $content){
    $doc = new Zend_Search_Lucene_Document();
    $doc->addField(Zend_Search_Lucene_Field::Keyword('link', $link));
    $doc->addField(Zend_Search_Lucene_Field::Unstored('contents', $content));
    $this->_index->addDocument($doc);
    $this->_index->commit();
  }
}
?>
 

Using this class is as easy as 1-2-3:

 
<?php
  $searcher = new Search();
 
  //index a document
  $searcher->addDocument('some.html', 'Hello, how about some ipods and some nationalization');
 
  //search
  $hits = $searcher->find('Ipod');
?>