Field Detail

• DEFAULT_STOPWORD_FILE

  public static final String DEFAULT_STOPWORD_FILE

  File containing default Ukrainian stopwords.

  See Also:

  Constant Field Values

Constructor Detail

• UkrainianMorfologikAnalyzer

  public UkrainianMorfologikAnalyzer()

  Builds an analyzer with the default stop words: DEFAULT_STOPWORD_FILE.

• UkrainianMorfologikAnalyzer

  public UkrainianMorfologikAnalyzer(CharArraySet stopwords)

  Builds an analyzer with the given stop words.

  Parameters:

  stopwords - a stopword set

• UkrainianMorfologikAnalyzer

  public UkrainianMorfologikAnalyzer(CharArraySet stopwords,
                                     CharArraySet stemExclusionSet)

  Builds an analyzer with the given stop words. If a non-empty stem exclusion set is provided this analyzer will add a SetKeywordMarkerFilter before stemming.

  Parameters:

  stopwords - a stopword set

  stemExclusionSet - a set of terms not to be stemmed

Method Detail

• getDefaultStopSet

  public static CharArraySet getDefaultStopSet()

  Returns an unmodifiable instance of the default stop words set.

  Returns:

  default stop words set.

• initReader

  protected Reader initReader(String fieldName,
                              Reader reader)

  Description copied from class: Analyzer
  Override this if you want to add a CharFilter chain.

  The default implementation returns reader unchanged.

  Overrides:

  initReader in class Analyzer

  Parameters:

  fieldName - IndexableField name being indexed

  reader - original Reader

  Returns:

  reader, optionally decorated with CharFilter(s)

• createComponents

  protected Analyzer.TokenStreamComponents createComponents(String fieldName)

  Creates a Analyzer.TokenStreamComponents which tokenizes all the text in the provided Reader.

  Specified by:

  createComponents in class Analyzer

  Parameters:

  fieldName - the name of the fields content passed to the Analyzer.TokenStreamComponents sink as a reader

  Returns:

  A Analyzer.TokenStreamComponents built from an StandardTokenizer filtered with StandardFilter, LowerCaseFilter, StopFilter , SetKeywordMarkerFilter if a stem exclusion set is provided and MorfologikFilter on the Ukrainian dictionary.