Abstract parent class for analysis factories that create Tokenizer instances.
availableTokenizers()returns a list of all available tokenizer names from context classpath
findSPIName(Class<? extends org.apache.lucene.analysis.TokenizerFactory> serviceClass)looks up a SPI name for the specified tokenizer factory
forName(String name, Map<String,String> args)looks up a tokenizer by name from context classpath
looks up a tokenizer class by name from context classpath
reloadTokenizers(ClassLoader classloader)Reloads the factory list from the given ClassLoader. Changes to the factories are
visible after the method ends, all iterators (#availableTokenizers(),...) stay
consistent.
NOTE: Only new factories are added, existing ones are never removed or replaced.
This method is expensive and should only be called for discovery of new factories on the given classpath/classloader!
Creates a TokenStream of the specified input using the default attribute factory.
create(org.apache.lucene.util.AttributeFactory factory)Creates a TokenStream of the specified input using the given AttributeFactory
| field | type | note |
|---|---|---|
| LUCENE_MATCH_VERSION_PARAM | String |
getClassArg() · also: get_class_argReturns: the string used to specify the concrete class name in a serialized representation: the
class arg. If the concrete class name was not specified via a class arg, returns
getClass().getName().
setExplicitLuceneMatchVersion(boolean isExplicitLuceneMatchVersion) · also: set_explicit_lucene_match_versionisExplicitLuceneMatchVersion() · also: is_explicit_lucene_match_versionget(Map<String,String> args, String name)get(Map<String,String> args, String name, String defaultVal)get(Map<String,String> args, String name, Collection<String> allowedValues)get(Map<String,String> args, String name, Collection<String> allowedValues, String defaultVal)get(Map<String,String> args, String name, Collection<String> allowedValues, String defaultVal, boolean caseSensitive)getChar(Map<String,String> args, String name, char defaultValue)getSet(Map<String,String> args, String name)Returns whitespace- and/or comma-separated set of values, or null if none are found
getOriginalArgs() · also: get_original_argsrequire(Map<String,String> args, String name)require(Map<String,String> args, String name, Collection<String> allowedValues)require(Map<String,String> args, String name, Collection<String> allowedValues, boolean caseSensitive)requireChar(Map<String,String> args, String name)