Package org.apache.lucene.analysis.ja.dict

Class TokenInfoDictionary

java.lang.Object

org.apache.lucene.analysis.ja.dict.BinaryDictionary

org.apache.lucene.analysis.ja.dict.TokenInfoDictionary

All Implemented Interfaces:

Dictionary

public final class TokenInfoDictionary
extends BinaryDictionary

Binary dictionary implementation for a known-word dictionary model: Words are encoded into an FST mapping to a list of wordIDs.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static class	TokenInfoDictionary.SingletonHolder

Nested classes/interfaces inherited from class org.apache.lucene.analysis.ja.dict.BinaryDictionary

BinaryDictionary.ResourceScheme

Field Summary

Fields

Modifier and Type	Field	Description
private TokenInfoFST	fst
static java.lang.String	FST_FILENAME_SUFFIX

Fields inherited from class org.apache.lucene.analysis.ja.dict.BinaryDictionary

DICT_FILENAME_SUFFIX, DICT_HEADER, HAS_BASEFORM, HAS_PRONUNCIATION, HAS_READING, POSDICT_FILENAME_SUFFIX, POSDICT_HEADER, TARGETMAP_FILENAME_SUFFIX, TARGETMAP_HEADER, VERSION

Fields inherited from interface org.apache.lucene.analysis.ja.dict.Dictionary

INTERNAL_SEPARATOR

Constructor Summary

Constructors

Modifier	Constructor	Description
private	TokenInfoDictionary()
	TokenInfoDictionary(java.net.URL targetMapUrl, java.net.URL posDictUrl, java.net.URL dictUrl, java.net.URL fstUrl)	Create a TokenInfoDictionary from an external resource URL (e.g.
	TokenInfoDictionary(java.nio.file.Path targetMapFile, java.nio.file.Path posDictFile, java.nio.file.Path dictFile, java.nio.file.Path fstFile)	Create a TokenInfoDictionary from an external resource path.
	TokenInfoDictionary(BinaryDictionary.ResourceScheme resourceScheme, java.lang.String resourcePath)	Deprecated, for removal: This API element is subject to removal in a future version. replaced by TokenInfoDictionary(Path, Path, Path, Path) for files and TokenInfoDictionary(URL, URL, URL, URL) for classpath/module resources
private	TokenInfoDictionary(IOSupplier<java.io.InputStream> targetMapResource, IOSupplier<java.io.InputStream> posResource, IOSupplier<java.io.InputStream> dictResource, IOSupplier<java.io.InputStream> fstResource)

Method Summary

Modifier and Type	Method	Description
private static java.io.InputStream	getClassResource(java.lang.String suffix)
TokenInfoFST	getFST()
static TokenInfoDictionary	getInstance()

Methods inherited from class org.apache.lucene.analysis.ja.dict.BinaryDictionary

getBaseForm, getInflectionForm, getInflectionType, getLeftId, getPartOfSpeech, getPronunciation, getReading, getResource, getRightId, getWordCost, lookupWordIds

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

FST_FILENAME_SUFFIX

public static final java.lang.String FST_FILENAME_SUFFIX

See Also:

Constant Field Values

fst

private final TokenInfoFST fst

Constructor Detail

TokenInfoDictionary

@Deprecated(forRemoval=true,
            since="9.1")
public TokenInfoDictionary(BinaryDictionary.ResourceScheme resourceScheme,
                           java.lang.String resourcePath)
                    throws java.io.IOException

Deprecated, for removal: This API element is subject to removal in a future version.

replaced by TokenInfoDictionary(Path, Path, Path, Path) for files and TokenInfoDictionary(URL, URL, URL, URL) for classpath/module resources

Parameters:

resourceScheme - - scheme for loading resources (FILE or CLASSPATH).

resourcePath - - where to load resources (dictionaries) from.

Throws:

java.io.IOException

TokenInfoDictionary

public TokenInfoDictionary(java.nio.file.Path targetMapFile,
                           java.nio.file.Path posDictFile,
                           java.nio.file.Path dictFile,
                           java.nio.file.Path fstFile)
                    throws java.io.IOException

Create a TokenInfoDictionary from an external resource path.

Parameters:

targetMapFile - where to load target map resource

posDictFile - where to load POS dictionary resource

dictFile - where to load dictionary entries resource

fstFile - where to load encoded FST data resource

Throws:

java.io.IOException - if resource was not found or broken

TokenInfoDictionary

public TokenInfoDictionary(java.net.URL targetMapUrl,
                           java.net.URL posDictUrl,
                           java.net.URL dictUrl,
                           java.net.URL fstUrl)
                    throws java.io.IOException

Create a TokenInfoDictionary from an external resource URL (e.g. from Classpath with ClassLoader.getResource(String)).

Parameters:

targetMapUrl - where to load target map resource

posDictUrl - where to load POS dictionary resource

dictUrl - where to load dictionary entries resource

fstUrl - where to load encoded FST data resource

Throws:

java.io.IOException - if resource was not found or broken

TokenInfoDictionary

private TokenInfoDictionary()
                     throws java.io.IOException

Throws:

java.io.IOException

TokenInfoDictionary

private TokenInfoDictionary(IOSupplier<java.io.InputStream> targetMapResource,
                            IOSupplier<java.io.InputStream> posResource,
                            IOSupplier<java.io.InputStream> dictResource,
                            IOSupplier<java.io.InputStream> fstResource)
                     throws java.io.IOException

Throws:

java.io.IOException

Method Detail

getClassResource

private static java.io.InputStream getClassResource(java.lang.String suffix)
                                             throws java.io.IOException

Throws:

java.io.IOException

getFST

public TokenInfoFST getFST()

getInstance

public static TokenInfoDictionary getInstance()