Dictionary Frequency Values

Description

These settings allow you to rank the relationship among dictionaries according to a dictionary frequency value. Dictionary frequency values are set in pairs: base frequency and maximum frequency.
iWnn handles the priority of stored words in terms of a specified frequency range.
In addition, when performing standard conversion (kana-kanji conversion or getting all candidates), the frequency values for each dictionary can be set separately for prediction conversion and morphological analysis.



In the example shown in the figure above, words stored in Dictionary C have priority over words stored in Dictionary A. Also, by overlapping the setting ranges as shown for settings for Dictionary A and Dictionary B, you can give only the highest frequency words in Dictionary B priority over words in Dictionary A. If the range is the same, as shown for Dictionaries C and D, priority is determined using only the frequency value information of the dictionary in which the word is stored.
However, depending on the state setting during contextual prediction and situational prediction, the priority of a word may vary if it exceeds the value range.

Limits on base frequency and maximum frequency by dictionary handle

Specify the base frequency and maximum frequency for each dictionary handle in the range from 0 to 1000. If the base frequency is greater than the maximum frequency, that dictionary is not used.
However, when the word search function (NjxSearchWord) is used with these settings, an error occurs.

Recommended values when using multiple custom dictionaries

Dictionary type Fuzzy Search For Conversion For Prediction For Morphological Analysis
Base High Base High Base High
Learning dictionary Yes 501 1000 501 1000 10 0
Integrated dictionary Yes 400 550 100 560 400 500
Customized dictionary (multiple) Yes 0 ~400 0 ~400 0 ~400 0 ~400 10 0
User dictionary No 410 410 10 0 10 0
Single kanji dictionary No 0 10 10 0 0 10
Ancillary word dictionary No 400 500 10 0 400 500
No reading prediction dictionary No 10 0 100 244 10 0
Because there are so many words in the integrated dictionary, many words are assigned to each frequency. Because more words are registered in the candidate list than other customized dictionaries, a broad frequency range of 0 to 400 is specified.
For dictionaries not used in any particular mode, set a base frequency of 10 and a maximum frequency of 0 (base frequency higher than maximum frequency) to exclude them from use.

No reading prediction dictionary: Recommended value for using "start of sentence"

Dictionary type Fuzzy Search For Conversion For Prediction For Morphological Analysis
Base High Base High Base High
Learning dictionary Yes 501 1000 501 1000 10 0
Integrated dictionary Yes 400 550 100 560 400 500
Customized dictionary (multiple) Yes 0 ~400 0 ~400 0 ~400 0 ~400 10 0
User dictionary No 410 410 10 0 10 0
Single kanji dictionary No 0 10 10 0 0 10
Ancillary word dictionary No 400 500 10 0 400 500
No reading prediction dictionary No 10 0 100 244 10 0
No reading prediction dictionary <start of sentence> No 10 0 100 900 10 0

Recommended value when using learning results based on morphological analysis

- When morphological analysis results are the priority

Dictionary type Fuzzy Search For Conversion For Prediction For Morphological Analysis
Base High Base High Base High
Morphological learning dictionary Yes 900 1000 900 1000 10 0
Learning dictionary Yes 501 1000 501 1000 10 0
Integrated dictionary Yes 400 550 100 560 400 500
User dictionary No 410 410 10 0 10 0
Single kanji dictionary No 0 10 10 0 0 10
Ancillary word dictionary No 400 500 10 0 400 500
No reading prediction dictionary No 10 0 100 244 10 0

- When the learning dictionary is the priority

Dictionary type Fuzzy Search For Conversion For Prediction For Morphological Analysis
Base High Base High Base High
Learning dictionary Yes 501 1000 501 1000 10 0
Morphological learning dictionary Yes 700 800 700 800 10 0
Integrated dictionary Yes 400 550 100 560 400 500
User dictionary No 410 410 10 0 10 0
Single kanji dictionary No 0 10 10 0 0 10
Ancillary word dictionary No 400 500 10 0 400 500
No reading prediction dictionary No 10 0 100 244 10 0
If we compare a 32 KB learning dictionary that has approximately 1000 learned words with the morphological analysis results of about 100 words, the number of words per frequency will be different depending on whether priority is given to morphological analysis results or to the learning dictionary. Specify a wider range of frequency values as described above, therefore, to even out priorities and the number of words obtained.

Definition of the standard dictionary frequency value

The following macros have been defined based on recommended values for the standard dictionary frequency value.
Dictionary Usage Macros
Integrated dictionary Conversions High NJ_DEFAULT_FREQUENCY_DIC_UNION_CONVERSION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_UNION_CONVERSION_BASE
Predictions High NJ_DEFAULT_FREQUENCY_DIC_UNION_PREDICTION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_UNION_PREDICTION_BASE
Morphological Analysis High NJ_DEFAULT_FREQUENCY_DIC_UNION_MORPHOLIZE_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_UNION_MORPHOLIZE_BASE
Single kanji dictionary Conversions High NJ_DEFAULT_FREQUENCY_DIC_SINGLE_CONVERSION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_SINGLE_CONVERSION_BASE
Predictions High NJ_DEFAULT_FREQUENCY_DIC_SINGLE_PREDICTION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_SINGLE_PREDICTION_BASE
Morphological Analysis High NJ_DEFAULT_FREQUENCY_DIC_SINGLE_MORPHOLIZE_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_SINGLE_MORPHOLIZE_BASE
Ancillary word dictionary Conversions High NJ_DEFAULT_FREQUENCY_DIC_ANCILLARY_CONVERSION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_ANCILLARY_CONVERSION_BASE
Predictions High NJ_DEFAULT_FREQUENCY_DIC_ANCILLARY_PREDICTION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_ANCILLARY_PREDICTION_BASE
Morphological Analysis High NJ_DEFAULT_FREQUENCY_DIC_ANCILLARY_MORPHOLIZE_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_ANCILLARY_MORPHOLIZE_BASE
No Reading Prediction Dictionary Conversions High NJ_DEFAULT_FREQUENCY_DIC_READING_CONVERSION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_READING_CONVERSION_BASE
Predictions High NJ_DEFAULT_FREQUENCY_DIC_READING_PREDICTION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_READING_PREDICTION_BASE
Morphological Analysis High NJ_DEFAULT_FREQUENCY_DIC_READING_MORPHOLIZE_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_READING_MORPHOLIZE_BASE
No Reading Prediction Dictionary (for start of sentence) Conversions High NJ_DEFAULT_FREQUENCY_DIC_HEAD_READING_CONVERSION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_HEAD_READING_CONVERSION_BASE
Predictions High NJ_DEFAULT_FREQUENCY_DIC_HEAD_READING_PREDICTION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_HEAD_READING_PREDICTION_BASE
Morphological Analysis High NJ_DEFAULT_FREQUENCY_DIC_HEAD_READING_MORPHOLIZE_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_HEAD_READING_MORPHOLIZE_BASE
User dictionary Conversions High NJ_DEFAULT_FREQUENCY_DIC_USER_CONVERSION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_USER_CONVERSION_BASE
Predictions High NJ_DEFAULT_FREQUENCY_DIC_USER_PREDICTION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_USER_PREDICTION_BASE
Morphological Analysis High NJ_DEFAULT_FREQUENCY_DIC_USER_MORPHOLIZE_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_USER_MORPHOLIZE_BASE
Learning dictionary Conversions High NJ_DEFAULT_FREQUENCY_DIC_LEARN_CONVERSION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_LEARN_CONVERSION_BASE
Predictions High NJ_DEFAULT_FREQUENCY_DIC_LEARN_PREDICTION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_LEARN_PREDICTION_BASE
Morphological Analysis High NJ_DEFAULT_FREQUENCY_DIC_LEARN_MORPHOLIZE_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_LEARN_MORPHOLIZE_BASE
Customized Dictionary Conversions High NJ_DEFAULT_FREQUENCY_DIC_CUSTOM_CONVERSION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_CUSTOM_CONVERSION_BASE
Predictions High NJ_DEFAULT_FREQUENCY_DIC_CUSTOM_PREDICTION_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_CUSTOM_PREDICTION_BASE
Morphological Analysis High NJ_DEFAULT_FREQUENCY_DIC_CUSTOM_MORPHOLIZE_HIGH
Base NJ_DEFAULT_FREQUENCY_DIC_CUSTOM_MORPHOLIZE_BASE

CONFIDENTIAL