Evaluate output

1

How can I evaluate my model performance on a certain value of the output? I know that in order to evaluate the model you just need to call evaluate model but what about a certain value, say for instance I wanted to evaluate my NER model on the PER entity only

2

you can evaluate your NER model on every named entity by doing two modifications:

  1. File metrics/fmeasure.py. Replace
    def ner_token_f1(y_true, y_pred, print_results=False): with
    def ner_token_f1(y_true, y_pred, print_results=True):

  2. File utils/settings/log_config.json. Replace "level": "INFO" with "level": "DEBUG" on line 6.

Then run the model with the evaluate command.