edu.umass.cs.mallet.base.fst
Class TokenAccuracyEvaluator

java.lang.Object
  edu.umass.cs.mallet.base.fst.TransducerEvaluator
      edu.umass.cs.mallet.base.fst.TokenAccuracyEvaluator

public class TokenAccuracyEvaluator

extends TransducerEvaluator

Field Summary

Fields inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator

alwaysEvaluateWhenFinished, checkpointFilePrefix, checkpointIterationsToSkip, checkpointTransducer, numIterationsToSkip, numIterationsToWait, printModelAtEnd, viterbiOutput, viterbiOutputEncoding, viterbiOutputFilePrefix, viterbiOutputIterationsToSkip, viterbiOutputIterationsToWait

Constructor Summary

TokenAccuracyEvaluator()

TokenAccuracyEvaluator(boolean printViterbiPath)

Method Summary

boolean	evaluate(Transducer crf, boolean finishedTraining, int iteration, boolean converged, double cost, InstanceList training, InstanceList validation, InstanceList testing) Evaluates a Tranducers on a given training, validation, and testing set.
double	getLastAccuracy() Returns the accuracy from the last time test() or evaluate() was called
void	test(Transducer model, InstanceList data, java.lang.String description, java.io.PrintStream viterbiOutputStream)

Methods inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator

getCheckpointFilePrefix, getCheckpointIterationsToSkip, getCheckpointTransducer, getNumIterationsToSkip, getNumIterationsToWait, getViterbiOutput, getViterbiOutputEncoding, getViterbiOutputFilePrefix, getViterbiOutputIterationsToSkip, getViterbiOutputIterationsToWait, isAlwaysEvaluateWhenFinished, isPrintModelAtEnd, setAlwaysEvaluateWhenFinished, setCheckpointFilePrefix, setCheckpointIterationsToSkip, setCheckpointTransducer, setNumIterationsToSkip, setNumIterationsToWait, setPrintModelAtEnd, setViterbiOutput, setViterbiOutputEncoding, setViterbiOutputFilePrefix, setViterbiOutputIterationsToSkip, setViterbiOutputIterationsToWait, shouldDoEvaluate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokenAccuracyEvaluator

public TokenAccuracyEvaluator(boolean printViterbiPath)

TokenAccuracyEvaluator

public TokenAccuracyEvaluator()

Method Detail

evaluate

public boolean evaluate(Transducer crf,
                        boolean finishedTraining,
                        int iteration,
                        boolean converged,
                        double cost,
                        InstanceList training,
                        InstanceList validation,
                        InstanceList testing)

Description copied from class: TransducerEvaluator

Evaluates a Tranducers on a given training, validation, and testing set. .

The default implementation calls the evaluator's test on the training, validation, and testing sets.

Overrides:

evaluate in class TransducerEvaluator

Parameters:

crf - The transducer to evaluate.

finishedTraining - Whether training has finished. Evaluators can be set to always evaluate when training completes.

iteration - The current iteration

converged - Whether training has converged. Most evaluators ignore this.

cost - The current cost during training. Some evaluators may include this in the output.

training - The training set. If null, the argument is ignored.

validation - The validation set. If null, the argument is ignored.

testing - The testing set. If null, the argument is ignored.

Returns:

Whether training should continue.

test

public void test(Transducer model,
                 InstanceList data,
                 java.lang.String description,
                 java.io.PrintStream viterbiOutputStream)

Specified by:

test in class TransducerEvaluator

getLastAccuracy

public double getLastAccuracy()

Returns the accuracy from the last time test() or evaluate() was called

Returns: