Performance Measure
- is specific to the task 𝑇
- are evaluated over a test-set (separate from training-set)
Performance Measure - Examples
|
Corresponding Performance Measure | |
|---|---|
|
classification |
measure the accuracy/error-rate of the model:
|
|
probability distribution estimation |
use a performance metric that gives the model a continuous-valued score for each example (e.g. average log-probability the model assigns to some examples) |
|
transcription |
either:
|
|
more performance measures |