leake explanation is an inference procedure different for each BSC perspective perspectives, each with objectives (highest-level concepts) measures (some subset of which are the observables) targets (measure OP threshold) initiative (what are we doing about this) tufte informative diagrams space shuttle example skew the example with correlated columns information smaller than data must apply some bias to reduce it bias makes us blind, bias lets us see (the future) dimensionality reduction e.g. remove correlated columns e.g. remove non-informative attributes validation best: on new data worst: on old data (can't predict error on new data) middle: cross-val jack-knifing: leave one out bootstrap: 66% random samples - note, trick: boosting- focus on prior mis-classified examples 10-way: usual 3-way: for small data sets