visualizations and storage for experiments

[cmry]

This is a big one, which requires the set-up of a database back-end (done already) and a (web) front-end:

• Dump serialized config files to JSON database.
• Represent the performance in a way that general metrics can be shown.
  • project
  • name
  • training_set (i.a.)
  • testing_set (i.a) -- this and above probably need to be abstracted from loaders
  • string representation of the used features
  • string NAME of the classifier used
  • POS / NEG f1-scores (could be put in a graph) micro f-1
• Able to overview and compare experiments visually.
  • Flat Performance bar.
  • Plotting performance on data proportions.
  • Summary of experiment configurations.
  • Confusion matrices.
  • Aggregate performances in one report.
  • t-SNE?
• Insight into feature importances.
  • LIME evaluation.
  • Coof. representations.

[cmry]

First rough work on the front-end done in 705ce59. For now, first there needs to be some representation in the database that makes relevant calls a bit easier. Some of those high level representations should be:

• project
• name
• training_set (i.a.)
• testing_set (i.a) -- this and above probably need to be abstracted from loaders
• string representation of the used features
• string NAME of the classifier used
• POS / NEG f1-scores (could be put in a graph)

[cmry]

LIME evaluation (from this paper) has been added since 3da4827. Currently for binary classification only!