TODO: "Humans seem to use multiple forms of knowledge representation. For example, see Liz Spelke's work on "core knowledge" in children (and also work by Josh Tenenbaum and collaborators.) This high level knowledge is of course represented by patterns of neuronal firing, but it might be more statistically (and possibly computationally) more efficient to do learning by manipulating these more structured representations (e.g., in terms of objects and agents and their attributes and relations) rather than taking tiny steps in a super high dimensional continuous parameter space (although the latter approach does seem to be killing it right now...)"

Intervew with Kevin Murphy