Given a family of functions parameterized by W, we seek to find a value of the parameter such that the similarity metric is small if and are from the same category, and large if they belong to different categories. The system is trained on pairs of patterns taken from a training set. The loss function minimized by training minimizes when and are from the same category, and maximizes when they belong to different categories. No assumption is made about the nature of other than differentiability with respect to W. Because the same function with the same parameter is used to process both inputs, the similarity metric is symmetric.
Bordes et al. (2011) devised an architecture to learn more than one asymmetric relations at the same time.
- Bordes, A., Weston, J., Collobert, R., & Bengio, Y. (2011, April). Learning Structured Embeddings of Knowledge Bases. In AAAI.