Why can 2 times 3 sometimes equal 7 with Android s Neural Network API?
Jan 23, 2021
Two times three equals six or at least that’s what I naively expected.
It is well-known that floating point matrix multiplication can result in a variety of surprises.
But did you know that quantized neural networks are not deterministic as well?
A quantized neural network uses integers to
multiply weights and activations in a neural network.
Thus, the naive logic goes, two and three represented and multiplied as integers should always give the exact same result,
namely six.
However, according to the Android NNAPI Driver Validation documentation, a