One to Many?

[Manoel Fernando Tenorio]

>> 
>> If you insist on being deterministic, you can get BP to give a probability
>> distribution over a set of possible answers, provided each possible answer
>> has its own output unit.  Unlike the Boltzmann machine, BP cannot represent
>> probabilites of combinations of output units.  For example, a Boltzmann
>> machine can give high probability to  the output vectors 01 and 10 and low
>> probability to 11 and 00.  BP cannot do this.
>> 
>> Geoff
It seems that this BP characteristic has to do more with the architectural
structure (number of links) than with the algorithm itself. An interesting
experiment would be to enhance the architecture by allowing links between
units in the same layer (input or output), and BP, or even a generalized 
version of it (i.e. Almeida ICNN87). If you allow the information to be
captured by the proper number of links, the network will make a good attempt
at it. This is the same message we got from using a hidden layer.

--ft.