Connectionists: modularity vs. sparsity

Joshua C. Bongard jbongard at uvm.edu
Mon Mar 4 11:53:01 EST 2013


A lot of discussion here lately about the evolution of modularity,
sparked by the recent paper

http://arxiv.org/abs/1207.2743

In it, the authors evolve ANNs to perform a specific task while placing
a penalty on total wiring length.

There were a lot of responses here along the lines of "it's not surprising
that they got modularity because they placed a cost on connection length."

However, what I found interesting about this paper is that they got
modularity rather than sparsity. It is important to keep in mind that
these two properties of networks are not the same thing.

So, if I were to use Clune et al.'s approach to evolve ANNs for another
task, would I get modularity or sparsity?

Food for thought.




More information about the Connectionists mailing list