Connectionists: IWOR 2015 late inquiry from Prof. John Weng
Juyang Weng
weng at cse.msu.edu
Tue Feb 24 17:35:27 EST 2015
Dear Profs. Sira Alonso and Oscar Vera-Perez,
I am afraid that this inquiry is too late for IWOR 2015, as I guess that
your IWOR program has been almost fixed.
A colleague just mentioned to me that there is a workshop on operation
research and a special track on computer vision and graphics
to be held in Havana, Cuba. I am very interested in visiting your
country with my wife.
However, I am not sure whether you are interested in how the brain
works, including decision making and vision as two special cases, just
like special cases for a mathematical theorem.
I am attaching the Brain Principles Manifesto that is being discussed in
several research communities, including
the Brain-Mind Institute at http://www.brain-mind-institute.org/ and
the connectionist mailing list <connectionists at cs.cmu.edu>
For those who like to participate in the email discussion on this
manifesto, they can subscribe to the BMI mailing list. Simply do an
internet search to get the list site.
I am attaching my CV and two papers for your information.
If you are still interested in my giving a talk, a tutorial or both, and
can kindly pay my cost of travel from Lansing, Michigan United States,
I will be greatly honored. I do not need any publication in the
proceedings of IWOR 2015.
If it is indeed too late for me to serve your workshop, I can fully
understand and I would like to further express my sincere apology for my
late contact.
----
The Brain Principles Manifesto
(Draft Version 2.0)
Feb. 24, 2015
Historically, public acceptance of science was slow.For example, Charles
Darwin waited about 20 years (from the 1830s to 1858) to publish his
theory of evolution for fear of public reaction.It took about 20 years
(by the 1870s) the scientific community and much of the general public
had accepted evolution as a fact. Of course, the debate on evolution
still goes on today.
Is the public acceptance of sciencefaster in modern days?Not necessarily
so, even though we have now better and faster means to communicate.The
primary reason is still the same but much more severe—the remaining open
scientific problems are more complex and the required knowledge to
convincingly understand goes beyond any single person.
For instance, network-like brain computation --- connectionist
computation --- has been long doubted and ignored by industry.Kunihiko
Fukushima introduced /Convolutional deep/ networks by at least
1980.Weng, Ahuja and Huang published /Max-pooling/ in deep fully
automatic learning networks by 1992.However, Apple, Baidu, Google,
Microsoft, Samsung, and other major related companies did not show
considerable interest till after 2012.That is a delay of about 20
years.The two techniques above are not very difficult to understand.
However, these two suddenly hot techniques have already been proved
obsolete by the discoveries of more fundamental working principles of
the brain.
Industrial and academic interests have been keen on a combination of two
things --- easily understandable but superficial tests and which
companies are involved.However, the newly known brain principles have
told us that the ways to conduct such tests will give only vanishing
gains that do not lead to a realistic zero error rate, regardless how
many more images can be added to the training sets and how long the
Moore’s Law can continue. Why?This is because all these static training
sets misled the participants by making it impractical to conduct serious
autonomous object segmentation that our human babies learn to perform
through interaction with the real physical world.Do our industry and
public need another 20 years?Or more?
Oct. 2011a highly respected multi-disciplinary professor kindly wrote:
“I tell these students that they can work on brains and do good science,
or work on robots and do good engineering.But if they try to do both at
once, the result will be neither good science nor good engineering.”How
long does it take for the industry and public to accept that that
pessimisticview of the brain was no longer true even then?
The brain principles that have already been discovered would bring
fundamental changes in the way humans live, human countries and
societies are organized, and the way humans treat one another.The
following questions point to some concrete fundamental changes that
benefit all humans. However, conventionally, scientists in natural
sciences do not address politics.Albert Einstein and Norm Chomsky are
among exceptions.
The brain of anybody, regardless of his education and experience, is
fundamentally short sighted, in both space and time, determined by the
known brain principles.Prof. Jonathan Haidt documented well such
shortsightedness in his book “/The Righteous Mind: Why Good People Are
Divided by Politics and Religion/
<http://www.amazon.com/The-Righteous-Mind-Politics-Religion/dp/0307455777>”,
although not in terms of brain computation.
In terms of brain computation, the precise circuits in your brain
self-wire beautifullyaccording to your real-time experience (the genome
only regulates) and their various invariance properties for abstraction
also largely depend on experience.Serotonin (e.g., caused by threats),
dopamine (e.g., caused praises) and other neural transmitters quickly
change the way these delicate circuits work but you feel everything
inside the brain is normal. Therefore, you make mistakes but you still
feel normal in the brain. Everybody is like that, including the
politicians in the questions below.
Surprisingly, to understand how the brain works requires a sophisticated
automata theory in computer science. See J. Weng, /Brain //as//an
Emergent Finite Automaton: A Theory and Three Theorems/
<http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0CCAQFjAA&url=http%3A%2F%2Fwww.scirp.org%2Fjournal%2FPaperDownload.aspx%3FpaperID%3D53728&ei=21rnVP7fB4KZyAT-noH4Cg&usg=AFQjCNEzHz-YDhivI1esDtgKg84SEx4RuQ&bvm=bv.86475890,d.aWw&cad>,
/IJIS/, 2015, which proposed the following brain principles:
1.The developmental (genome-like) program uses fully emergent,
task-nonspecific internal representations of the brain-like Network (DN)
and therefore, the DN is of general-purpose—can learn any body-capable
tasks, at least in principle.
2.The sensory area allows naturally sensed images of cluttered scenes in
which many objects mix, instead of an encoding that fits only what a
Turing Machine can work with.A teacher does not segment objects as how
children learn.
3.The motor area allows subareas where each subarea represents either
declarative knowledge (e.g., abstract concepts such as location, type,
scale, etc.) or non-declarative knowledge (e.g., driving a car or riding
a bicycle).
4.Every area in the “brain” DN emerges (not statically exist) uses a
unified area function that does not have local minima in its high
dimensional, nonlinear, and non-iterative approximation in its feature
development and adaptation.
5.The “brain” DN learns incrementally—taking one-pair of sensory pattern
and motor pattern at a time to update the network and discarding the
pair immediately after. E.g., the real brain has only one pair of retina.
6.The “brain” DN is always optimal—every update of DN realizes the
maximum likelihood estimate of the “brain”, conditioned on the limited
computational resources in the “brain” and the limited learning
experience in its “life time”.
The logic completeness of the brain DN is (partially, not all)
understood by a universal Turing Machine which is like our modern-day
computer, in principle.This automaton brain model proposes that each
brain is an automaton, but also very different from all traditional
symbolic automata because it programs itself—emergent.No traditional
automata can program themselves in the sense of Turing Machine but a
brain automaton does.
The automaton brain model predicted that neural circuits precisely
record the statistics of experience, roughly consistent with neural
anatomy (e.g., Felleman & Van Essen, /Cerebral Cortex/, 1991). In
particular, the model predicted that “shifting attention between
`humans’ and `vehicles’ dramatically changes brain representation of all
categories” (J. Gallant et al. /Nature Neuroscience/, 2013) and that
human attention “can regulate the activity of their neurons in the
medial temporal lobe” (C. Koch et al. /Nature/, 2010).The model raised
questions to claims that neurons encode exclusively sensory information
like the “place” cells in the work of 2014 Nobel Prize in Physiology or
Medicine instead of a combination of both bottom-up (e.g., place) and
top-down context (e.g., goal) as reported by Koch et al. and Gallant et
al. and theoretically predicted by the automaton brain model.
Unfortunately, the automaton brain model implies that all
neuroscientists and neural network researchers are unable to understand
the brain of their studies without a rigorous training in automata
theory. For example, traditional models for nervous systems and neural
networks focus on pattern recognition and do not have the capabilities
of a grounded symbol system (e.g., “rulefully combining and
recombining,” Stevan Harnad, /Physica D,/ 1990).Automata theory deals
with such capabilities. Does this new knowledge stun our students and
researchers or guide them so their time is better spent?
Understanding brain automata would enable us to see answers to a wide
variety of important questions, some of which are raised below. We do
not provide yes/no answers here, only raise questions.The automaton
brain model predicts that there is no absolute right or wrong in any
brain but its environmental experiences wire and rewire the brain.
In each of the following social science questions, we have two sides,
Side A with more knowledge due to the more open political and
ideological environment and Side B with less knowledge due to less open
political and ideological environment, but all have normal human brains
that should be respected.Is it more scientifically productive for Side A
to approach Side B friendly with caring heart so that Side B is not
threatened and not listening?We want them to rewire for good instead of
for bad, do we?
How can our industry and pubic understand that the door for a great
opportunity that has opened up for them?How can they see the economical
outlooks that this opportunity brings with it?
How should our educational system change to prepare our many bright
minds for the new brain age?Has our government been prompt to properly
respond to this modern call from the nature?
How should our young generationact for to this new opportunity that is
unfolding before their eyes?Is a currently narrowly defined academic
degree sufficient for their career?
----
Best regards,
-John Weng
--
--
Juyang (John) Weng, Professor
Department of Computer Science and Engineering
MSU Cognitive Science Program and MSU Neuroscience Program
428 S Shaw Ln Rm 3115
Michigan State University
East Lansing, MI 48824 USA
Tel: 517-353-4388
Fax: 517-432-1061
Email: weng at cse.msu.edu
URL: http://www.cse.msu.edu/~weng/
----------------------------------------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20150224/ac761b7a/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: resume.pdf
Type: application/pdf
Size: 203315 bytes
Desc: not available
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20150224/ac761b7a/attachment-0003.pdf>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Weng-ConceptNet-IEEEIntelSyWeb-2014.pdf
Type: application/pdf
Size: 907666 bytes
Desc: not available
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20150224/ac761b7a/attachment-0004.pdf>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: BrainTheory3Thms-Weng-IJIS-2015.pdf
Type: application/pdf
Size: 800983 bytes
Desc: not available
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20150224/ac761b7a/attachment-0005.pdf>
More information about the Connectionists
mailing list