[ACT-R-users] [soar-group] Vision module proposal/ ACT-R mailing list on PM

[Frank Ritter]

Dear Yan King Yin and Fabio,

Check out papers at http://acs.ist.psu.edu/papers/ritter-papers.html :
   on supporting cognitive models as users with eyes and hands (baxter)
   on using eyes and hands (jones)
   on java eyes and hands (norling)
   on tcl/tk eyes and hands (lonsdale)
   and any paper with St. Amant using his SegMan system.
   and under /ijhcs-em-si/  there is a special issue on this topic.

we've been working on this for a while.  also, Mike Byrne at Rice and 
his act-r/pm module is an excellent thing to follow and build upon. 
source code for most systems are available, so you can build on them.

cheers,

Frank

At 10:25 PM -0400 6/7/06, Robert Wray wrote:
>On the general subject of incorporating Soar and a vision system and
>using Soar for object recognition, Daniel Crevier attended a few Soar
>workshops in the 90's with this goal in mind; I dont know if there's
>anything published on this topic.
>
>http://www.wired.com/wired/archive/2.10/streetcred.html?pg=16
>
>Bob
>
>Yan King Yin wrote:
>>  Dear Soar group
>>
>>  I'm planning to develop a vision front-end for use by intelligent
>>  agents.  The long term goal is to be able to recognize everyday
>  > objects, estimate depth / distance, recognize events, and basically be
>  > the "eyes" for intelligent agents.
>>
>>  The outline of my vision scheme is here:
>>  http://www.geocities.com/genericai/VisionScheme.htm
>>  Basically the scheme is to decompose the input image / video into
>>  structural features and output them in a graphical representation for
>>  further processing.  Object recognition is based on production rules.
>>  Recognition iterates hierarchically from low-level features to 2D and
>>  3D features.  At the highest level the output is a logical / symbolic
>>  description of the scene.
>>
>>  The special point is that the vision module works closely within a
>>  cognitive architecture.  I'm trying to see if Soar can be such a
>>  "host" for this project.  (Sorry if I sound ignorant about Soar;  I'm
>>  just starting to learn about it).
>>
>>  Also, I have thought about the problem of general intelligence for 
>>some time:
>>  http://www.geocities.com/genericai/GI-Basics.htm
>>  My most important idea is that the intelligent agent must compress its
>>  sensory experience and store the results into its memory systems
>>  (episodic, semantic, etc).
>>
>>  Question 1:  Are there Soar implementations where I can plug in a
>>  vision front-end and start experimenting with sensory processing, like
>>  right now?
>>
>>  Question 2:  In Soar's episodic memory, can I store general events
>>  such as statements in the format of "event calculus"?  For example,
>  > "John threw a red ball to Mary at 2:00pm".
>  >
>  > Question 3:  It seems that Soar's knowledge representation is based on
>  > attribute-value pairs, whereas my choice of KR is predicate logic
>  > because of its universal expressiveness.  Will there be a problem that
>>  some logical facts are not representable in Soar?
>>
>>  I know these problems may be very hard, but I also believe that having
>>  a vision module for Soar will allow it to do a lot more interesting
>>  things, so it's probably worth the effort.
>>
>>  Any comments or suggestions?
>>
>>  Thanks in advance,
>>  Yan King Yin
>>  General Intelligence Research Group
>>
>>  Using Tomcat but need to do more? Need to support web services, security?
>>  Get stuff done quickly with pre-integrated technology to make your 
>>job easier
>>  Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>>  http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>>  _______________________________________________
>>  soar-group mailing list
>>  soar-group at lists.sourceforge.net
>>  https://lists.sourceforge.net/lists/listinfo/soar-group
>>
>
>Using Tomcat but need to do more? Need to support web services, security?
>Get stuff done quickly with pre-integrated technology to make your job easier
>Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>_______________________________________________
>soar-group mailing list
>soar-group at lists.sourceforge.net
>https://lists.sourceforge.net/lists/listinfo/soar-group