[ACT-R-users] sensitivity analyses of ACT-R parameters

[Gluck, Kevin A Civ USAF AFMC 711 HPW/RHAC]

Coty,

We ran sensitivity analyses of the :bll and :ans parameters in David
Reitter's ACT-UP model of the Dynamic Stocks and Flows task.  Those results
and others (including a procedural parameter sweep using Halbruegge's DSF
model) were published in the attached paper.  It may not be precisely what
you are looking for, but it's certainly similar in spirit.  

The broad point and position is that we learn more about our models,
architectures, and systems by performing and reporting explorations of
performance surfaces in the form of systematic sensitivity and necessity
analyses than we do by limiting ourselves to gradient descent searches for
optimal fits or maximum performance levels.  So I'm glad to know you have
some new research underway that also will involve sensitivity analyses.

As you are no doubt aware, these can become computationally intensive.  We
used two DoD HPC centers for the 40 million runs reported in this paper, in
order to get them done in two weeks, rather than the 10 years or so it would
have taken with the machines we were running in our lab.  Since then, Jack
Harris and his MindModeling team have expanded their system so that it
includes both volunteer resources and HPC clusters.  Perhaps Jack will
elaborate.  I'll just say that it's even more flexible and powerful a
capability than it used to be, and it is available to computational
cognitive scientists who find their research programs restricted by
inadequate access to computational resources.

www.mindmodeling.org

Cheers,

Kevin

-----Original Message-----
From: act-r-users-bounces at act-r.psy.cmu.edu
[mailto:act-r-users-bounces at act-r.psy.cmu.edu] On Behalf Of Cleotilde
Gonzalez
Sent: Wednesday, October 17, 2012 3:50 PM
To: act-r-users at act-r.psy.cmu.edu
Cc: 'Jason Harman'; 'Noam Ben-Asher'
Subject: [ACT-R-users] sensitivity analyses of ACT-R parameters

Hello,
  I am working on a project involving sensitivity analyses of ACT-R
parameters d and s.  Would any of you know of any work that has done
something like this?  Would you please refer papers/authors to me? 

thank you,

Coty

_______________________________________________
ACT-R-users mailing list
ACT-R-users at act-r.psy.cmu.edu
http://act-r.psy.cmu.edu/mailman/listinfo/act-r-users
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Gluck, Stanley, Moore, Reitter,	& Halbrugge (2010) Exploration for Understanding in Cognitive	Modeling.pdf
Type: application/pdf
Size: 1023569 bytes
Desc: not available
URL: <http://mailman.srv.cs.cmu.edu/pipermail/act-r-users/attachments/20121018/b3d7f64e/attachment.pdf>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 5692 bytes
Desc: not available
URL: <http://mailman.srv.cs.cmu.edu/pipermail/act-r-users/attachments/20121018/b3d7f64e/attachment.bin>