NUmber of linear dichotomies of a binary d-Dim space
Danny L. Silver
dsilver at csd.uwo.ca
Sun Feb 5 09:42:31 EST 1995
It is well known that a d-dimensional 2-class hypothesis space containing
n patterns in "general position" will have L(n,d) linear dichotomies
[see 1,2,3]; where L(n,d) is computed using a recursive equation:
L(n,d) = L(n-1,d) + L(n-1,d-1)
with the boundary conditions of: L(1,d) = 2 and L(n,1) = 2n.
This can also be stated as:
L(n,d) = 2 SUM(i=0 to d) ( n-1 ) ; for n > d
( i )
L(n,d) = 2^n ; for n <= d
Example:
d = 2, n = 4, then:
L(4,2) = L(3,2) + L(3,1)
= L(2,2) + L(2,1) + 2(3)
= L(1,2) + L(1,1) + 4 + 6
= 2 + 2 + 4 + 6
= 14
Furthermore, there will be L(n,d)/2 (eg. 14/2 = 7) hyperplanes involved in
partitioning the classes for the (eg. 14) dichotomies.
However, if the patterns are based on binary components, then the
pattern points are the vertices of a hypercube; in which case the general
position condition does not hold and the L(n,d) value provides only an upper
bound on the number of linear dichotomies.
Question: Is there an expression/procedure for computing the exact
number of liner dichotomies of a binary d-dimensional hypothesis space?
Any information would be most helpful.
I will collect and summarize received replies on this matter.
.. Many thanks, Danny.
Ref:
(1) "The Mathematical Foundations of Learning Machines" by Nils J.
Nilsson, Morgan Kaufman, San Mateo, CA; 1990 (originally published
in 1965 as"learning Machines"). -- p. 32-34
(2) "Neural Networks in Computing Intelligence" by LiMin Fu,
McGraw-Hill, inc, NY, 1994. -- p. 71-73
(3) A set of n points are said to be in "general position" in a
d-dimensional space iff no subset of d+1 points lies on any d-1
dimensional hyperplane. In the case of a binary hypercube, this
implies that no subset of d+1 pattern points may lie on any one
d-1 hypercube face.
--
=========================================================================
= Daniel L. Silver University of Western Ontario, London, Canada =
= N6A 3K7 - Dept. of Comp. Sci. - Office: MC27b =
= dsilver at csd.uwo.ca H: (519)473-6168 O: (519)679-2111 (ext.6903) =
=========================================================================
More information about the Connectionists
mailing list