[ieee 2013 international conference on high performance computing & simulation (hpcs) -...

7
Modeling of asynchronous cellular automata with fixed-point attractors for pattern classification Biswanath Sethi * Sukanta Das Department of Information Technology Bengal Engineering and Science University, Shibpur, Howrah, West Bengal, India-711103. Email: [email protected], [email protected] * Corresponding author Abstract—This paper addresses a detail characterization of the one-dimensional two-state 3-neighborhood asynchronous cellular automata (ACA) having multiple fixed-point attractors with the target to model this class of CA for designing efficient pattern classifier. The cells of ACA are independent, and they are updated independently. When an ACA cell is updated, it reads the states of its neighbors and then updates its state following the state transition function. The ACA rules are characterized considering an arbitrary cell is updated in each time step. A theorem is designed for the identification of ACA with only fixed-point attractors. From this theorem we get 146 out of 256 ACA in two-state 3-neighborhood interconnection which always approach towards fixed-Point attractors. To identify individual fixed-point attractors, a directed graph, namely Fixed-point graph (FPG) is proposed. The FPG guides us to point out the ACA having multiple fixed-points attractors. There are 83 such ACA (out of 146 ACA with only fixed-point attractors) that are utilized to design efficient pattern classifier. Finally, the proposed classifier is tested with real-life data sets, and it is observed that the performance of the proposed ACA based classifier is always better than that of traditional CA based classifier and is also better than many other well-known pattern classifiers. Index Terms—Cellular automata model, asynchronous cellular automata (ACA), fixed-point attractor, Fixed-point graph (FPG), pattern classifier. I. I NTRODUCTION With the increase of computing power, the researchers have been showing their interest on the study of global behavior of cellular automata (CA). The CA have become popular tool to simulate various real-world systems. CA were originally introduced as an abstract mathematical model capable of self- reproduction [12]. They are defined by a lattice of cells and a local rule by which state of a cell is determined as a function of the state of its neighbors. In early 1980, the CA structure was simplified, and a two-state, 3-neighborhood CA structure was proposed on an one-dimensional lattice [13]. The researchers working with VLSI design and test have got attracted to this type of CA due to their simplicity and ease of hardware implementations [1]. This contribution also concentrates on such one-dimensional two-state 3-neighborhood CA. While characterizing the CA, a set of CA states have been identified, toward which neighboring states asymptotically ap- proach in the course of dynamic evolution, called attractors [1], This work is supported by DST Fast Track Project Fund (No.SR/FTP/ETA- 0071/2011) [14]. The attractors can be of length 1 (fixed-point attractor) or of length greater than 1 (multi-state attractor). The CA with multiple fixed-point attractors have been targeted to design effective solutions for patten classification [1]. The character- ization of CA for pattern classification has received special attention for cost effective solutions of real life applications. The CA, contributing with this context, are addressed in [2], [3], [5]–[8]. However, all such contributions have dealt with synchronous CA, where all the CA cells are forced to be updated simulta- neously. On the other hand, in asynchronous CA (ACA) the cells are independent, and as a result, the cells are free to get updated independently [4], [9]. This independence property of ACA cells may affect the performance of ACA while they are utilized to address some real life problems. The ACA, however, have rarely been considered to solve pattern classification problem. Two dimensional ACA are studied in [10], [11] to utilize them for pattern classification. To our knowledge, no target has been taken to study one-dimensional ACA as pattern classifier. In this scenario, we concentrate on characterization of ACA in one-dimensional two-state 3-neighborhood interconnection, with the target to design an efficient model for pattern classi- fication. The ACA with multiple fixed-point attractors are uti- lized for pattern classification. We refer such ACA as multiple attractor ACA (MAACA). Here, we design 2-class classifier. We explore the essential properties of attractors that enable us for such characterization. A theorem has been reported for the identification of ACA with fixed-point attractors. One of the major contributions of this work is, it introduces the idea of Fixed-point graph to identify the fixed-point attractors of ACA. An algorithm is also developed to find the fixed- point attractors from the graph. Finally, the pattern classifier is designed and tested with real-life data sets. It is shown that performance of ACA based classifier is much better than that of traditional (that is, synchronous) CA based classifier. Moreover, the proposed classifier is very much competitive with other well-known classifier, even better than them in many cases. The next section introduces the preliminaries of ACA and some definitions which are relevant for the current work. Section III reports the characterization of ACA. A theorem and algorithms for characterization are addressed in this section. 978-1-4799-0838-7/13/$31.00 ©2013 IEEE 311

Upload: sukanta

Post on 14-Mar-2017

221 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: [IEEE 2013 International Conference on High Performance Computing & Simulation (HPCS) - Helsinki, Finland (2013.07.1-2013.07.5)] 2013 International Conference on High Performance Computing

Modeling of asynchronous cellular automata withfixed-point attractors for pattern classification

Biswanath Sethi∗ Sukanta DasDepartment of Information Technology

Bengal Engineering and Science University, Shibpur, Howrah, West Bengal, India-711103.Email: [email protected], [email protected]

* Corresponding author

Abstract—This paper addresses a detail characterization of theone-dimensional two-state 3-neighborhood asynchronous cellularautomata (ACA) having multiple fixed-point attractors with thetarget to model this class of CA for designing efficient patternclassifier. The cells of ACA are independent, and they are updatedindependently. When an ACA cell is updated, it reads the statesof its neighbors and then updates its state following the statetransition function. The ACA rules are characterized consideringan arbitrary cell is updated in each time step. A theorem isdesigned for the identification of ACA with only fixed-pointattractors. From this theorem we get 146 out of 256 ACA intwo-state 3-neighborhood interconnection which always approachtowards fixed-Point attractors. To identify individual fixed-pointattractors, a directed graph, namely Fixed-point graph (FPG)is proposed. The FPG guides us to point out the ACA havingmultiple fixed-points attractors. There are 83 such ACA (out of146 ACA with only fixed-point attractors) that are utilized todesign efficient pattern classifier. Finally, the proposed classifieris tested with real-life data sets, and it is observed that theperformance of the proposed ACA based classifier is alwaysbetter than that of traditional CA based classifier and is alsobetter than many other well-known pattern classifiers.

Index Terms—Cellular automata model, asynchronous cellularautomata (ACA), fixed-point attractor, Fixed-point graph (FPG),pattern classifier.

I. INTRODUCTION

With the increase of computing power, the researchers havebeen showing their interest on the study of global behaviorof cellular automata (CA). The CA have become popular toolto simulate various real-world systems. CA were originallyintroduced as an abstract mathematical model capable of self-reproduction [12]. They are defined by a lattice of cells and alocal rule by which state of a cell is determined as a function ofthe state of its neighbors. In early 1980, the CA structure wassimplified, and a two-state, 3-neighborhood CA structure wasproposed on an one-dimensional lattice [13]. The researchersworking with VLSI design and test have got attracted to thistype of CA due to their simplicity and ease of hardwareimplementations [1]. This contribution also concentrates onsuch one-dimensional two-state 3-neighborhood CA.

While characterizing the CA, a set of CA states have beenidentified, toward which neighboring states asymptotically ap-proach in the course of dynamic evolution, called attractors [1],

This work is supported by DST Fast Track Project Fund (No.SR/FTP/ETA-0071/2011)

[14]. The attractors can be of length 1 (fixed-point attractor) orof length greater than 1 (multi-state attractor). The CA withmultiple fixed-point attractors have been targeted to designeffective solutions for patten classification [1]. The character-ization of CA for pattern classification has received specialattention for cost effective solutions of real life applications.The CA, contributing with this context, are addressed in [2],[3], [5]–[8].

However, all such contributions have dealt with synchronousCA, where all the CA cells are forced to be updated simulta-neously. On the other hand, in asynchronous CA (ACA) thecells are independent, and as a result, the cells are free to getupdated independently [4], [9]. This independence propertyof ACA cells may affect the performance of ACA whilethey are utilized to address some real life problems. TheACA, however, have rarely been considered to solve patternclassification problem. Two dimensional ACA are studied in[10], [11] to utilize them for pattern classification. To ourknowledge, no target has been taken to study one-dimensionalACA as pattern classifier.

In this scenario, we concentrate on characterization of ACAin one-dimensional two-state 3-neighborhood interconnection,with the target to design an efficient model for pattern classi-fication. The ACA with multiple fixed-point attractors are uti-lized for pattern classification. We refer such ACA as multipleattractor ACA (MAACA). Here, we design 2-class classifier.We explore the essential properties of attractors that enableus for such characterization. A theorem has been reportedfor the identification of ACA with fixed-point attractors. Oneof the major contributions of this work is, it introduces theidea of Fixed-point graph to identify the fixed-point attractorsof ACA. An algorithm is also developed to find the fixed-point attractors from the graph. Finally, the pattern classifieris designed and tested with real-life data sets. It is shownthat performance of ACA based classifier is much better thanthat of traditional (that is, synchronous) CA based classifier.Moreover, the proposed classifier is very much competitivewith other well-known classifier, even better than them inmany cases.

The next section introduces the preliminaries of ACA andsome definitions which are relevant for the current work.Section III reports the characterization of ACA. A theorem andalgorithms for characterization are addressed in this section.

978-1-4799-0838-7/13/$31.00 ©2013 IEEE 311

Page 2: [IEEE 2013 International Conference on High Performance Computing & Simulation (HPCS) - Helsinki, Finland (2013.07.1-2013.07.5)] 2013 International Conference on High Performance Computing

TABLE ILOOK-UP TABLE FOR RULE 36, 77 AND 219

PS : 111 110 101 100 011 010 001 000 Rule

(RMT ) (7) (6) (5) (4) (3) (2) (1) (0)(i)NS : 0 0 1 0 0 1 0 0 36(ii)NS : 0 1 0 0 1 1 0 1 77(iii)NS : 1 1 0 1 1 0 1 1 219

The design of pattern classifier are devised in section IV. Thealgorithm for the design of pattern classifier is also reported.The performance of the proposed scheme with other are alsoreported in this section.

II. PRELIMINARIES OF ACA

Cellular automaton (CA) is a discrete dynamical systemwhich evolves in discrete time and space. A CA consists of alattice of cells, each of which stores a boolean variable at timet, that refers to the present state of the CA cell [13]. The nextstate of a cell of one-dimensional two-state 3-neighborhoodCA is determined by the present states of left, self and rightneighbors. Hence,

St+1i = f(St

i−1, Sti , S

ti+1) (1)

where f is the next state function; Sti−1, St

i and Sti+1 are the

present states of the left neighbor, self and right neighbor ofthe ith CA cell at time t respectively. A collection of (local)states St(St

1, St2, · · · , S

tn) of cells at time t is referred as a

configuration or a (global) state of the CA at t. The functionf : {0, 1}3 7→ {0, 1} can be expressed as a look-up table(see TABLE I). The decimal equivalent of the 8 outputs iscalled ‘rule’ [13]. There are 28 = 256 CA rules in two-state3-neighborhood dependency. Three such rules (36, 77 and 219)are shown in TABLE I. From the view point of SwitchingTheory, a combination of the present states can be consideredas the Min Term of a 3-variable (St

i−1, Sti , S

ti+1) switching

function. So, each column of the first row of TABLE I isreferred to as Rule Min Term (RMT). The column (011) isthe RMT 3. The next states corresponding to this RMT are 0for rule 36 and, 1 for rule 77, and 1 for rule 219 (TABLE I).When the left most and right most cells of an n-cell CA arethe neighbors of each other (that is, St

0 = Stn and St

n+1 = St1),

the CA is called periodic boundary CA.Traditionally, the cells of a CA are updated simultaneously.

In asynchronous update, on the other hand, the cells areconsidered as independent and so, updated independently. Wehave considered here that a single arbitrary cell is updated ineach time step. Such CA are referred as asynchronous cellularautomata (ACA). This work deals with one-dimensional two-state 3-neighborhood ACA under periodic boundary condition.

The next state of a synchronous CA is determined by therule only. However, in ACA, the next state does not onlydepend on the rule, but also on the cell which is being updatedrandomly. Fig. 1 shows state transition diagram of 4-cell rule219 ACA in periodic boundary condition. The cells, updatedrandomly during state transition, are noted over arrows.

An ACA state can be viewed as a sequence of RMTs. Forexample, the state 1110 in periodic boundary condition can

TABLE IIRELATIONSHIP BETWEEN i

th AND (i+ 1)th RMTS

ith RMT (i + 1)th RMT

0, 4 0, 11, 5 2, 32, 6 4, 53, 7 6, 7

be viewed as 〈3765〉, where 3, 7, 6 and 5 are correspondingRMTs on which the transitions of first, second, third and fourthcell can be made. To get a sequence of RMTs for a state, weconsider an imaginary 3-bit window that slides over the state.The window contains a 3-bit binary value which is equivalentto RMT. To get the ith RMT, the window is loaded with (i−1)th, ith and (i+1)th bits of the state. The window slides onebit right to report the (i+1)th RMT. Now the current contentof the window is ith, (i + 1)th and (i+ 2)th bit of the state.In the sequence of RMTs, however, two consecutive RMTsare related. If 5 (101) is the ith RMT in some sequence, then(i + 1)th RMT is either 2 (010) or 3 (011). Similarly, if 0(000) or 4 (100) is the ith RMT, then 0 (000) or 1 (001) is the(i + 1)th RMT. The relations of two consecutive RMTs in asequence of RMTs are noted in TABLE II. These relations playan important role in the design of pattern classifier, reportedin this paper.

Definition 1: An RMT r of a rule is active if an ACA cellflips its state (1 to 0 or 0 to 1) on r. Otherwise, the RMT r

is passive.For example, RMT 1 (001) of rule 219 (see TABLE I) is

active. Because, while a cell is acting on that particular RMT,then the cell’s present state is 0 and next state for the rule is 1.Hence, transition occurs. So, it can be said that if the middlebit of an RMT is unequal with the RMT value, the RMT isactive. RMT 7 (111) of rule 219, on the other hand, is passive.

Definition 2: A fixed-point attractor is an ACA state, nextstate of which is the state itself for any style of update of cells.That is, if an ACA reaches to a fixed-point attractor, the ACAremains in that particular state forever.

In Fig. 1, the states 1101, 0111, 1111, 1011 and 1110 arefixed-point attractors for rule 219 ACA. The RMT sequencefor the state 1111 is 〈7777〉. The next state of 1111 is always1111 for the update of any cell in any sequence. The RMT 7is passive for rule 219. It can be observed that the RMTs inthe RMT sequence of a fixed-point attractor are to be passive.Hence, we get the following lemma.

Lemma 1: Rule R ACA forms a fixed-point attractor withstate S if the RMTs of the RMT sequence of S are passive.

Since there are five, attractors in 4-cell rule 219 ACA,we can find five basins of attraction (Fig. 1). An attractor isthe representative of the corresponding basin. If not specifiedotherwise, we shall refer fixed-point attractor as just attractorin our further discussion.

III. CHARACTERIZATION OF ACA

This section reports the properties of ACA to explore thefixed-point attractors. The proposed characterization is based

312

Page 3: [IEEE 2013 International Conference on High Performance Computing & Simulation (HPCS) - Helsinki, Finland (2013.07.1-2013.07.5)] 2013 International Conference on High Performance Computing

1111

1/2/3/4 (c)

0001

1001

1011

0000

1000

1001

1000

0000

1000

1001

1 1 1

34 1

34

3

1/2/3/4 (d) (e)

0010

0110

1110

1000

1100

1001

1001

1000

1100

2

1

2

3

1

4

2

3

1/2/3/4

(a)

0000

1000

11011100

0001

1001

0100

1100

1

2

4

1

2

1

4

0001 0101

0011

0111

0001 0011

0110

0010

1010

3 2 1

2 3

2

3

4

1/23/4(b)

Fig. 1. A state transition diagram of 4-cell rule 219 ACA.

on a theorem and algorithms. The theoretical foundationis thus evolved and then employed to identify fixed-pointattractors.

A. ACA with only fixed-point attractors

The following theorem states the necessary conditions ofACA, having only fixed-point attractors.

Theorem 1: Rule R ACA converges to fixed-point attractorif (i) RMT 0 (RMT 7) of R is passive and RMT 2 (RMT 5)is active, or (ii) RMTs 0 and 7 are passive and RMT 2 or 5is active, or (iii) RMTs 0, 1, 2, and 4 (RMTs 3, 5, 6, and 7)are passive and RMT 3 or 6 (RMT 1 or 4 ) is active, or (iv)RMTs 1, 2, 4, and 5 (RMTs 2, 3, 5 and 6) are passive.

Proof: Proof of case (i): Let us consider RMT 0 of R

is passive and RMT 2 is active. We shall show that the ruleR ACA can reach to a fixed-point attractor from any initialstate. Since RMT 0 is passive, the all-0 state (RMT sequence〈00 · · · 0〉) is a fixed-point attractor. In any other state (exceptall-1), a sequence of consecutive 1s guided by 0s can alwaysbe found.

Consider, RMT 7 of R is active. Now in such a state (like· · · 0111110 · · ·), we can find RMT 7 in its correspondingRMT sequence. If a cell with RMT 7 is selected to update,in that case, the sequence of consecutive 1s is divided intotwo sub-sequences of consecutive 1s guided by 0s. The newsequences have less number of 1s (like · · · 0111110 · · · →· · · 0101110 · · ·). After a number of similar updates, we canget a state with a number of single 1 and two consecutive 1sguided by 0s. A cell has state 1 with left and right neighbor’sstates as 0s (010) implies that the cell can act on RMT 2.Since RMT 2 is active, all such cells can reach to state 0.So, finally, we get either the all-0 state (that is, the ACA isconverged to all-0), or a state with two consecutive 1s guidedby 0s (· · · 001100 · · ·). In second case, the RMT sequencecontains RMT 0 and RMTs 1, 3, 6 and 4. If RMTs 1, 3, 4and 6 are passive, the state · · · 0110 · · · itself is a fixed-pointattractor. Otherwise, the ACA can reach to all-0 (fixed-point)attractor after some update of cells. Hence, from an arbitrary

state with sequences of consecutive 1s guided by 0s, the ACAcan reach to a fixed-point attractor. The all-1 state is a specialstate which contains no 0. However, if an arbitrary cell isupdated, then we can get a 0, and then the new state canreach to fixed-point attractor with the above logic.

Now consider, RMT 7 is passive. Then, the all-1 state (RMTsequence 〈77 · · · 7〉) is another fixed-point attractor. A statewith a sequence of consecutive 1s guided by 0s contains RMTs3 and 6. If any one of them is active, the ACA with that statecan reach to all-0 fixed-point. If both (RMT 3 and 6) arepassive but RMT 1, 4 or 5 is active, the ACA can reach toall-1 fixed-points. If all RMTs except 2 are passive, then thestate itself is a fixed-point attractor. Hence, the rule R ACAthat can reach to fixed-point attractors from any initial state ifRMT 0 of R is passive and RMT 2 is active.

While RMT 7 is passive and RMT 5 is active (and the restRMTs are active or passive) it can be shown by similar logicthat the rule R ACA converge to fixed-point attractorsProof of case (ii): While RMTs 0 and 7 of R are passive andRMT 2 or RMT 5 is active, the ACA converges to fixed-pointattractor. This proof can obviously followed from the proof ofcase (i).Proof of case (iii): Consider RMTs 0, 1, 2 and 4 of R arepassive. Then, the states where two 1s are separated by atleast two consecutive 0s (like · · · 001000100 · · ·) are fixed-point attractors, because the corresponding RMT sequencesof these states contain only RMTs 0, 1, 2 and 4 (Lemma 1).Now consider a state which contains two or more consecutive1s. Therefore, the corresponding RMT sequence of the statecontains RMTs 3, 7 and 6 (along with others). If RMTs 3 or6 is active, the number of 1s can be reduced to a single 1separated by 0s during evolution of the ACA. The resultantstate is a fixed-point attractor if corresponding RMT sequencecontains RMTs 0, 1, 2 and 4 only. If the resultant state(like · · · 001010 · · ·) contains any other RMT which is active(except 3 or 6) then updating the cells properly, we can reachto a state which is a fixed-point attractor.

While RMTs 3, 5, 6, and 7 are passive, the states wheretwo 0s are separated by at least two consecutive 1s (like· · · 11011011 · · ·) are fixed-point attractors because the corre-sponding RMT sequences of these states contain RMTs 3, 5,6 and 7 only (Lemma 1). Now consider a state which containstwo or more consecutive 0s. Therefore, the correspondingRMT sequence of state contains RMTs 4, 0 and 1 (alongwith other). If RMT 1 or 4 is active, the number of 0s canbe reduced to single 0 separated by 1s during the evolutionof the ACA. The resultant state is a fixed-point attractor ifcorresponding RMT sequence contains RMT 3, 5, 6, 7 only.If the resultant state contains any other RMT which is active(except RMT 1 or 4) then we can reach to a fixed-pointattractor.Proof of case (iv): Consider RMTs 1, 2, 4 and 5 of R arepassive. We shall next show that from any state, the ACAcan reach to a fixed-point attractor while RMT 0, 3, 6, or7 or none is active. Let us consider RMTs 0 and 7 areactive. Now, from all-0 state, updating cell with RMT 0

313

Page 4: [IEEE 2013 International Conference on High Performance Computing & Simulation (HPCS) - Helsinki, Finland (2013.07.1-2013.07.5)] 2013 International Conference on High Performance Computing

we can reach to 0101 · · · after a number of time steps. Thestate 0101 · · · is a fixed-point attractor. The transitions are :0000 · · · → 0100 · · · → · · · → 0101 · · ·.

Similarly, from all-1 state, the ACA can reach to 0101 · · ·01or 0101 · · ·011 (depending on the number of cells). The state0101 · · ·01 is itself a fixed-point attractor and 0101 · · ·011 canbe a fixed-point attractor if RMTs 3 and 6 are passive. If RMT3 or 6 is active, the ACA can obviously reach to a fixed-pointattractors. Now it can easily be shown that the ACA can reachto a fixed-point attractor from any state.

Lastly, it can also be shown that rule R ACA can reachto a fixed-point attractor, if RMTs 2, 3, 5 and 6 are passive.We omit the detail steps of this proof because the rationale issimilar with other cases.

There are 64 rules where the RMT 0 is passive and RMT 2 isactive (Theorem 1(i)). Similarly, identifying this way theorem1 dictates that there are 146 ACA out of 256, which alwaysapproach to some fixed-point attractors. Such ACA rules arelisted in TABLE III.

Example 1: Let us consider the rule 36 ACA, in whichRMTs 0, 1, 2 and 4 are passive. Therefore, the rule satisfies thecondition for convergence to fixed-point attractor (Theorem 1(iii)). Here, we assume number of cells are 4 and the initialstate is 1111. The ACA can reach to a fixed-point attractorafter some random update of cells from the initial state. Onepossible transition is: 1111(1) → 0111(4) → 0110(4) →0110(2) → 0010 (the cell updated in a step is noted inbracket).

TABLE IIITHE RULES OF ACA WHICH ALWAYS APPROACH TOWARDS FIXED-POINT

ATTRACTORS

0 2 4 5 8 10 12 1316 18 24 26 32 34 36 4042 44 48 50 56 58 64 6668 69 72 74 76 77 78 7980 82 88 90 92 93 94 9596 98 100 104 106 112 114 120122 128 130 132 133 136 138 140141 144 146 152 154 160 161 162163 164 165 166 167 168 169 170171 172 173 174 175 176 177 178179 180 181 182 183 184 185 186187 188 189 190 191 192 194 196197 200 202 203 204 205 206 207208 210 216 217 218 219 220 221222 223 224 225 226 227 228 229230 231 232 233 234 235 236 237238 239 240 241 242 243 244 245246 247 248 249 250 251 252 253254 255

B. Identification of fixed-point attractors

Following Theorem 1, we can get the list of ACA whichalways converge to fixed-point attractors (TABLE III).However, the individual attractors of ACA are not identified.To utilize ACA as pattern classifier, one has to identify theattractors. This subsection reports the concept of Fixed-pointgraph (FPG) to identify the attractors. The FPG is a directedgraph, where the nodes represent the passive RMTs. To get

1

2 3

4 56

Fig. 2. Fixed-point graph (FPG) of rule 77 ACA

FPG for some ACA, we first identify the passive RMTs ofthe corresponding rule. As a next step, a forest consideringthe passive RMTs as individual nodes is formed. Now, wedraw an edge from node u to node v, if u and v are relatedfollowing TABLE II. For example, if RMTs 1, 2 and 5 arepassive, then we can draw directed edges from node 1 tonode 2, node 2 to node 5 and node 5 to node 2. But wecan not draw the directed edge from node 1 to node 5, asRMT 1 and RMT 5 are not related (see TABLE II). We nextpropose an algorithm that constructs FPG of a given ACA rule.

Algorithm 1: Construction of FPGInput: Rule R, TABLE II.Output: Fixed-point graph (G) with all passive RMTs are itsvertices.Step 1. Point out the passive RMTs of RStep 2. Make forest with passive RMTs of RStep 3. For each vertex u repeat step 4 and step 5.Step 4. Find the next possible RMTs from TABLE II.Step 5. If the next possible RMT is a vertex v, then draw adirected edge from u to vStep 6. Report the graph as FPG

Example 2: This Example illustrates the steps of Algorithm1. Let us consider rule 77 ACA. Here, the passive RMTs are1, 2, 3, 4, 5 and 6 (see TABLE I). As per step 2 of Algorithm1, the vertices of the graph are 1, 2, 3, 4, 5 and 6 (see Fig.2). Now considering the first vertex as vertex 1, we find thenext RMTs of vertex 1 are RMT 2 and 3 (from TABLE II).As these two RMTs are also vertices, we draw directed edgesfrom vertex 1 to both vertices 2 and 3 (see Fig. 2). Similarly,for vertex 3 the next possible RMTs are 6 and 7. But onlyone directed edge is possible from vertex 3 to vertex 6, sincevertex 7 is absent (Fig. 2). After the construction of directededges for all the vertices, the graph is the desired FPG. Fig.2 is the FPG, resulted from the Algorithm 1 of rule 77 ACA.

Following Algorithm 1, we can get the FPGs for therules of ACA, which always approach to some fixed-pointattractors. Algorithm 2, reported next, provides the procedurefor counting the number of attractors from a FPG of aparticular ACA. For each vertex in the FPG, we countnumber of cycles of length equal to the ACA size. The sumof all cycles for each vertex is the total number of fixed-pointattractors for that particular ACA.

314

Page 5: [IEEE 2013 International Conference on High Performance Computing & Simulation (HPCS) - Helsinki, Finland (2013.07.1-2013.07.5)] 2013 International Conference on High Performance Computing

Algorithm 2: Counting AttractorsInput : FPG (G) from Algorithm 1, n (CA size)Output: Number of fixed-point attractorsStep 1. For each vertex v of (G), repeat steps 2 and 3.Step 2. Find whether v can be reached after exploring (n-1)vertices of (G)Step 3. If there are m ways to return back to v, add this mwith the total no. of fixed-point attractors to be reported.Step 4. If no such path is found, a fixed-point attractor cannot be formed with vertex v.Step 5. Report the total no. of fixed-point attractors.

Example 3: This Example illustrates the execution steps ofAlgorithm 2. Let us consider, for the graph G (Fig. 2), wecount the number of fixed-point attractors for 4 cell ACA.Starting from vertex 1, the vertex 1 can be reached afterexploring vertices 3, 6 and 4 (step 2 of Algorithm 2). Thepath is 1→ 3→ 6→ 4→ 1 (Fig. 2). Similarly, other cyclesof length 4 (as 4 cell ACA) in G can be found, and the totalcycles of length 4 are the total number of fixed-point attractorsin G. The cycles of length 4 in G (Fig. 2) are:

1) 1→ 3→ 6→ 4→ 12) 3→ 6→ 4→ 1→ 33) 6→ 4→ 1→ 3→ 64) 4→ 1→ 3→ 6→ 45) 2→ 5→ 2→ 5→ 26) 5→ 2→ 5→ 2→ 5

Hence, the total number of attractors in G is 6 (see Fig. 2).

TABLE IVTHE RULES OF ACA WITH MULTIPLE FIXED-POINT ATTRACTORS

(MAACA)

4 5 12 13 36 44 68 6972 76 77 78 79 92 93 9495 100 104 128 130 132 133 136138 140 141 144 146 152 154 160162 164 166 168 170 172 174 176178 180 182 184 186 188 190 192194 196 197 200 202 203 204 205206 207 208 210 216 217 218 219220 221 222 223 224 228 232 234236 237 238 240 242 244 246 248250 252 254

Out of 256, 146 ACA in two-state 3-neighborhood inter-connection that always approach towards fixed-point attractorsare already listed in TABLE III (Theorem 1). However, wecan further identify a set of ACA which are having multipleattractors. Algorithm 2 guides us to find such set of ACA.There are 83 ACA (TABLE IV) which have multiple attractorsand are referred as multiple attractors ACA (MAACA). TheseMAACA are utilized in designing pattern classifier.

IV. DESIGN OF CLASSIFIER

An n-cell ACA with multiple fixed-point attractors(MAACA) can be viewed as a natural classifier. It classifies aset of patterns into different distinct classes, each class con-tains set of states of the attractor basin. For the identification

of a class of patterns, the attractors, representing the classes,need to be stored in memory (Fig. 3). To identify the class ofan input pattern P, the MAACA is loaded with P and updatedtill it reaches to an attractor. Then, from the attractor and thestored information, one can declare the class of the pattern P.In Fig. 3, the class of P is I. However, if there are more thantwo attractors, then a set of attractors identify a class.

Memory

I

II

P

Fig. 3. MAACA based classification strategy

Example 4: Let the MAACA of Fig. 1 be employed toclassify patterns into two classes (say 1 and 2), where class 1is represented by the states of three attractor basins and class2 is represented by the states in the rest of basins. Let theattractors 1111, 0111 and 1110 be for class 1 and the restattractors 1101 and 1011 be for class 2. Hence, the MAACAof Fig. 1 can act as 2-class pattern classifier.

The design of MAACA based 2-class classifier for patternclassification demands the proper distribution of the patternsamong the CA attractor basins. The design of classifier fortwo pattern sets P1 and P2 should ensure that elements ofone class (say P1) are covered by a set of attractor basins thatdo not include any member from the class P2. However, forreal-life data sets, the attractor basins may mix up the patternsof two classes. Therefore, the primary metric for evaluatingclassifier performance is the classification accuracy. It ismeasured as:

efficiency =# patterns properly classified

Total No. of patterns× 100 (2)

Example 5: Let us consider two pattern sets of class 1 sayP1={1111, 0011, 1100, 0110} and class 2 say P2={0000,0001, 1000}. Suppose the MAACA of Fig. 1 is considered asthe classifier. The pattens 1111, 0011, 1100 and 0110 from setP1 are under attractor basin class 1 while patterns 0000, 0001from set P2 are in attractor basin class 2. However, the pattern1000 is in class 2, but it is wrongly identified by the classifieras class 1. Hence, The total number of properly identifiedpatterns are 6. So, by using the formula of equation 2 theefficiency of the classifier utilizing the above given patterns,for the particular ACA is 85.714%. Depending on the patternsets and the MAACA, the efficiency can vary.The above discussion shows that the MAACA are the can-didates to qualify as a pattern classifier. Out of 83 MAACA(TABLE IV), however, we exclude rule 204 ACA, because allthe states of 204 ACA are attractors. For the rest 82 rules, wedesign Algorithm 3 for getting the target classifier. Algorithm3 takes two pattern sets (P1 and P2) and a list of 82 ACA. Then

315

Page 6: [IEEE 2013 International Conference on High Performance Computing & Simulation (HPCS) - Helsinki, Finland (2013.07.1-2013.07.5)] 2013 International Conference on High Performance Computing

the algorithm reports the ACA having maximum efficiency aspattern classifier.

Algorithm 3: ClassifierInput: TABLE IV – {204 ACA}, n (Size of ACA), Two patternset P1 and P2.Output: ACA with maximum efficiencyStep 1. For each ACA, A ∈ TABLE IV –{204}repeat Step 2 to Step 8.Step 2. Identify the attractors of A utilizing FPG (SectionIII-B).Step 3. Repeat Step 4 and Step 5 for each pattern p of P1 andP2.Step 4. Load A with p.Step 5. Run A until it reaches to an attractor, attr.Step 6. Suppose n1 and n2 are the number of patterns fromP1 and P2 respectively mapped into an attractor, attr

if n1 > n2, then declare the attr for P1.if n1 < n2, then declare the attr for P2.if n1 = n2, then declare attr for P1 or P2 arbitrarily.

Step 7. Repeat Step 6 for each attractor.

Step 8. Find efficiency as∑

max (n1,n2)

|P1|+|P2|.

Step 9. Report the ACA with maximum efficiency as our targetclassifier.

Algorithm 3, designs the classifier for given pattern sets.This phase is commonly referred as training. However, tounderstand the effectiveness of the designed classifier, weneed to test it with a new set of patterns. Here, we reportthe efficiencies of training phase as well as testing phase forsome data sets. For our purpose, we have taken standard andwidely studied data sets, available at http://www.ics.uci.edu/∼mlearn/MLRepository.html. Six data sets are considered forexperimentation–Monk 1, Monk 2, Monk 3, Haber-man, Tic-Tac-Toe, Spect Heart.

All the data sets taken into consideration have two classes.Two handle such real data, data sets are suitably modified to fitthe input characteristics of the proposed pattern classifier. Tocalculate the efficiency of the proposed classifier, the trainingof data sets are performed, and the ACA with maximumefficiency is reported as the proposed classifier. Then, theclassifier (that is, the ACA) is tested with different data sets tomeasure the classification efficiency. Since the cells of ACAare updated arbitrarily, classification efficiency for a singleACA rule may little change in different runs.

TABLE V shows the maximum efficiency of different ACAusing monk-1 data set obtained during training of the classifier.It shows that efficiency of a data set (in training) changes ifthe ACA changes. TABLE VI reports the performance resultof the proposed classifier using different real-life data sets.Column 1 shows the name of data set while column 2 reportsthe size of ACA. The efficiencies of the classifier duringtraining and testing are depicted in next two columns, andthe ACA, acting as the classifier is in the last column. Wefurther compare the performance of proposed classifier withothers [2], [3]. TABLE VII reports a comparative study ofefficiency of various classifier algorithms with our classifier.

The efficiency of the proposed classifier, with respective ACArule is reported in the last column.

TABLE VEFFICIENCY OF ACA DURING TRAINING OF MONK-1 DATA SET

ACA Efficiency ACA Efficiency ACA Efficiency(in %) (in %) (in %)

4 95.161 5 73.387 12 95.96713 72.580 36 84.677 44 84.67768 95.161 69 73.387 72 71.77476 99.193 77 82.258 78 69.35479 70.161 92 75.000 93 71.58094 70.967 95 70.967 100 83.064104 73.387 128 50.000 130 50.000132 50.000 133 70.161 136 50.000138 50.000 140 84.677 141 72.580144 50.000 146 50.000 152 50.000154 50.000 160 52.419 162 54.838164 87.096 166 50.000 168 51.612170 60.483 172 83.064 174 50.000176 54.838 178 61.290 180 50.000182 50.000 184 59.677 186 54.838188 50.000 190 50.000 192 50.000194 50.000 196 84.677 197 69.354200 84.677 202 76.612 203 79.032205 94.354 206 84.677 207 91.129208 50.000 210 50.000 216 79.838217 91.129 218 83.870 219 84.677220 84.677 221 91.935 222 87.903223 93.548 224 53.225 228 83.064232 85.483 234 51.612 236 91.741237 72.580 238 50.000 240 62.096242 54.838 244 50.000 246 50.000248 51.612 250 51.612 252 50.000254 50.000 - - - -

TABLE VIPERFORMANCE OF PROPOSED CLASSIFIER

Data set ACA size Efficiency in % ACA ruleTraining Testing

Monk 1 11 99.193 92.129 76Monk 2 11 97.633 91.435 76Monk 3 11 100.000 94.212 76

Haber-man 9 80.666 84.615 164Tic-Tac-Toe 18 100.000 99.432 76Spect Heart 22 100.000 100.000 76

From the results of the proposed classifier during trainingand testing (TABLE VI, TABLE VII), it is observed that theproposed classifier performs more efficiently than other well-known pattern classifiers, and always better than the traditionalsynchronous CA based classifier.

V. CONCLUSION

This paper has reported a detail characterization of asyn-chronous cellular automata having multiple fixed-point attrac-tors with the target to model this class of ACA in designingthe efficient pattern classifier. Theorem and algorithms havedesigned for the characterization of these ACA. The conceptof FPG has proposed for the counting of attractors, whichidentify the MAACA, utilized for the pattern classification.The algorithm for the design of pattern classifier has alsobeen proposed which calculates the efficiency of the classifier.

316

Page 7: [IEEE 2013 International Conference on High Performance Computing & Simulation (HPCS) - Helsinki, Finland (2013.07.1-2013.07.5)] 2013 International Conference on High Performance Computing

TABLE VIICOMPARISON OF CLASSIFICATION ACCURACY

Data set Algorithms Efficiency Efficiencyin % in % (proposed)

Monk 1 Bayesian 99.9 92.129C4.5 100 (rule 76)TCC 100

MTSC 98.65MLP 100

Traditional CA 61.111Monk 2 Bayesian 69.4 91.435

C4.5 66.2 (rule 76)TCC 78.16

MTSC 77.32MLP 75.16

Traditional CA 67.129Monk 3 Bayesian 92.12 94.212

C4.5 96.3 (rule 76)TCC 76.58

MTSC 97.17MLP 98.10

Traditional CA 80.645Haber-man Traditional CA 73.499 84.615

(rule 164)Tic-Tac-Toe Sparse grid 98.33 99.432

ASVM 70.000 (rule 76)LSVM 93.330

Traditional CA 63.159Spect Heart Traditional CA 91.978 100.000

(rule 76)

The performance of the proposed classifier has also testedwith real-life date sets and compared with some well-knownclassifier. It has been reported that, the proposed ACA basedclassifier, performs better than them, and always better thantraditional CA based classifier.

REFERENCES

[1] P Pal Chaudhuri, D Roy Chowdhury, S Nandi, and S Chatterjee.Additive Cellular Automata – Theory and Applications, volume 1. IEEEComputer Society Press, USA, ISBN 0-8186-7717-1, 1997.

[2] Sukanta Das, Sukanya Mukherjee, Nazma Naskar, and Biplab K. Sik-dar. Characterization of single cycle ca and its application in patternclassification. Electr. Notes Theor. Comput. Sci., 252:181–203, 2009.

[3] Sukanta Das, Sukanya Mukherjee, Nazma Naskar, and Biplab K. Sikdar.Modeling single length cycle nonlinear cellular automata for patternrecognition. In NaBIC, pages 198–203, 2009.

[4] Nazim Fates, Eric Thierry, Michel Morvan, and Nicolas Schabanel.Fully asynchronous behavior of double-quiescent elementary cellularautomata. Theor. Comput. Sci., 362(1-3):1–16, 2006.

[5] N. Ganguly, A. Das, P. Maji, B. K. Sikdar, and P P. Chaudhuri. Evolutionof cellular automata based associative memory for pattern recognition.High Performance Computing, Hyderabad, India, 2001.

[6] N. Ganguly, P. Maji, B. K. Sikdar, and P Pal Chaudhuri. Design ofa Cellular Automata Based Pattern Classifier. Transaction on PatternAnalysis and Machine Intelligence, TPAMI, (116429), 2002.

[7] Niloy Ganguly. Cellular Automata Evolution : Theory and Applicationsin Pattern Recognition and Classification. PhD thesis, Bengal Engineer-ing College (a Deemed University), India, 2004.

[8] Pradipta Maji. Cellular Automata Evolution for Pattern Recognition.PhD thesis, Jadavpur University, Kolkata, India, 2005.

[9] Anindita Sarkar, Anindita Mukherjee, and Sukanta Das. Reversibilityin asynchronous cellular automata. Complex Systems, 21(1):71–84,June,2012.

[10] Tomoaki Suzuko. Searching for pattern-forming asynchronous cellularautomata-an evolutionary approach. In Proceedings of InternationalConference on Cellular Automata for Research and Industry, ACRI,Greece, pages 151–160. Springer, 2004.

[11] Tomoaki Suzuko. Spatial pattern formation in asynchronous cellularautomata with mass conservation. Elsevier,Physica A: Statistical Me-chanics and its Applications, 343:185–200, November 2004.

[12] John von Neumann. The theory of self-reproducing Automata, A. W.Burks ed. Univ. of Illinois Press, Urbana and London, 1966.

[13] S. Wolfram. Theory and applications of cellular automata. WorldScientific, Singapore, 1986. ISBN 9971-50-124-4 pbk.

[14] Andrew Wuensche and Mike Lesser. The Global Dynamics of CellularAutomata, volume Reference Vol 1 of Santa Fe Institute Studies in theSciences of Complexity. Addison-Wesley, 1992. IBSN 0-201-55740-1.

317