Download - CHAPTER 8
![Page 1: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/1.jpg)
CHAPTER 8 1
CHAPTER 8
HASHING
All the programs in this file are selected fromEllis Horowitz, Sartaj Sahni, and Susan Anderson-Freed“Fundamentals of Data Structures in C”,Computer Science Press, 1992.
![Page 2: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/2.jpg)
CHAPTER 8 2
Symbol Table
DefinitionA set of name-attribute pairs
Operations– Determine if a particular name is in the table– Retrieve the attributes of the name– Modify the attributes of that name– Insert a new name and its attributes– Delete a name and its attributes
![Page 3: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/3.jpg)
CHAPTER 8 3
The ADT of Symbol TableStructure SymbolTable(SymTab) is objects: a set of name-attribute pairs, where the names are unique functions: for all name belongs to Name, attr belongs to Attribute, symtab belongs to SymbolTabl
e, max_size belongs to integer SymTab Create(max_size) ::= create the empty symbol table whose maximum
capacity is max_size Boolean IsIn(symtab, name) ::= if (name is in symtab) return TRUE
else return FALSE Attribute Find(symtab, name) ::= if (name is in symtab) return the corresponding
attribute else return null attribute SymTab Insert(symtal, name, attr) ::= if (name is in symtab)
replace its existing attribute with attr else insert the pair (name, attr) into symtab
SymTab Delete(symtab, name) ::= if (name is not in symtab) return else delete (name, attr) from symtab
search, insertion, deletion
![Page 4: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/4.jpg)
CHAPTER 8 4
Search vs. Hashing
Search tree methods: key comparisons hashing methods: hash functions types
– statistic hashing– dynamic hashing
![Page 5: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/5.jpg)
CHAPTER 8 5
Static Hashing
. . .
. . ... ... ... .
. . .
012..
b-2b-1
1 2 ………. s
hash table (ht) f(x): 0 … (b-1)
s slots
b buckets
![Page 6: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/6.jpg)
CHAPTER 8 6
Identifier Density and Loading Density
The identifier density of a hash table is the ratio n/T– n is the number of identifiers in the table– T is possible identifiers
The loading density or loading factor of a hash table is = n/(sb)– s is the number of slots– b is the number of buckets
![Page 7: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/7.jpg)
CHAPTER 8 7
Synonyms
Since the number of buckets b is usually several orders of magnitude lower than T, the hash function f must map several different identifiers into the same bucket
Two identifiers, i and j are synonyms with respect to f if f(i) = f(j)
![Page 8: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/8.jpg)
CHAPTER 8 8
Overflow and Collision
An overflow occurs when we hash a new identifier into a full bucket
A collision occurs when we hash two non-identical identifiers into the same bucket
![Page 9: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/9.jpg)
CHAPTER 8 9
Example Slot 0 Slot 1
0 acos atan12 char ceil3 define4 exp5 float floor6…25
b=26, s=2, n=10, =10/52=0.19, f(x)=the first char of xx: acos, define, float, exp, char, atan, ceil, floor, clock, ctimef(x):0, 3, 5, 4, 2, 0, 2, 5, 2, 2
synonyms
synonyms:char, ceil, clock, ctime
overflowsynonyms
![Page 10: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/10.jpg)
CHAPTER 8 10
Hashing Functions
Two requirements– easy computation– minimal number of collisions
mid-square (middle of square)
division
)()( 2xmiddlexf m
Mxxf D %)( (0 ~ (M-1))
Avoid the choice of M that leads to many collisions
![Page 11: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/11.jpg)
CHAPTER 8 11
M = 2i fD(X) depends on LSBs of XExample.(1) Each character is represented by six bits.(2) Identifiers are right-justified and zero-filled.
000000A1 = … 000001011100000000B1 = … 000010011100000000C1 = … 00001101110000000X41 = … 01100001110000NTXY1 = … 011000011001011100
3 4Zero-filled fD(X) shift right i bits
M=2i, i 6
Similarly, AXY, BXY, WTXY (M=2i, i 12) have the same bucket address
A program tends to have variables with the same suffix,M=2i is not suitable
![Page 12: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/12.jpg)
CHAPTER 8 12
(3) Identifiers are left-justified and zero-filled.60-bit word
fD(one-char id) = 0, M=2i, i 54fD(two-char id) = 0, M=2i, i 48
![Page 13: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/13.jpg)
CHAPTER 8 13
Programs in which many variables are permutations of each other.
Example. X=X1X2 Y=X2X1 X1 --> C(X1) X2 --> C(X2) Each character is represented by six bits X: C(X1) * 26 + C(X2) Y: C(X2) * 26 + C(X1) (fD(X) - fD(Y)) % P (where P is a prime number) = C(X1) * 26 % P + C(X2) % P - C(X2) * 26 % P- C(X1) % P
P = 3 64 % 3 * C(X1) % 3 + C(X2) % 3 -
64 % 3 * C(X2) % 3- C(X1) % 3 = C(X1) % 3 + C(X2) % 3 - C(X2) % 3- C(X1) % 3 = 0
P = 7? M is a prime number such that M does not divide rka for small k and a (Knuth)
for example, M = 1009
![Page 14: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/14.jpg)
CHAPTER 8 14
Hashing Functions
Folding– Partition the identifier x into several parts– All parts except for the last one have the same length– Add the parts together to obtain the hash address– Two possibilities
• Shift folding– x1=123, x2=203, x3=241, x4=112, x5=20, address=699
• Folding at the boundaries– x1=123, x2=203, x3=241, x4=112, x5=20, address=897
![Page 15: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/15.jpg)
CHAPTER 8 15
P1 P2 P3 P4 P5
123 203 241 112 20
shift folding 123
203
241
11220
699folding at
the boundaries
MSD ---> LSDLSD <--- MSD
123 203 241 112 20
![Page 16: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/16.jpg)
CHAPTER 8 16
Digital Analysis
All the identifiers are known in advanceM=1~999X1 d11 d12 … d1n
X2 d21 d22 … d2n
…Xm dm1 dm2 … dmn
Select 3 digits from nCriterion:Delete the digits having the most skewed distributions
![Page 17: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/17.jpg)
CHAPTER 8 17
Overflow Handling
Linear Open Addressing (linear probing) Quadratic probing Chaining
![Page 18: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/18.jpg)
CHAPTER 8 18
Data Structure for Hash Table
#define MAX_CHAR 10#define TABLE_SIZE 13typedef struct { char key[MAX_CHAR]; /* other fields */} element;element hash_table[TABLE_SIZE];
![Page 19: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/19.jpg)
CHAPTER 8 19
Hash Algorithm via Divisionvoid init_table(element ht[]){ int i; for (i=0; i<TABLE_SIZE; i++) ht[i].key[0]=NULL;}
int transform(char *key){ int number=0; while (*key) number += *key++; return number;}
int hash(char *key){ return (transform(key) % TABLE_SIZE);}
![Page 20: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/20.jpg)
CHAPTER 8 20
Example
Identifier Additive Transform x Hashfordowhileifelsefunction
102+111+114100+111119+104+105+108+101105+102101+108+115+101102+117+110+99+116+105+111+110
327211537207425870
234
129
12
![Page 21: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/21.jpg)
CHAPTER 8 21
Linear Probing(linear open addressing)
Compute f(x) for identifier x Examine the buckets
ht[(f(x)+j)%TABLE_SIZE] 0 j TABLE_SIZE– The bucket contains x.– The bucket contains the empty string– The bucket contains a nonempty string other than x– Return to ht[f(x)]
![Page 22: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/22.jpg)
CHAPTER 8 22
Linear Probingvoid linear_insert(element item, element ht[]){ int i, hash_value; I = hash_value = hash(item.key); while(strlen(ht[i].key)) { if (!strcmp(ht[i].key, item.key)) fprintf(stderr, “Duplicate entry\n”); exit(1); } i = (i+1)%TABLE_SIZE; if (i == hash_value) { fprintf(stderr, “The table is full\n”); exit(1); } } ht[i] = item;}
![Page 23: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/23.jpg)
CHAPTER 8 23
Problem of Linear Probing
Identifiers tend to cluster together Adjacent cluster tend to coalesce Increase the search time
![Page 24: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/24.jpg)
CHAPTER 8 24
Coalesce Phenomenonbucket x bucket searched bucket x bucket searched
0 acos 1 1 atoi 22 char 1 3 define 14 exp 1 5 ceil 46 cos 5 7 float 38 atol 9 9 floor 510 ctime 9 …… 25
Average number of buckets examined is 41/11=3.73
![Page 25: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/25.jpg)
CHAPTER 8 25
Quadratic Probing
Linear probing searches buckets (f(x)+i)%b Quadratic probing uses a quadratic function
of i as the increment Examine buckets f(x), (f(x)+i )%b, (f(x)-i )
%b, for 1<=i<=(b-1)/2 b is a prime number of the form 4j+3, j is an
integer
![Page 26: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/26.jpg)
CHAPTER 8 26
rehashing
Try f1, f2, …, fm in sequence if collision occurs
disadvantage– comparison of identifiers with different hash
values– use chain to resolve collisions
![Page 27: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/27.jpg)
CHAPTER 8 27
Data Structure for Chaining
#define MAX_CHAR 10#define TABLE_SIZE 13#define IS_FULL(ptr) (!(ptr))typedef struct { char key[MAX_CHAR]; /* other fields */} element;typedef struct list *list_pointer;typedef struct list { element item; list_pointer link;};list_pointer hash_table[TABLE_SIZE];
![Page 28: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/28.jpg)
CHAPTER 8 28
Chain Insertvoid chain_insert(element item, list_pointer ht[]){ int hash_value = hash(item.key); list_pointer ptr, trail=NULL, lead=ht[hash_value]; for (; lead; trail=lead, lead=lead->link) if (!strcmp(lead->item.key, item.key)) { fprintf(stderr, “The key is in the table\n”); exit(1); }
ptr = (list_pointer) malloc(sizeof(list)); if (IS_FULL(ptr)) { fprintf(stderr, “The memory is full\n”); exit(1); } ptr->item = item; ptr->link = NULL; if (trail) trail->link = ptr; else ht[hash_value] = ptr;}
![Page 29: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/29.jpg)
CHAPTER 8 29
Results of Hash Chaining
[0] -> acos -> atoi -> atol[1] -> NULL[2] -> char -> ceil -> cos -> ctime[3] -> define[4] -> exp[5] -> float -> floor[6] -> NULL…[25] -> NULL
acos, atoi, char, define, exp, ceil, cos, float, atol, floor, ctimef(x)=first character of x
# of key comparisons=21/11=1.91
![Page 30: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/30.jpg)
CHAPTER 8 30
=n/b .50 .75 .90 .95hashing function chain/open chain/open chain/open chain/open
mid square 1.26/1.73 1.40/9.75 1.45/37.14 1.47/37.53division 1.19/4.52 1.31/7.20 1.38/22.42 1.41/25.79shift fold 1.33/21.75 1.48/65.10 1.40/77.01 1.51/118.57
Bound fold 1.39/22.97 1.57/48.70 1.55/69.63 1.51/97.56digit analysis 1.35/4.55 1.49/30.62 1.52/89.20 1.52/125.59
theoretical 1.25/1.50 1.37/2.50 1.45/5.50 1.48/10.50
![Page 31: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/31.jpg)
CHAPTER 8 31
dynamic hashing(extensible hashing)
dynamically increasing and decreasing file size
concepts– file: a collection of records– record: a key + data, stored in pages (buckets)– space utilization
tyPageCapacigesNumberOfPacordNumberOf
*Re
![Page 32: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/32.jpg)
CHAPTER 8 32
*Figure 8.8:Some identifiers requiring 3 bits per character(p.414)
Identifiers Binary representaiton
a0a1b0b1c0c1c2c3
100 000100 001101 000101 001110 000110 001110 010110 011
Dynamic Hashing Using Directories
Example. m(# of pages)=4, P(page capacity)=2
00, 01, 10, 11
allocation:lower ordertwo bitsfrom LSB
to MSB
![Page 33: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/33.jpg)
CHAPTER 8 33
*Figure 8.9: A trie to hole identifiers(p.415)
a0,b0
c2
a1,b1
c3
a0,b0
c2
c3
a1,b1
c5
a0,b0
c2
c3c5
a1,c1
b1
(a) two level trie on four pages (b) inserting c5 with overflow
(c) inserting c1 with overflow
0
0
1
1 0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
+c5
+c1
Note: time to accessa page: # of bits to distinguish the identifiersNote: identifiers skewed:depth of tree skewed
![Page 34: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/34.jpg)
CHAPTER 8 34
Extendiable Hashingf(x)=a set of binary digits --> table lookup
local depthglobal depth: 4
page pointer
{0000,1000,0100,1100}
{0001}{0010,1010,0110,1110}{0011,1011,0111,1111}
{0101,1101}
{1001}
2
422
3
4
pages c & d: buddies
{000,100}
{001}{010,110}{011,111}
{101}
a0,b0
c2
a1,b1
c3
0
0
1
1 0
1 a0,b0
c2
c3
a1,b1
c5
0
1
0
1
0
1
0
1
+c1
![Page 35: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/35.jpg)
CHAPTER 8 35
If keys do not uniformly divide up among pages, then thedirectory can glow quite large, but most of entries will pointto the same page
f: a family of hashing functionshashi: key --> {0 .. 2i-1} 1 i dhash(key, i): produce random number of i bits from identifier key
hashi is hashi-1 with either a zero or one appeared as the new leading bit of result 100 000 100 001 101 000
hash(a0,2)=00 hash(a1,4)=0001 hash(b0,2)=00 101 001 110 001 110 010
hash(b1,4)=1001 hash(c1, 4)=0001 hash(c2, 2)=10 110 011 110 101
hash(c3,2)=11 hash(c5,3)=101
![Page 36: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/36.jpg)
CHAPTER 8 36
*Program 8.5: Dynamic hashing (p.421)
#include <stdio.h>#include <alloc.h>#include <stdlib.h>#define WORD_SIZE 5 /* max number of directory bits */#define PAGE_SIZE 10 /* max size of a page */#define DIRECTORY_SIZE 32 /* max size of directory */typedef struct page *paddr;typedef struct page { int local_depth; /* page level */ char *name[PAGE_SIZE]; int num_idents; /* #of identifiers in page */ };typedef struct { char *key; /* pointer to string */ /*other fields */ } brecord;int global_depth; /* trie height */paddr directory[DIRECTORY_SIZE]; /* pointers to pages */
25=32
the actual identifiers
See Figure 8.10(c) global depth=4 local depth of a =2
![Page 37: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/37.jpg)
CHAPTER 8 37
paddr hash(char *, short int);paddr buddy(paddr);short int pgsearch(char *, paddr );int convert(paddr);void enter(brecord, paddr);void pgdelete(char *, paddr);paddr find(brecord, char *);void insert (brecord, char *);int size(paddr);void coalesce (paddr, paddr);void delete(brecord, char *);
paddr hash(char *key, short int precision){ /* *key is hashed using a uniform hash function, and the low precision bits are returned as the page address */ } directory subscript for directory lookup
![Page 38: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/38.jpg)
CHAPTER 8 38
paddr buddy(paddr index){ /*Take an address of a page and returns the page’s buddy, i. e., the leading bit is complemented */ }
int size(paddr ptr) { /* return the number of identifiers in the page */ } void coalesce(paddr ptr, paddr, buddy){ /*combine page ptr and its buddy into a single page */ }short int pgsearch{char *key, paddr index) { /*Search a page for a key. If found return 1 otherwise return 0 */}
buddy bn-1bn-2 … b0 bn-1bn-2 … b0
![Page 39: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/39.jpg)
CHAPTER 8 39
void convert (paddr ptr){ /* Convert a pointer to a pointer to a page to an equivalent integer */ }
void enter(brecord r, paddr ptr) { /* Insert a new record into the page pointed at by ptr */ } void pgdelete(char *key, paddr ptr) { /* remove the record with key, hey, from the page pointed to by ptr */ }
short int find (char *key, paddr *ptr){ /* return 0 if key is not found and 1 if it is. Also, return a pointer (in ptr) to the page that was searched. Assume that an empty directory has one page. */
![Page 40: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/40.jpg)
CHAPTER 8 40
paddr index;int intindex;index = hash(key, global_depth);intindex = convert(index);*ptr = directory[intindex];return pgsearch(key, ptr);}
void insert(brecord r, char *key) { paddr ptr; if find(key, &ptr) { fprintr(stderr, “ The key is already in the table.\n”); exit(1); } if (ptr-> num_idents != PAGE_SIZE) { enter(r, ptr); ptr->num_idents++; } else{ /*Split the page into two, insert the new key, and update global_depth if necessary.
![Page 41: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/41.jpg)
CHAPTER 8 41
If this causes global_depth to exceed WORD_SIZE then print an error and terminate. */ };}
void delete(brecord r, char *key){/* find and delete the record r from the file */ paddr ptr; if (!find (key, &ptr )) { fprintf(stderr, “Key is not in the table.\n”); return; /* non-fatal error */ } pgdelete(key, ptr); if (size(ptr) + size(buddy(ptr)) <= PAGE_SIZE) coalesce(ptr, buddy(ptr));}
void main(void){}
![Page 42: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/42.jpg)
CHAPTER 8 42
*Figure 8.12: A trie mapped to a directoryless, contiguous storage (p.424)
a0,b0
c2
a1,b1
c3
0
1
0
1
0
1
a0b0c2 -a1b1c3 -
00
01
10
11
Directoryless Dynamic Hashing (Linear Hashing)
continuous address space
offset of base address (cf directory scheme)
![Page 43: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/43.jpg)
CHAPTER 8 43
*Figure 8.13: An example with two insertions (p.425)
a0b0c2 -a1b1c3 -
00
01
10
11
new page
a0b0c2 -a1b1c3 - - -
000
01 10
11
100
c5
overflow page
a0b0c2 -a1b1c3 - - - - -
000
01 10
11
100
c1 c5
new page
start of expansion 2there are 4 pages
(a)
insert c5page 10 overflows
page 00 splits(b)
insert c1page 10 overflows
page 01 splits(c)
+c5
1
2 rehash & split
+c1
rehash & split
![Page 44: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/44.jpg)
CHAPTER 8 44
*Figure 8.14: During the rth phase of expansion of directoryless method (p.426)
pages already split pages not yet split pages added so far
addressed by r+1 bits addressed by r bits addressed by r+1 bits
q r
2r pages at start
suppose we are at phase r; there are 2r pages indexed by r bits
![Page 45: CHAPTER 8](https://reader035.vdocument.in/reader035/viewer/2022062518/56814655550346895db36dc0/html5/thumbnails/45.jpg)
CHAPTER 8 45
*Program 8.6:Modified hash function (p.427)
if ( hash(key,r) < q) page = hash(key, r+1); else page = hash(key, r); if needed, then follow overflow pointers;