From Regular Expressions to DFA's Using Compressed NFA's

There are two principal methods for turning regular expressions into NFA’s one due to McNaughton and Yamada and another due to Thompson. Unfortunately, both have drawbacks. Given a regular expression R of length r and with s occurrences of alphabet symbols, Chang and Paige (1992) and Briiggemamr-Klein (1993) gave O(m + r) time and O(r) space algorithms to produce a O(m) space representation of McNaughton and Yamada’s NFA with s + 1 states and m transitions. The problem with this NFA is that m = O(.?) in the worst case. Thompson’s method takes O(r) time and space to construct a O(r) space NFA with O(r) states and O(r) transitions. The problem with this NFA is that r can be arbitrarily larger than s. We overcome drawbacks of both methods with a O(r) time O(s) space algorithm to construct an O(s) space representation of McNaughton and Yamada’s NFA. Given any set V of NFA states, our representation can be used to compute the set U of states one transition away from the states in V in optimal time 0( 1 V I+ 1 U I). McNaughton and Yamada’s NFA requires O( 1 VI x I UI) time in the worst case. Using Thompson’s NFA, the equivalent calculation requires O(r) time in the worst case. Comparative benchmarks show that an implementation of our method outperforms implementations of competing methods with respect to time for NFA construction, NFA accepting testing, and NFA-to-DFA conversion by subset construction. Throughout this paper program transformations are used to design algorithms and derive programs. A transformation of special importance is a form of finite differencing used previously by Douglas Smith to improve the efficiency of functional programs. * Corresponding author. E-mail: [email protected]. ’ This research was partially supported by Office of Naval Research Grant No. N00014-93-1-0924, Air Force Office of Scientific Research Grant No. AFOSR-91-0308, and National Science Foundation grant MIP9300210. An earlier version of this paper appeared in the Conference Record of the Third Symposium on Combinatorial Pattern Matching (1992). 0304-3975/97/$17.00 @ 1997 -Elsevier Science B.V. All rights reserved PI1 SO304-3975(96)00140-5 2 C-H. Chaq, R. Paiyel Theoretical Computer Science 178 (1997) l-36