سند علمی

3-Way Composition of Weighted Finite-State Transducers

چکیده

Composition of weighted transducers is a fundamental algorithm used in many applications, including for computing complex edit-distances between automata, or string kernels in machine learning, or to combine different components of a speech recognition, speech synthesis, or information extraction system. We present a generalization of the composition of weighted transducers, 3-way composition, which is dramatically faster in practice than the standard composition algorithm when combining more than two transducers. The worst-case complexity of our algorithm for composing three transducers T1, T2, and T3 resulting in T , is O(|T |Q min(d(T1)d(T3), d(T2))+ |T |E), where | · |Q denotes the number of states, | · |E the number of transitions, and d(·) the maximum out-degree. As in regular composition, the use of perfect hashing requires a pre-processing step with linear-time expected complexity in the size of the input transducers. In many cases, this approach significantly improves on the complexity of standard composition. Our algorithm also leads to a dramatically faster composition in practice. Furthermore, standard composition can be obtained as a special case of our algorithm. We report the results of several experiments demonstrating this improvement. These theoretical and empirical improvements significantly enhance performance in the applications already mentioned.

اسناد مشابه

  • N-Way Composition of Weighted Finite-State Transducers

    سند علمی۲۰۰۹Int. J. Found. Comput. Sci.Cyril Allauzen, Mehryar Mohri

    Composition of weighted transducers is a fundamental algorithm used in many applications, including for computing complex edit-distances between automata, or string kernels in machine learning, or to combine different components of a speech recognition, speech synthesis, or infor

  • A generalized composition algorithm for weighted finite-state transducers

    سند علمی۲۰۰۹INTERSPEECHCyril Allauzen, Michael Riley, Johan Schalkwyk

    This paper describes a weighted finite-state transducer composition algorithm that generalizes the concept of the composition filter and presents filters that remove useless epsilon paths and push forward labels and weights along epsilon paths. This filtering permits the composti

  • Filters for Efficient Composition of Weighted Finite-State Transducers

    سند علمی۲۰۱۰CIAACyril Allauzen, Michael Riley, Johan Schalkwyk

    This paper describes a weighted finite-state transducer composition algorithm that generalizes the concept of the composition filter and presents various filters that process epsilon transitions, lookahead along paths, and push forward labels along epsilon paths. These filters, e

  • Fast on-the-fly composition for weighted finite-state transducers in 1.8 million-word vocabulary continuous speech recognition

    سند علمی۲۰۰۴INTERSPEECHTakaaki Hori, Chiori Hori, Yasuhiro Minami

    This paper proposes a new on-the-fly composition algorithm for Weighted Finite-State Transducers (WFSTs) in large-vocabulary continuous-speech recognition. In general on-the-fly composition, two transducers are composed during decoding, and a Viterbi search is performed based on

  • A New Epsilon Filter for Efficient Composition of Weighted Finite-State Transducers

    سند علمی۲۰۱۱INTERSPEECHFrank Duckhorn, Matthias Wolff, Rüdiger Hoffmann

    In this paper we propose a new composition algorithm for weighted finite-states transducers that are more and more used for speech and pattern recognition applications. Composition joins multiple transducers into one. We have implemented an embedded speech based dialog system for

  • Compilation of Weighted Finite-State Transducers from Decision Trees

    سند علمی۱۹۹۶ACLRichard Sproat, Michael Riley

    We report on a method for compiling decision trees into weighted finite-state transducers. The key assumptions are that the tree predictions specify how to rewrite symbols from an input string, and the decision at each tree node is stateable in terms of regular expressions on the