Incorporating Discriminator in Sentence Generation: a Gibbs Sampling Method
نویسندگان
چکیده
Generating plausible and fluent sentence with desired properties has long been a challenge. Most of the recent works use recurrent neural networks (RNNs) and their variants to predict following words given previous sequence and target label. In this paper, we propose a novel framework to generate constrained sentences via Gibbs Sampling. The candidate sentences are revised and updated iteratively, with sampled new words replacing old ones. Our experiments show the effectiveness of the proposed method to generate plausible and diverse sentences.
منابع مشابه
Gibbs Sampling in Probabilistic Description Logics with Deterministic Dependencies
In many applications there is interest in representing both probabilistic and deterministic dependencies. This is especially the case in applications using Description Logics (DLs), where ontology engineering usually is based on strict knowledge, while there is also the need to represent uncertainty. We introduce a Markovian style of probabilistic reasoning in first-order logic known as Markov ...
متن کاملFast Collocation-Based Bayesian HMM Word Alignment
We present a new Bayesian HMM word alignment model for statistical machine translation. The model is a mixture of an alignment model and a language model. The alignment component is a Bayesian extension of the standard HMM. The language model component is responsible for the generation of words needed for source fluency reasons from source language context. This allows for untranslatable source...
متن کاملBayesian Models for Sentence-Level Subjectivity Detection
This paper proposes subjLDA for sentence-level subjectivity detection by modifying the latent Dirichlet allocation (LDA) model through adding an additional layer to model sentence-level subjectivity labels. A variant, called joint-subjLDA, has also been described. The model inference and parameter estimation algorithms, and Gibbs sampling procedure are presented.
متن کاملBayesian parameter estimation in dynamic population model via particle Markov chain Monte Carlo
In nature, population dynamics are subject to multiple sources of stochasticity. State-space models (SSMs) provide an ideal framework for incorporating both environmental noises and measurement errors into dynamic population models. In this paper, we present a recently developed method, Particle Markov Chain Monte Carlo (Particle MCMC), for parameter estimation in nonlinear SSMs. We use one eff...
متن کاملUsing Prior Probabilities and Density Estimation for Relational Classification
A Bayesian method for incorporating probabilistic background knowledge into ILP is presented. Positive only learning is extended to allow density estimation. Estimated densities and deened prior are combined in Bayes theorem to perform relational classiication. An initial application of the technique is made to part-of-speech (POS) tagging. A novel use of Gibbs sampling for POS tagging is given.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1802.08970 شماره
صفحات -
تاریخ انتشار 2018