Rao-blackwellized estimates for the multivariate bayesian inference
Küçük Resim Yok
Tarih
2009
Yazarlar
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
Maltepe Üniversitesi
Erişim Hakkı
CC0 1.0 Universal
info:eu-repo/semantics/openAccess
info:eu-repo/semantics/openAccess
Özet
In Bayesian inference the summary statistics of the parameter estimates are generally chosen as the mean and standard deviation of the posterior distribution after the burn-in period. If we know the conditional distribution of each parameter cj (j = 1, . . . , r) given other parameters ck (k 6= j), the mean of the estimates can be improved via Raoblackwellization estimator which is the conditional probability of cj averaged over the conditional probability of ck’s via E(cj ) = 1 n Pn k=1 E(cj |? (k) ?j ). Here ?(k) denotes the r-dimensional parameter vector ? = (c1, . . . , cr) at the kth iteration after the burn-in period, thereby ?(k) ?j states all the components of ?(k) except for cj . Finally n represents the number of samples chosen from the conditional posterior distribution of the parameter after burn-in. From empirical results, it is shown that due to the consequence of the Rao-blackwell theorem, the given equation above typically gives better estimate than the mean of the posterior distribution of cj in terms of accuracy. In Rao-blackwellization where the direct computation of ? component is not possible, whereas the full conditional distribution of cj is known, the sampler for cj can be generated via Gibbs sampling from the MCMC outputs (Gelfand and Smith, 1990; Boys et al., 2000). On the other hand if the conditional distribution of ? is unknown, hereby Gibbs is not applicable, an ?-neighbourhood of ? is defined in such a way that a sufficiently small sphere with radius ? can cover n samples of cj (Tanner and Wong, 1987). Although this idea works for small set of variables, it is difficult to find such an ?-radial sphere for high dimensional multivariate estimation unless we reduce the dimension of ?. For calculating a Rao-blackwellized estimate for the model parameters in which the Gibbs and ?-neighbourhood techniques cannot be plausible, we propose an alternative solution in such a way that the unknown normalizing constant of the transition probability from the full conditional distribution of parameters is calculated by numerical integration. By using the available MCMC results, we approximate a specific normalizing constant for each cj considering the possible interval of ? without reducing any dimension. Then these findings are combined with the computations of the conditional distribution of ? which are updated by either Gibbs or Metropolis-Hasting algorithms. To evaluate the performance of our approach, we implement it to estimate the Rao-blackwellized estimates of model parameters of a large biological network where the known methods cannot be utilized.
Açıklama
Anahtar Kelimeler
Rao-blackwellization, Bayesian inference, Multivariate diffusion approximation
Kaynak
International Conference of Mathematical Sciences
WoS Q Değeri
Scopus Q Değeri
Cilt
Sayı
Künye
Purutçuoğlu, V. ve Wit, E. (2009). Rao-blackwellized estimates for the multivariate bayesian inference. Maltepe Üniversitesi. s. 380.
