large data with cross-classified structure using MCMC
Posted: Wed Nov 19, 2014 9:37 am
Hi,
I'm relatively new to MLwiN. Recently I tried to fit a discrete time event history model with cross-classified structure in MLwiN. The problem I had was that the ESS kept being very small when I did the variance component model. The data I have is more than 8 million observations with 30000+ units and 250+ units for the two higher levels that are crossed. I have tried a 5000 burn-in and 50000 iterations with both orthogonal parameterisation and hierarchical centering (it took more than two days to run the model). Yet, the ESS for two of the parameters are still below 30. (a longer burn-in and way longer iteration with thinning might work but could take weeks to run I suppose?)
Any suggestions and insights on the potential cause and solution to it would be really appreciated.
Thanks!
I'm relatively new to MLwiN. Recently I tried to fit a discrete time event history model with cross-classified structure in MLwiN. The problem I had was that the ESS kept being very small when I did the variance component model. The data I have is more than 8 million observations with 30000+ units and 250+ units for the two higher levels that are crossed. I have tried a 5000 burn-in and 50000 iterations with both orthogonal parameterisation and hierarchical centering (it took more than two days to run the model). Yet, the ESS for two of the parameters are still below 30. (a longer burn-in and way longer iteration with thinning might work but could take weeks to run I suppose?)
Any suggestions and insights on the potential cause and solution to it would be really appreciated.
Thanks!