Page 1 of 1

3 level data structure and sample size

Posted: Wed Feb 21, 2018 3:59 am
by shanekav
Hi,

We would be grateful for some input if possible.

We are dealing with a three-level nested structure – L1 - 295 people / L2 - 84 houses / L3 - 14 organisations.

Questions:

1. At level 1 the households only have small numbers of people (between 1 - 5). Are there any issues we should be aware of? We are primarily interested in predictors at the household level. Will it be possible to look at slopes across households?

2. The inclusion of a second level in the data (i.e. households) improves the deviance statistic. But, the inclusion of level 3 (organisations) leads to little change (2484 to 2480), which appears to be borderline significant (allowing 1 DF between the models). However the VPC suggests that organisational level contributes roughly 12% of the variance (output below). Can/should we include this third level? If we include it, can we include predictors at this level?

Many thanks in advance,

Shane

Capture.JPG
Capture.JPG (26.75 KiB) Viewed 6379 times

Re: 3 level data structure and sample size

Posted: Mon Feb 26, 2018 5:10 pm
by GeorgeLeckie
Hi Shane,

Probably worth pointing out that these are general multilevel modelling queries that would apply equally in any multilevel software or commands rather than being any specific to MLwiN. So do look in multilevel modelling textbooks at the sections about sample sizes at different levels.

1. You should be able to allow the slopes of individual-level predictors to vary across households as you have a healthy enough sample of households (84).

2. Adding organisation random effects only leads to a modest improvement in the deviance because there are only 14 organisations and so the organisation variance component is estimated imprecisely. Think you are going to struggle to find significant regression coefficients on any organisation-level covariates as you have such a small sample size here.

Best wishes

George

Re: 3 level data structure and sample size

Posted: Wed Mar 21, 2018 4:30 am
by shanekav
Hi George,

Many thanks for taking the time to respond.

Shane

Re: 3 level data structure and sample size

Posted: Wed Mar 28, 2018 10:40 am
by BoyceRon
Hi George, what would be the number of organization after which you could say it's significant enough to make a noticable difference?