It's funny people say that when they're two distinct structures on her property.
I know you're not saying it's a barn, just replying to you since it's kinda continuing what you were saying :p
I like how in the MLP Movie the "you were raised in a barn" joke was worded in such a way that it didn't make her house a barn - she just spent a lot of time there. At least that's iirc.