I completely agree with Robert. I would also point out that our best questions - where best is defined as highest voted - are all interesting questions which are both accessible to laypersons and interesting for specialists to answer.
http://physics.stackexchange.com/questions?sort=voteshttps://physics.stackexchange.com/questions?sort=votes
If we want to be the reference site for physics we need to be able to communicate, we need to be able to be authoritative by the breadth, depth and quality of our answers, and not merely by limiting the topics, audience and users to some elite few who speak lingo.
In this I do think we are lacking and we could improve massively.