Penn Jillette: 'Making My House Child-Friendly Was Impossible'

"In a more traditional community, there would be another 15 kids from their school," he tells PEOPLE of his plans to move