Perhaps Greg “The Peeper” Neal simply misspoke here and meant to say that you shouldn’t let small-minded and petty people bring you down. Even if that’s what he meant, however, I think his phrasing inadvertently reveals a dismissive attitude that most fundy pastors work a lot harder to conceal.
It’s surprising, really, since concealing things (albeit mostly in the changing room) seems to be a skill set that Greg has worked very hard to master.