Will a layer of pea gravel cause drainage problems in a back yard??

They won't affect your drainage situation at all. In fact, in some cases, it might help. Tell your neighbor to relax.