Playful bantering or gentle flirting with someone outside of your marriage is harmless if proper boundaries remain intact, according to psychologist Michael Brickey, author of Defying Aging, and many other relationship experts. Difference of opinions even occur within a marriage.