The downside. Yes, there is a downside to dating black men. There are serious barriers that could prevent you from finding a black man of your dreams. Dating black men barriers part one: disapproval. As we’ve said before, it’s not 1947, so dating black men will not likely get you threatened or incarcerated.