During the Civil War, Southern slaves who escaped to Union lines came to be called “contrabands.” The term was first used by General Benjamin Butler, who refused to return escaped slaves to Confederate slaveholders because he deemed them “contraband of war.”