Which of the following is NOT true about African Americans during the Civil War?