Many members of minority communities fear results in Birmingham and elsewhere could lead to rise in hostile rhetoric