Why do some people make the claim Lincoln was racist for wanting to return the?

In his writings, Abe Lincoln refer ed to the black man as "*******", and said that he found the black man to be both "intellectually and socially inferior to the white man." If that's not racist, what is? Further, he didn't want to send the freed slaves back from whence they came, he wanted to load them on ships and sail them off to some south seas island where they could start their own country.