I can't comment @jimmij 's answer, because I have less than 50 rep, but I would like to explain what worked for me on bashin Bash.
If you run
$ man ls | grep color
you will see all the entries of the man-page for your specific shell environment (in our case bash).
For me the following adjustment did the trick:
$ alias ls='ls -G'