With whole life, there is a cash value build up.
A loan reduces the death benefit and possibly the cash value, but that depends on how it is structured.
I'm a fan of whole life insurance. When you realize what you got (and know how to structure it in addition to realizing what you have), you can become your own private bank exiting from the current banking paradigm that is occurring for most people.