Usually, cat owners find that to be true... and non-cat people scratch their heads and don't get the fascination.
Cats don't have "pack" mentality like dogs do, so they tend to take people on a case-by-case basis - they decide if they like or respect you, and there's not much you can do to change their minds.
Whereas a dog accepts correction, or even punishment, from an "alpha" readily, cats do not. They can harbor grudges, pick fights, and even become downright hateful if handled the same way a dog is handled. A cat doesn't need a dominant force in its life to give it guidance - and any such attempt is usually met with extreme resistance. Positive reinforcement, however, typically works wonders.
For them, affection comes from a genuine desire to be friendly, not from a desire to please or obey. As someone who has treated - and owned - both cats and dogs for decades, I can honestly say that the relationship a cat has with its owner can be just as loving and loyal as that with a dog... IF the cat and the person are the right match.