As St. John Henry Newman put it:
"Contemplate the objects of this people's praise, survey their standards, ponder their ideas and judgments, and then tell me whether it is not most evident, from their very notion of the desirable and the excellent, that greatness, and goodness, and sanctity, and sublimity, and truth are unknown to them; and that they not only do not pursue, but do not even admire, those high attributes of the Divine Nature. This is what I am insisting on, not what they actually do or what they are, but what they revere, what they adore, what their gods are. Their god is mammon; I do not mean to say that all seek to be wealthy, but that all bow down before wealth. Wealth is that to which the multitude of men pay an instinctive homage. They measure happiness by wealth; and by wealth they measure respectability. Numbers, I say, there are who never dream that they shall ever be rich themselves, but who still at the sight of wealth feel an involuntary reverence and awe, just as if a rich man must be a good man. They like to be noticed by some particular rich man; they like on some occasion to have spoken with him; they like to know those who know him, to be intimate with his dependants, to have entered his house, nay, to know him by sight. Not, I repeat, that it ever comes into their mind that the like wealth will one day be theirs; not that they see the wealth, for the man who has it may dress, and live, and look like other men; not that they expect to gain some benefit from it: no, theirs is a disinterested homage, it is a homage resulting from an honest, genuine, hearty admiration of wealth for its own sake, such as that pure love which holy men feel for the Maker of all; it is a homage resulting from a profound faith in wealth, from the intimate sentiment of their hearts, that, however a man may look,—poor, mean, starved, decrepit, vulgar; or again, though he may be ignorant, or diseased, or feeble-minded, though he have the character of being a tyrant or a profligate, yet, if he be rich, he differs from all others; if he be rich, he has a gift, a spell, an omnipotence;—that with wealth he may do all things."[0]
There is a reason that money specifically, and not sex or knowledge or socializing or other good things that can get out of hand, is worshiped as a god by so many.
[0] https://www.newmanreader.org/works/discourses/discourse5.htm...