We recently migrated from RDS to Iceberg and the savings have been mind-blowing. That said, it's like a deconstructed database and everything you took for granted is now on the outside. Sometimes it's cool, like instead of a Cron inside the database you have a cloud Cron on the outside which is more natively monitor able. Some of it sucks like write contention on inserts so you need a write coordinator lock, and external vacuums.
However, the savings are extreme. Better cost per byte stored. Better compression. Less table bloat.
The universal compatibility has not materialised yet. We are still waiting for duckdb and click house predicate pushdown but if that appears we will be able to have specialized query engines over a generic storage layer which would be amazing. Tools like Nimtable underline what compatability unlocks.