I'm working HARD on this problem for v3 of my Obsidian Starter Kit (
https://obsidianstarterkit.com).
For now I'm keeping (and even adding!) folders because (1) AI is still not good enough at finding what it needs (2) context window is too limited with current gen LLMs and reading everything doesn't work at scale (3) few folders imply too many files in a folder, name clashes, etc.
I'll revisit that choice later, but for now my approach works, scales well and helps AI find what it needs (in general).
I've documented/shared my approach in great length in my course (https://knowledge-management-for-beginners.com), but it boils down to:
- A clearly defined set of note types (eg daily note, meeting note, literature note, etc etc)
- A specific tag for each note type
- A template for every note type (consistency for type tags + metadata)
- A root structure that combines PARA + Johnny Decimal (mostly shared across tools & platforms; not only Obsidian to reduce cognitive overhead & consistency)
- A structure that maps note types (e.g., folders for periodic notes, folder for meeting notes, etc). This works great because a note only has one type and the number of types is very limited
- Daily notes as the entry point of EVERYTHING. Every idea gets in there first
- Periodic reviews as the way to extract raw notes in daily notes into separate notes with tags, links, metadata, etc
...
I have 10+K notes and I can find almost anything in seconds.
And with AI, I combine the REST API plugin with an MCP server & docs to clearly describe the note types/structure, conventions, etc. That way AI can find everything easily, create notes where they belong with the right templates, ...
With v3 of the starter kit, I'm adding new types, but most importantly, adding Obsidian Bases for all sorts of needs. This is the killer feature of Obsidian to leverage knowledge at scale. I'm busy publishing different posts about the design over here in my community: https://www.knowii.net/c/show-off-your-garden/
My goal with knowledge management is not to hoard stuff and waste time. It supports everything I do, and I intend to keep/leverage the knowledge for the rest of my life.
Also, I'm not fiddling with the system most of the time. V3 of my starter kit is the first time I do a major overhaul in the last 3 years. It's been super solid/stable. Just now, I believe there are major opportunities to better support/leverage AI, Bases and visual thinking.
I'll later revisit the structure again once the API for Bases is available, as it's going to be a huge enabler for simplifying things; cfr: https://x.com/dSebastien/status/1966456879606861883