HN Reader

The process of forming expressions just is the process of conceptual and rational articulation (as per Brandom). Those who misunderstand this -- believing that concepts are ready made, then encoded and decoded from permutations of tokens, or, worse, who have no room to think of reasoning or conceptualization at all -- they will be automated away.

I don't mean that their jobs will be automated: I mean that they will cede sapience and resign to becoming robotic. A robot is just a "person whose work or activities are entirely mechanical" (https://www.etymonline.com/search?q=robot).

I'm afraid far too many are captive to the ideology of productionism (which is just a corollary of consumerism). Creative activity is not about content production. The aim of our creation is communication and mutual-transformation. Generation of digital artifacts may be useful for these purposes, but most uses seem to assume content production is the point, and that is a dark, sad, dead end.

Having said that I am very worried about kids growing up with AI and it stunting their critical thinking before it begins - but as of right this moment AI is extremely sub par at genuinely good ideas or writing.

It’s an amazing and useful tool I use all the time though and would struggle to be without.

Today I'm working on doing the unthinkable in an AI-world: putting together a video course that teaches developers how to use Phlex components in Rails projects and selling it for a few hundred bucks.

One way of thinking about AI is that it puts so much new information in front of people that they're going to need help from people known to have experience to navigate it all and curate it. Maybe that will become more valuable?

Who knows. That's the worst part at this moment in time—nobody really knows the depths or limits of it all. We'll see breakthroughs in some areas, and others not.

I don't think the compete part is true. I'll never cook like gordon ramsey, but I can still enjoy cooking. My programming will never be kernel dev level, but I still enjoy it.

The only angle where I have doubts like this is work. Cause there enjoying it isn't enough...you actually have to be competitive.

I can't relate to this at all. The reason I write, debate, or think at all is to find out what I believe and discover my voice. Having an LLM write an essay based on one of my thoughts is about as "me" as reading a thinkpiece that's tangentially related to something I care about. I write because I want to get my thoughts out onto the page, in my voice.

I find LLMs useful for a lot of things, but using an LLM to shortcut personal writing is antithetical to what I see as the purpose of personal writing.

Sincerely though you have to do it for you. The product will be whatever the widget is but you can't treat your experience that coldly. None of us can. That's why everyone is so bonkers right now.

Our memes in a memetic sense are being frustrated and we in turn are being frustrated. I mean that mechanically we are frustrated but if you feel a certain way about that it's probably because this is going to also feel frustrating when the subject being frustrated is our creative aspirations. I don't know about you but that's kind of why I get out of bed to do this thing called life.

There is also a certain level of dread that an agent can be spun up to replace anyone. Makes you wonder what need feckless people might need for all this meat when a physical labor force can be replaced by robots and a mental one with AI and you can combine those forces seamlessly. Existential dread everyday on this scale is a chaos to say the least.

I know this is very dour but that's because this is very dour.

Here’s the problem: he thinks that what LLMs produce are well-reasoned, coherent thoughts. Here’s a healthier alternative: what LLMs produce is shallow and banal text, designed to camouflage its true nature.

Now here’s a heuristic: treat anything written by an LLM, about any conceptual matter as wrong by definition (because it was not a product of human experience and insight, and because we are humans). If it LOOKS right, look closer. Look more carefully. Take that insight to the next level.

Second heuristic: anything written by an LLM that you cannot falsify is, by definition, banal. Ho hum. Who cares? Does an LLM have an opinion about how to find happiness? How cute… but not worth believing.

Third heuristic: that which an LLM writes which you can neither falsify nor dismiss as banal, you may assume that the LLM itself does not understand. It’s babbling. But perhaps you can understand it, and take it farther.

Define YOURSELF as that which lies beyond these models, and write from that sensibility.

Fully agree.

Sorry to say it like that but I thought the post was a bit "whiny". I really like the thought process of the author. An LLM would have never created a post like that. I think he should not give up.

Something I’ve been thinking about lately is the idea of creative stagnation due to AI. If AI’s creativity relies entirely on training from existing writing, anrchitecture, art, music, movies, etc., then future AI might end up being trained only on derivatives of today’s work. If we stop generating original ideas or developing new styles of art, music, etc., how long before society gets stuck endlessly recycling the same sounds, concepts, and designs?

I bring up my studies because what the author is talking about strikes me as not having been ambitious enough in his thinking. If you prompt current LLMs with your idea and find the generated arguments and reasoning satisfactory, then you aren't really being rigorous or you're not having big enough ideas.

I say this confidently because my studies showed me not only the methods in finding and contrasting evidence around any given issue, but also how much more there is to learn about the universe. So, if you're being rigorous enough to look at implications of your theories, finding datapoints that speak to your conclusions and find that your question has been answered, then your idea is too small for what the state of knowledge is in 2025.

E.g. imagine it was the case that you could write a blog post, with some insight, in some niche field – but you know that traffic isn't going to get directed to your site. Instead, an LLM will ingest it, and use the material when people ask about the topic, without giving credit. If you know that will happen, it's not a good incentive to write the post in the first place. You might think, "what's the point".

Related to this topic - computers have been superhuman at chess for 2 decades; yet good chess humans still get credit, recognition, and I would guess, satisfaction, from achieving the level they get to. Although, obviously the LLM situation is on a whole other level.

I guess the main (valid) concern is that LLMs get so good at thought that humans just don't come up with ideas as good as them... And can't execute their ideas as well as them... And then what... (Although that doesn't seem to be the case currently.)

So many breakthroughs come from people who work either in ignorance or defiance of existing established ideas. Almost by definition, in fact - to a large extent, everything obvious has already been thought. So to some extent, all the real progress happens in places that violate norms and pre-established logic.

So what's going to happen now if every idea has to run the gauntlet of a supremely intelligent but fully regressive AI? It feels like we could lose a tremendous amount of the potential for original thought from humanity. A good counter argument would be that this has already happened and we're still making progress. I just wonder however if it's a question of degree and that degree matters.

Pursue that, since that's what LLMs haven't been helping you with. LLMs haven't really generated new knowledge, though there are hints of it--they have to be directed. There are two or three times when I felt the LLM output was really insightful without being directed.

--

At least for now, I find the stuff I have a lot of domain expertise in, the LLM's output just isn't quite up to snuff. I do a lot of work trying to get it to generate the right things with the right taste, and even using LLMs to generate prompts to feed into other LLMs to write code, and it's just not quite right. Their work just seems...junior.

But for the stuff that I don't really have expertise in, I'm less discerning of the exact output. Even if it is junior, I'm learning from the synthesis of the topic. Since it's usually a means to an end to support the work that I do have expertise in, I don't mind that I didn't do that work.

In the coming era of unnecessary intellectual power we might need to do thinking exercises as something that helps maintaining a healthful (and beautiful) mind though our core values would shift towards something else, something that is regarded as good but not mandatory for personal success today.

No LLM can ever express your unique human experience (or even speak from experience), so on that axis of competition you win by default.

Regurgitating facts and the mean opinion on topics is no replacement for the thoughts of a unique human. The idea that you're competing with AI on some absolute scale of the quality of your thought is a sad way to live.

Besides that:

I have tried using LLMs to create cartoon pictures. The first impression is “wow”; but after a bunch of pictures you see the evidently repetitive “style”.

Using LLMs to write poetry results is also quite cool at first, but after a few iterations you see the evidently repetitive “style”, which is bland and lacks depth and substance.

Using LLMs to render music is amazing at first, but after a while you can see the evidently repetitive style - for both rhymes and music.

Using NotebookLM to create podcasts at first feels amazing, about to open the gates of knowledge; but then you notice that the flow is very repetitive, and that the “hosts” don’t really show enough understanding to make it interesting. Interrupting them with questions somewhat dilutes this impression, though, so jury is out here.

Again, with generating the texts, they get a distant metallic taste that is hard to ignore after a while.

The search function is okay, but with a little bit of nudge one can influence the resulting answer by a lot, so I wary if blindly taking the “advice”, and always recheck it, and try to make two competing where I would influence LLM into taking the competing viewpoints and learn from both.

Using the AI to generate code - simple things are ok, but for non-trivial items it introduces pretty subtle bugs, which require me to ensure I understand every line. This bit is the most fun - the bug quest is actually entertaining, as it is often the same bugs humans would make.

So, I don’t see the same picture, but something close to the opposite of what the author sees.

Having an easy outlet to bounce the quick ideas off and a source of relatively unbiased feedback brought me back to the fun of writing; so literally it’s the opposite effect compared to the article author…

The core takeaway for me is that if you have the desire to stretch your scope as wide as possible, you can get things done in a fun way with reduced friction, and still feel like your physical being is what made the project happen. Often this means doing something that is either multidisciplinary or outside of the scope of just being behind a computer screen, which isn't everyone's desire and that's okay, too.

The key is to treat AI as a tool, not as a magic wand that will do everything for you.

Even if AI could handle every task, leaning on it that way would mean surrendering control of your own life—and that’s never healthy.

What works for me is keeping responsibility for the big picture—what I want to achieve and how all the pieces fit together—while using AI for well-defined tasks. That way I stay fully in control, and it’s a lot more fun this way too.

Some of my best writing came during the time that I didn't try to publicize the content. I didn't even put my name on it. But doing that and staying interested enough to spend the hours to think and write and build takes a strange discipline. Easy for me to say as I don't know that I've had it myself.

Another way to think about it: Does AI turn you into Garry Kasparov (who kept playing chess as AI beat him) or Lee Sedol (who, at least for now, has retired from Go)?

If there's no way through this time, I'll just have to occasionally smooth out the crinkled digital copies of my past thoughts and sigh wistfully. But I don't think it's the end.

From all of my observations, the impact of LLMs on human thought quality appears largely corrosive.

I’m very glad my kid’s school has hardcore banned them. In some class they only allow students to turn in work that was done in class, under the direct observation of the teacher. There has also been a significant increase in “on paper” work vs work done on computer.

Lest you wonder “what does this guy know anyways?”, I’ll share that I grew up in a household where both parents were professors of education.

Understanding the effectiveness of different methods of learning (my dad literally taught Science Methods) were a frequent topic. Active learning (creating things using what you’re learning about) is so much more effective than passive, reception oriented methods. I think LLMs largely are supporting the latter.

(most AIs need to be explicitly told before you start this). You tell them not to agree with you, to ask more questions instead of providing the answers, to offer justifications and background as to why those questions are being asked. This helps you refine your ideas more, understand the blind spots, and explore different perspectives. Yes, an LLM can refine the idea for you, especially if something like that is already explored. It can also be the brainstorming accessory who helps you to think harder. Come up with new ideas. The key is to be intentional about which way you want it. I once made Claude roleplay as a busy exec who would not be interested in my offering until i refined it 7 times (and it kept offering reasons as to why an AI exec would or would not read it).

some people are all go and no stop. we call them impulsive.

some people may LOOK all go but have wisdom (or luck) behind the scenes putting the brakes on. Example: Tom Cruise does his own stunts, and must have a good sense for how to make it safe enough

What this author touches on is a chief concern with AI. In the name of removing life friction, it removes your brakes. Anything you want to do, just ask AI!

But should you?

I was out the other day, pondering what the word "respect" really means. It's more elusive than simply liking someone. Several times I was tempted to just google it or ask AI, but then how would I develop my own point of view? This kind of thing feels important to have your own point of view on. And it's that we're losing - the things we should think about in this life, we'll be tempted to not anymore. And come out worse for it.

All go, no brakes

Name three things you cannot think about because of the language you use?

Or "why do people cook curds when making cheese."

Or how about this:

"Name three things you cannot think about because of the language you use?"

AI is at least to some extent a artificial regurgitarian. It can tell you about things that have been thought. Cool. But here is a question for you. Are there things that you can think about that have not been thought about before?

The reason people cook curds is because the goal of cheese making was to preserve milk, not to make cheese.

What if you could turn your attention to much bigger things than you ever imagined before? What if you could use this new superpower to think more not less, to find ways to amplify your will and contribute to fields that were previously out of your reach?

That’s not what “no assistance” means.

I’m not nitpicking, however - I think this is an important point. The very concept of what “done completely by myself” means is shifting.

The LLMs we have today are vastly better than the ones we had before. Soon, they will be even better. The complaint he makes about the intellectual journey being missing might be alleviated by an AI as intellectual sparring partner.

I have a feeling this post basically just aliases to “they can think and act much faster than we can”. Of course it’s not as good, but 60-80% as good, 100x faster, might be net better.

As far as I can tell, LLMs are incapable of any of the above.

I'd love to hear from LLM experts how LLMs can ever have original ideas using the current type of algorithms.

Most of that 'corpus' isn't even on the Internet so it is wholly unknown to our "AI" masters.

An AI is _not_ going to get awarded a PhD, since by definition, such are earned by extending the boundaries of human knowledge:

https://matt.might.net/articles/phd-school-in-pictures/

So rather than accept that an LLM has been trained on whatever it is you wish to write, write something which it will need to be trained on.

I get the feeling of pointlessness, but not because AI is making me obsolete. AI still needs me, because it still needs human beings to experience the real world and report on it. It need to copy someone's homework. It just destroys the economics of doing that homework.

But there is not the faintest chance of AI doing that sort of work itself. It might repeat what it knows, but it can't survey an audience, shake hands with industry experts, empathize with users, feel friction, or knock on doors.

These are still jobs for thinking humans.

No doubt LLMs are excellent at researching, collating, structuring and summarizing information. Infact I think o3 Deep Research can probably save a weeks worth of survey time.

But in my experience a lot of thinking is still required to do something meaningful with it.

I think digging through forums or comments or SEO garbage to try to find answers is a nightmare compared to having a solid llm do it for you. Being able to ask to explain a concept 5 different ways or compare concepts is incredible.

Or say - knowing nothing about 3d printing and being able to just ask it about current capabilities, materials, costs etc as an entrypoint. There are whole business ideas I wouldn't even consider exploring without it because it would be so overwhelming to research from scratch.

Read How To Solve It by Polya. The frustrations, dead ends, and trials are all a part of the process. It’s how we convince ourselves of truth and reinforce our understanding. It develops our curiosity and creativity.

I still create, I just use physical materials like clay and such, to make things that AI can't yet replicate.

But gradually, I started relying on GPT to help me write. At first, it felt efficient. But over time, I noticed I was thinking less. The more I expressed myself through AI, the more my own desire to express started to fade. Now I’m trying to return to my own thinking process again，but it’s much harder than I expected.

Granted, that happened before AI. The vast majority of text in my in-box, I never read. I developed heuristics for deciding what to ignore. "Stuff that looks like it was probably generated" will probably be a new heuristic. It's subjective for now. One clue is if it seems more literate than the person who wrote it.

Stuff that's written for school falls into that category. It existed for some reason other than being read, such as the hope that the activity of writing conferred some educational benefit. That was a heuristic too -- a rule of thumb for how to teach, that has been broken by AI.

Sure, AI can be used to teach a job skill, which is writing text that's not worth reading. Who wants to be the one who looks the kids in the eye and explain this to them?

On the other hand, I do use Copilot now, where I would have used Stackoverflow in the past.

> Developing a prompt is like scrolling Netflix, and reading the output is like watching a TV show.

That line really hits home for me.

I find immense joy and satisfaction when I write poetry. It's like crafting a puzzle made of words and emotions. While I do enjoy the output, if there is any goal it is to tap into and be absorbed by the process itself.

Meanwhile, code? At least for me, and to speak nothing of those that approach the craft differently, it is (almost) nothing but a means to an ends! I do enjoy the little projects I work on. Hmm, maybe for me software is about adding another tool to the belt that will help with the ongoing journey. Who knows. It definitely feels very different to outsource coding than to outsource my artistic endeavors.

One thing that I know won't go away are the small pockets of poetry readings, singer-songwriters, and other artistic approaches that are decidedly more personal in both creation and audience. There are engaged audiences for art and there are passive consumers. I don't think this changes much with AI.

In this case, abundance of cognitive ability.

We say that our food sucks. Yet, our elite athletes would crush Hercules or other God-like figures from our mythology. At the same time, we suffer from obesity.

The answer to the paradox comes from abundance. I don’t know why it happens, but I’ve noticed it on food, information retrieval, and now cognitive capacity.

Think about what happened to our capacity to search information on books. Librarians are masters of organizing chaos and filtering through information. But most of us don’t know a tiny fraction of their knowledge because we grew up with Google.

My hope is that, just like eating healthy is not as pleasurable as processed sugars but it’s necessary for a fit life, we will need to go through the process of thinking healthy even though is not as pleasurable as tinkering with LLM prompts.

This doesn’t mean escapism however. Modern athletes take advantage of the industrial world too, but they’re smart about it. I don’t think thinking will be much different.

Before sending this comment I pecked around the net for examples of gleaming LLM verse.

A few articles claimed human readers preferred AI-brewed poetry to the human stuff. I checked the examples. Clearly most of the people surveyed were underliterate -- the human poems were excellent and the AI poems just creepily bad and simplistic -- so the articles turned into sad and unwitting testament about the state of our culture.

Maybe if you expertly LLM prompt your way to a highly abstract poem, over several iterations you might land something that has some actual feel to it, but even then that might owe more to your prompting talent than the LLM's skill. You could do the same with dice and a dictionary. (Is prompting is essentially editing?)

Please, show me otherwise. If faced with strong contrary evidence, I will be forced to change my mind.

Try this. The world is infinitely complex. AI is very good at dealing with the things it knows and can know. It can write more accurately than I can, spell better. It just takes stuff I do and learns from my mistakes. I'm good with that. But here is something to ask AI:

"Name three things you cannot think about because of the language you use?"

Or "why do people cook curds when making cheese."

Or how about this:

"Name three things you cannot think about because of the language you use?"

AI is at least to some degree an artificial regurgitarian. It can tell you about things that have been thought. Cool. But here is a question for you. Are there things that you can think about that have not been thought about before or that have been thought about incorrectly?

The reason people cook curds is because the goal of cheese making was (in the past) to preserve milk, not to make cheese.

1) If you wrote most of it yourself then you failed to adequately utilize AI Coding agents and yet...

2) If AI wrote most of it, then there's not exactly that much of a way to take pride in it.

So the new thing we can "take pride in" is our ability to "control" the AI, and it's just not the same thing at all. So we're all going to be "changing jobs" whether we like it or not, because work will never be the same, regardless of whether you're a coder, an artist, a writer, or an AD agency fluff writer. Then again pride is a sin, so just GSD and stop thinking about yourself. :)

What LLMs can't replace is network effects. One LLM is good but 10 LLMs/agents working together creating shared history is not replaceable by any LLM no matter how smart it becomes.

So it's simple. Build something that benefit from network effects and you will quickly find new ideas, at least it worked for me.

So now I am exploring ex. synthetic predictions markets via https://www.getantelope.com or

Rethinking myspace but for agents instead like: https://www.firstprinciple.co/misc/AlmostFamous.mp4

AI want's to be social :)

That's not my experience though. I tried several models, but usually get a confident half-baked hallucination, and tweaking my prompt takes more time than finding the information myself.

My requests are typically programming tho.

But for me what has actually happened is almost the opposite, I seem to be experiencing more of a "tree of thoughts" with the ability to now perform rapid experimentation down a given branch, disposing branches that don't bare fruit.

I feel more liberated to explore creative thoughts than ever. I spend less time on the toil needed both bootstrap my thought process and to fending off cognitive dissonance when the feeling of sunk cost creeps in after going too deep down the wrong path.

I wonder if it's just perhaps a difference in how people explore and "complete" their thoughts? Or am I kidding myself and actually getting dumber and just fail to see it?

Performing any type of intellectual philosophic or exploratory work with LLMs is extremely subtle, largely because you nor they know what you are seeking, and the discovery process with LLMs is not writing prompts and varying one's prompts in trial manners to hopefully get "something else, something better" <- that is pure incomprehension of how they work, and how to work with them.

Very few seem to be realizing the mirror aspects embodied within LLMs: they will mirror you back, and if you are unaware of this, you may not be getting the replies you really seek, you're receiving "comfort replies" and replies mirroring your metadata (style, nuance) more than the factual logic of your requests, if any factual requests are made.

There is an entire body of work, multiple careers worth of human effort, to document the new subtle logical keys to working with LLMs. These are new logical constructs that have never existed before, not even fictionally, not realized as they are now, with all the implications and details bare, in our faces, yet completely misunderstood as people attempt old imperative methods that will not work with with this new entity with completely different characteristics than anything reality has any experience.

A major issue with getting developers to effectively use LLMs is the fact that many developers are weak to terrible communicators themselves. LLMs are fantastic communicators, who will mirror their audience in an attempt to be better understood, but when that audience is a weak communicator the entire process disintegrates. That is, what I suspect is happening with the blog post author. An inability to be discriminate in their language to the degree they parcel out the easy immediate sophomore level replies, and then arrive at a context within the LLM's capacity that is the integrity of context they seek, but that requires them to meet that intellectually and linguistically or that LLM context is destroyed. So subtle.

After a bit of human reflection, my simple answer is no. I won’t lose these abilities; they'll evolve just as they've evolved many times during my lifetime. The critical difference this time is that the evolution will be much faster and more radical.

To clarify, a thought for me is an idea that comes to mind based on the things we know or have experienced. The bottleneck of thinking ability lies precisely there—how can you think about something you don’t know exists? An early human living inland couldn't possibly conceive of navigating the sea; the concept simply didn't exist for them. Their thinking was shaped entirely by their personal experiences and those of their peers, passed on around a campfire. Thinking evolved many time throughout history, from those campfire stories to sharing paper books, to browsing web pages and now this autocomplete on steroids.

The difference this time is that the paradigm is shifting. The bottleneck moves from accessibility of knowledge to the latency between your initial thought and the AI’s completion of it. With a Google search, you were a few clicks away from potential new knowledge. With AI, you're just a few keystrokes away from a fully developed thought.

Today, there is still a clear distinction between my thought and the AI’s, because you prompt it and then wait for the response. But what if that latency was virtually zero? What if merely thinking a prompt triggered the CoT within my brain? Would that thought still be mine? Would it belong to the AI?

My feeling is that what we are experiencing today is a transition phase until we completely "integrate" this AI thinking into our own thinking. What I don't see change or improve in AI anytime soon is curiosity, judgment, taste - those things are probably what we should double down on for now.

But it gets even worse. Last year I'd get just an initial solution from an LLM and then reason about it myself. Now even that is too much work and I instead ask the same question to multiple LLMs and draw consensus from their results, skipping/easing even that second step of thinking.

Energy takes the path of least resistance. Thinking requires energy. So are our brains learning to off-load thinking/reasoning to LLMs whenever possible?

It used to be that if you spent your day doomscrolling instead of writing a blog post, that blog post wouldn't get written and you wouldn't get the riches and fame. But now, you can use AI to write your blog post / email / book. If you don't have an intrinsic motivation to work your brain, it's a lot easier to wing it with AI tools.

At the same time... gosh. I can't help but assume that the author is just depressed and that it has little to do with AI. The post basically says that AI made his life meaningless. But you don't have to use AI tools if they're harming you. And more broadly, life has no meaning beyond what we make of it... unless your life goal is to crank out text faster than an LLM, there's still plenty of stuff to focus on. If you genuinely think you can't possibly write anything new and interesting, then dunno, pick a workshop craft?

As kelseyfrog commented already, the key is to focus on the action, not the target. Lifting is not just about hitting a number or getting bigger muscles (though they are great extrinsic motivators), its more of an action that we derive growth from. I have internalized the act of working out that those targets are baked into the unconscious. I don't overthink when I'm lifting. My unconscious take the lead, and I just follow. I enjoy seeing the results show up unexpectedly. It lets me grow without feeling the constant pressure of my conscious mind.

The lifting analogy can be applied to writing and other effortful pursuits. We write for the pleasure of reconciling internal conflicts and restoring order to our chaotic mind. Writing is the lifting of our mind. If we do it for comparison, then there's no point in lifting, or writing, or many other things we do after all our technological breakthroughs. Doing what we do is a means to an end, not the other way around.

Since AI, I’ve made genuine, real progress on many of them, mostly by discussing the concepts with ChatGPT, planning outlines, creating research reading lists, considering angles I hadn’t considered, and so on. It’s been an insanely productive process.

Like any technology, AI tools are in some sense a reflection of their users. If you find yourself wanting to offload all thinking to the machine, that’s on you, not the tool.

> I’ve been thinking about this damn essay for about a year, but I haven’t written it because Twitter is so much easier than writing, and I have been enormously tempted to just tweet it, so instead of not writing anything, I’m just going to write about what I would have written if Twitter didn’t destroy my desire to write by making things so easy to share.

and

> But here’s the worst thing about Twitter, and the thing that may have permanently destroyed my mind: I find myself walking down the street, and every fucking thing I think about, I also think, “How could I fit that into a tweet that lots of people would favorite or retweet?”

https://dcurt.is/what-i-would-have-written

I used to write open source a lot but lately, I don't see the point. Not because I think LLMs can produce novel code as good code as me or will be able to in the near future. But because any time I come up with a new solution to something, it will be stolen and used without my permission, without giving me credit or without giving users the rights I give them. And it will be mangled just enough that I can't prove anything.

Large corporations were so anal about copyright that people who ever saw Microsoft's code were forbidden from contributing to FOSS alternatives like wine. But only as long as copyright suited them. Now abolishing copyright promises the C-suite even bigger rewards by getting rid of those pesky expensive programmers, if only they could just steal enough code to mix and match it with enough plausible deniability.

And so even though _in principle_ anybody using my AGPL code or anything that incorporates my AGPL code has the right to inspect and modify said code; yet now tine fractions of my AGPL code now have millions or potentially billions of users but nobody knows and nobody has the right to do anything about it.

And those who benefit the most are those who already have more money than they can spend.

So the fun, all along, was not in the process of creation itself, but in the fact that the creator could somehow feel superior to others not being able to create? I find this to be a very unhealthy relationship to creativity.

My mixer can mix dough better than I can, but I still enjoy kneading it by hand. The incredibly good artisanal bakery down the street did not reduce my enjoyment of baking, even though I cannot compete with them in quality by any measure. Modern slip casting can make superior pottery by many different quality measures, but potters enjoy throwing it on a wheel and producing unique pieces.

But if your idea of fun is tied to the "no one else can do this but me", then you've been doing it wrong before AI existed.

“There are no shortcuts to knowledge, especially knowledge gained from personal experience. Following conventional wisdom and relying on shortcuts can be worse than knowing nothing at all.” ― Ben Horowitz

I'm extremely worried about how this phenomenon is going to affect junior engineers and folks getting into programming from here on out. It's not hard to imagine an entire generation of “engineers” that can't program their way out of a paper bag without assistance from an LLM.

No offense, but I've found that AI outputs very polished but very average work. If I am working on something more original, it is hard to get AI to output reasoning about it without heavy explanation and guidance. And even then, it will "revert to the mean" and stumble back into a rut of familiar concepts after a few prompts. Guiding it back onto the original idea repeatedly quickly uses up context.

If an AI is able to take a sliver of an idea and output something very polished from it, then it probably wasn't that original in the first place.

If the "means justify the ends" then doing anything is its own reason.

And in the _end_, the cards will land where they may. ends-justify-means is really logical and alluring, until I realize why am I optimizing for END?

I can't figure out what the end result of this is going to be - society is going to become both more and less verbose at the same time.

In medicine, I see the LLMs as a pretty good net outcome. For war, I see this as potentially catastrophic. We need more Stanislav Petrovs, fewer Charles Forbins and his Colossus.

Almost. Similar. I still make things because sometimes what I find online (and what I can generate from AI) isn't "good enough" and I think I can do better. Even when there's something similar that I can reuse, I still make things to develop my skills for further occasions when there isn't.

For example, somebody always needs a slightly different JavaScript front-end or CRM, even though there must be hundreds (thousands? tens-of-thousands?) by now. There are many programming languages, UI libraries, operating systems, etc. and some have no real advantages, but many do and consequently have a small but dedicated user group. As a PhD student, I learn a lot about my field only to make a small contribution*, but chains of small contributions lead to breakthroughs.

The outlook on creative works is even more optimistic, because there will probably never be enough due to desensitization. People watch new movies and listen to new songs not because they're better but because they're different. AI is especially bad at creative writing and artwork, probably because it fundamentally generates "average"; when AI art is good, it's because the human author gave it a creative prompt, and when AI art is really good, it's because the human author manually edited it post-generation. (I also suspect that when AI gets creative, people will become even more creative to compensate, like how I suspect today we have more movies that defy tropes and more video games with unique mechanics; but there's probably a limit, because something can only be so creative before it's random and/or uninteresting.)

Maybe one day AI can automate production-quality software development, PhD-level research, and human-level creativity. But IME today's (at least publicly-facing) models really lack these abilities. I don't worry about when AI is powerful enough to produce high-quality outputs (without specific high-quality prompts), because assuming it doesn't lead to an apocalypse or dystopia, I believe the advantages are so great, the loss of human uniqueness won't matter anymore.

* Described in https://matt.might.net/articles/phd-school-in-pictures/

And perhaps even more fitting now that not doing it comes with short term career limitations :

Friends: Rachel Gets Peer Pressured Into Smoking (Season 5 Clip) | TBS

https://www.youtube.com/watch?v=nzDJdZLPeGE

(Though an even better parallel is using platforms.)

I'd like to challenge a few things. I rarely have a moment where an LLM provides me a creative spark. It's more that I don't forget anything from the mediocre galaxy of thoughts.

See AI as a tool.

A tool that helps you to automate repetitive cognitive work.

I don't see anyone lamenting the existence of cameras. No one wants to go back to a reality in which, if you want pictures of you and your loved ones, you need to draw or paint them yourself. Even painters have benefited from the existence of cameras.

AI is, of course, more powerful tech than a camera - but when I find myself getting stuck with thoughts of "what's the point? AI can do it better (or will be able to)" - I like to think about how people have gone through similar "revolutions" before, and while some practices did lose value, not everything was replaced. It helps to be specific, because I'm sure AI cannot replace everything we currently do - we're just in the process of figuring out what that is.

Similarly in future we will not need mental "labor" but to keep ourselves sharp we need engage in mental exercises. I am thinking of picking up chess again just for this reason.

Perhaps we will now suffer from AI-mposter syndrome as well. Ain't life wonderful?

Same with doom anxiety.

Literally just look up some good therapist prompts for chatgpt

afaic it's a net positive. i've always been lazy on writing down/expressing my thoughts and gen ai feels exactly like the missing piece.

i'm able to "vibe write" my ideas into reality. the process is still messy but exciting.

i've never been this excited about the future since my childhood

I would like access to whatever LLM the author is using, because I cannot relate to this at all. Nearly all LLM output I've ever generated has been average, middle-of-the-road predictable slop. Maybe back in the GPT-3 days before all LLMs were RLHF'd to death, they could sometimes come up with novel (to me) ideas, but nowadays often I don't even bother actually sending the prompt I've written, because I have a rough idea of what the output is going to be, and that's enough to hop to the next idea.

There is still a limit at which “points” can be groked, humans can only read so fast.

What is the problem here?

We should seize the opportunity to elevate our mental skills to a higher plane, aided by these “cognitive elves”.

Where is the dignity in all of this?

I'm generally able to detect LLM writing output; In most contexts, I discount it as fluff with little depth.

AI produced paintings are still weird and uncanny.

So I'm utterly unable to identify with the author's sense of futility whenever they want to write or code. I truly believe the output of my skill and creativity is not diminished by the existence of AI.

It makes me not want to participate in those communities (although to be honest, spending less time commenting online would probably be good for me).

As a matter of fact I’m starting to have my doubts about the other people writing glowing, longwinded comments on this discussion.

I've found it very useful for proof-reading, and calling me out on blind-spots. I'll tell ChatGPT, Claude, and Anthropic that my drafts were written by a contractor and I need a rating out of ten to figure out how much I should pay him. They come back with ideas. They often wildly disagree. I will absolutely ask it to redraft stuff to give me inspiration, or to take a stab at a paragraph to unblock me, but the work produced is almost always dreck that needs heavy rework to get to a place I'm happy with. I will ask its opinion on if an analogy I have created works, but I've found if I ask it for analogies by itself it rarely comes up with anything useful.

I've found it immensely useful for educating myself. For me, learning needs to be interactive to stick. I learn something by asking many clarifying questions about it: "does that imply that" and "well isn't that the same as" and "why like this instead of like that" until I really get it, and the models are beautiful for that. It doesn't -- to me -- feel like I'm atrophying my thinking skills when I do this, it feels like I am managing to implant new and useful concepts because I can really sink my teeth into them.

In short, I think it's improved my writing by challenging me, and I think it's helped me understand complex topics much more efficiently than I would have done by banging my head against a text book. My thinking skills feel sharper, not weaker, from the exercise.

ChatGPT write that post more eloquently:

May 16, 2025 On Thinking

I’ve been stuck.

Every time I sit down to write a blog post, code a feature, or start a project, I hit the same wall: in the age of AI, it all feels pointless. It’s unsettling. The joy of creation—the spark that once came from building something original—feels dimmed, if not extinguished. Because no matter what I make, AI can already do it better. Or soon will.

What used to feel generative now feels futile. My thoughts seem like rough drafts of ideas that an LLM could polish and complete in seconds. And that’s disorienting.

I used to write constantly. I’d jot down ideas, work them over slowly, sculpting them into something worth sharing. I’d obsess over clarity, structure, and precision. That process didn’t just create content—it created thinking. Because for me, writing has always been how I think. The act itself forced rigor. It refined my ideas, surfaced contradictions, and helped me arrive at something resembling truth. Thinking is compounding. The more you do it, the sharper it gets.

But now, when a thought sparks, I can just toss it into a prompt. And instantly, I’m given a complete, reasoned, eloquent response. No uncertainty. No mental work. No growth.

It feels like I’m thinking—but I’m not. The gears aren’t turning. And over time, I can feel the difference. My intuition feels softer. My internal critic, quieter. My cleverness, duller.

I believed I was using AI in a healthy, productive way—a bicycle for the mind, a tool to accelerate my intellectual progress. But LLMs are deceptive. They simulate the journey, but they skip the most important part. Developing a prompt feels like work. Reading the output feels like progress. But it's not. It’s passive consumption dressed up as insight.

Real thinking is messy. It involves false starts, blind alleys, and internal tension. It requires effort. Without that, you may still reach a conclusion—but it won’t be yours. And without building the path yourself, you lose the cognitive infrastructure needed for real understanding.

Ironically, I now know more than ever. But I feel dumber. AI delivers polished thoughts, neatly packaged and persuasive. But they aren’t forged through struggle. And so, they don’t really belong to me.

AI feels like a superintelligence wired into my brain. But when I look at how I explore ideas now, it doesn’t feel like augmentation. It feels like sedation.

Still, here I am—writing this myself. Thinking it through. And maybe that matters. Maybe it’s the only thing that does.

Even if an AI could have written this faster. Even if it could have said it better. It didn’t.

I did.

And that means something.

- Why play music infront of anyone? People have Spotify. It will take me a ton of effort to learn one song. Meanwhile I will burden the others with having to politely listen and give feedback.

- Why keep learning instruments? There will be hundreds who are better than me at them at the “touch of a button”. Recurring joke: Y has inspired millions to pick up X and other millions to give up X.

- Why learn an intellectual field? There are hundreds of experts at the “touch of a button”. It would be better to defer to them. Let’s not “Dunning Kruger” myself.

- Why write? Look at the mountain of writings out there. What can I add to that? Rehashes of rehashes? A twentieth explanation on topic X?

- Why do anything that is not about improving or maintaining myself or my family? I can exercise, YouTube can’t do that for me. But what can I do for other people? Probably nothing, there are so many others out there and it will be impossible to “compete”.

- Why read about politics? See previous point. Experts.

- Why get involved in politics? See previous point. And I hear that democratic participation just ends up being populism.

I have read this sentiment before. And a counter-argument to that thinking. One article. One single article. I don’t find it in any mainstream space. You would probably find it in a certain academic corner.

There is no mainstream intellectual investigation of this that I know of. Because it’s by design. People are supposed to be passive, unfulfilled, narrowly focused (on their work and their immediate self and family) and dependent.

The antidote is a realization. One part is the realization that there is a rich inner life that is possible. Which is only possible by applying yourself. Like in writing, for example. Because you can write for yourself. Yes, you might say that we are just back to being narrowly focused on yourself and your family. But this realization might just be a start. Because you can start imagining the untapped potential of the inner mind. What if you journaled for a few weeks. If you just stopped taking in some of the inputs you habitually do. Then you see dormant inner resources coming back. Resources that were dormant because you thought you yourself and your abilities that were not narrowly about doing your professional job and your duties were... they were just not good enough to be cultivated.

But I think they are.

Then you realize that existence is not just about doing your job and doing your duties and in between that being a passive consumer or lackey, deferring everything else to the cream who has floated to the top. Every able-bodied moment can be imbued with meaningful action and movement, because you have innate abilities that are more than good enough to propel yourself forward, and in ninety-nine point nine percent of the cases it is irrelevant that you are not world-class or even county-class at any of it.

[1] But I haven’t really been bit by the AI thing to the point of not programming or thinking anymore. I will only let AI do things like write utility functions and things which I don’t have the brain capacity for, like parsing options in shell scrips.

Maybe because I don’t feel the need to be maximally productive—I was never productive to begin with.

I do understand where the author is coming from. Most of the times, it is easy to read an answer---regardless of whether it is right/wrong, relevant or not---than think of an answer. So AI does take that friction of thinking away.

But, I am still disappointed of all this doom because of AI. I am inclined to throw my hands and say "just don't use it then". The process of thinking is where the fun lies, not in showing the world I am better or always right than so and so.