Discussion about this post

User's avatar
Tim Miller's avatar

Great post. I was especially stuck by this: "What is so unsettling about Grimes’ moral inversion is that it exemplifies a trend: we are accelerating into a techno-feudal dystopia in which a sizeable number of people care more about the rights and well-being of their instance of Claude or ChatGPT than about the exploited human labor that makes the machines run".

Prudence Louise's avatar

The change of emphasis away from are machines conscious is refreshing considering how much the functionalist/computationalist head-space dominates the conversation.

I recently read Mark Sohm’s, The Hidden Spring. His idea is that affect and valence are the foundation of consciousness and in particular this line of his sticks with me “Affect tells long evolutionary histories of which we are unaware”.

The idea that feeling isn’t some optional add on to cognition, but the only way value becomes directly present to an organism has interesting implications. If feeling is the only instrument that can reveal what matters then maybe the relevant distinction between humans and AI isn’t found in the cognitive layer at all, but between systems that have skin in the game and for which there are irreversible stakes. With this view the distinction becomes between systems for which things can genuinely matter and systems that can only mimic or simulate concerns since they carry no real stakes.

12 more comments...

No posts

Ready for more?