Cosleuth
This is a genuinely interesting document: the Claude chat transcript underpinning a software developer’s recent discovery of a very serious malware attack.
It’s interesting to notice that, even as these tools become ubiquitous, it’s relatively rare to read through someone else’s interactions at length.
A couple of stray thoughts:
-
Having a place to say “something feels weird … can you help me figure this out?” at any time feels deeply useful, particularly for the “somethings” that feel itchy but not yet important —
that you wouldn’t present to another person for fear of wasting their time. This is an expression of the most powerful property of these systems, which is not their intelligence but their patience. -
Notice that the developer has to really prod Claude to keep going, insisting something is amiss! These systems ain’t magic, and their centroid-seeking urges lead them towards “it’s probably nothing” too easily. Not that anybody wants an AI agent that freaks out about every stray log entry … it’s a hard problem! Again though: ain’t magic.