People are using « tokens used » as productivity metric ?! « Tokens used »?!?!? That’s like, the first time « lines of code created » gets beaten for the « worst metric of software engineering » 🫠
6
Discussion
Loading...
@romeu Measuring data centers in gigawatts is another strong contender.
@romeu @inthehands
I used to be in the datacenter business. I was saddened by the number of cabinets pulling multiple KW 24x7 but doing absolutely nothing.
I was tired of data center PUE metrics. I wanted to institute a new one:
Joy per Joule
Does your compute and storage produce joy?
1
Our whole society is rife with this: mistaking consumption for productivity
1
@inthehands @romeu @cammerman That's kind of how we measure GDP.
1
@romeu It's probably the best possible metric for how hard you're cargo culting though, so it depends on your aims.
1
@romeu A more useful and accurate analysis may be as follows: tokens used will be seen as an adoption metric, and implicitly as a loyalty metric.
1
@romeu Believing that AI is bringing about a productivity revolution, management will see AI as an opportunity yes, but primarily as a necessity, and an existential threat.
1
@romeu They will fear that unless everyone gets on board the AI juggernaut, the organization will be disrupted by new-fangled competitors who are reaping the insane productivity benefits that they have been convinced exist.
1
@romeu Hence the problem to be solved will be seen as one of adoption, and the obstacle to be overcome, the friction caused by recalcitrant, stubborn, backwards dinosaurs. And tokens used is an adoption metric, albeit one that is extremely vulnerable to Goodhart's law.
1
@romeu If you don't use any tokens, certainly it must mean that you're part of the problem and undermining the express will of management.
1
1+ more replies (not shown)
@romeu Checkmates Goodhart's law by being a terrible metric even when not measured.
@[email protected] @[email protected] "I spent more money, give me a raise!"
bonfire.mavnn.eu
News and community around mavnn.eu projects.
Automatic federation enabled