Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> LLM's are notoriously bad at this. The noise to signal ratio is unacceptably high…

I keep seeing this statement in threads about AI, and maybe it’s just from you, but high SNR is a good thing.

See https://en.wikipedia.org/wiki/Signal-to-noise_ratio

I think the rest of your post is very valid. It’s the mental equivalent of this article https://news.ycombinator.com/item?id=47049088

 help



Except they didn't say signal-to-noise, they said noise-to-signal. And if the NSR is unacceptably high, that means the SNR is unacceptably low.

Two inverses do make a right, it seems.


Hah, you got me there! I'll try to keep the ratio flipped correctly next time ;)

I read that article recently, so the similarities might not be entirely coincidental. 'JPEG of thought' is gonna stay in my vocabulary for a while.


Hehe, yeah there's some terms that just are linguistically unintuitive.

"Skill floor" is another one. People generally interpret that one as "must be at least this tall to ride", but it actually means "amount of effort that translates to result". Something that has a high skill floor (if you write "high floor of skill" it makes more sense) means that with very little input you can gain a lot of result. Whereas a low skill floor means something behaves more linearly, where very little input only gains very little result.

Even though its just the antonym, "skill ceiling" is much more intuitive in that regard.


Are you sure about skill floor? I've only ever heard it used to describe the skill required to get into something, and skill ceiling describes the highest level of mastery. I've never heard your interpretation, and it doesn't make sense to me.

Yes, I am very sure. And it isn't that difficult to understand, it is skill input graphed against effectiveness output. A higher floor just means that with 1 skill, you are guaranteed at least X (say, 20) effectiveness output.

https://imgur.com/tOHltkx

The confusion comes from people using "skill floor" for "learning curve" instead of "effectiveness".

But this is a thing where definitions have shifted over time. Like jealousy. People use "jealousy" when they really mean "envy", but correcting someone on it will usually just get you scorn and ridicule, because like I mentioned, language is fluid.


If the skill floor is high and therefore "effectiveness" is the same for a wide range of skill levels, isn't that the same as having a high barrier to entry? It seems that any activity or game where it takes a lot of skill before you can differentiate yourself from other players would be described that way.

I've also never heard that use of "skill floor" before. The "floor/ceiling" descriptors imply min/max constraints.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: