Determinism for the same prompt means you can’t give it context through a conversation, which vastly shrinks its utility.
That said, even that form of determinism can be unreliable: the example of arithmetic still works; you could have it completely deterministic, but if it only performs correctly on 80% of arithmetic problems, it’s still unreliable.
Determinism for the same prompt means you can’t give it context through a conversation, which vastly shrinks its utility.
That said, even that form of determinism can be unreliable: the example of arithmetic still works; you could have it completely deterministic, but if it only performs correctly on 80% of arithmetic problems, it’s still unreliable.