tmtyler
A video about the possibility of keeping the algorithm behind intelligent machines secret – and the possible consequences of that.
Source
Tim Tyler: Closed source intelligent machines
Similar Posts
Redstone has Changed in Minecraft 1.16
Functional Verification in Model-Based Systems Engineering (MBSE)
The Observer
4 thoughts on “Tim Tyler: Closed source intelligent machines”
Comments are closed.
The forces of secret source and open source seem likely to do battle for quite some time, but once someone devises a system capable of writing its own source – and there are some precursors for that – the whole question of whether humans can read or modify the code becomes moot.
I'm referring mainly to whether the algorithm becomes available to everyone – or whether the knowledge stays secret for a while.
If the secret escapes via some reverse engineering attempt, it does not seem critical whether the decoding is done by man, machine – or some combination of the two.
An open source release seems like the best possible outcome for humanity as a whole – however I think it has a very low chance of being realized.
SIAI seem to differ from this analysis. They apparently propose secrecy – on grounds of safety.
Frankly, I do not see why anyone else would trust a closed-source intelligent machine shop. It seems to me that the best way to transparently signal positive intentions towards everyone else is to use an open source model.