War Games was a computer planning planet destroying nuke attacks because it was taught to play chess and not tic tac toe. it needed to learn about pointless victory. This is a bunch of jackasses in a room buying a thinky box asking it questions and taking the answers seriously enough to go to war relieving themselves of the burden of thought and common sense. this isn’t War Games, it’s a classic Star Trek episode except Kirk never shows up to teach us that you can’t let a fucking computer program run your fucking military intelligence, because that’s INSANE. Why would you do that? you need multiple human eyes on everything going on, you can’t let a fucking language model do it for you… my god… it’s children doing their homework with AI, except their homework is the apparatus that used to enforce the rule of law on a global scale. granted, that was always a lie as it’s more the gun that enforced colonial interests, but still. a gun that decides it need to start shooting random people who could win a war against us depending on the lines drawn and the time frame is a pretty dangerous thing to let go.
you’re assigning human traits to a computer program that is a language model that’s not actually meeting the standards of artificial intelligence, it’s a reward based system, you say ‘what is the best build for a raiper weapon in Dark Souls’, and it looks up faqs and spits out the language it expects you’re looking for. it doesn’t think and if it finds 12 joke posts on reddit saying something totally contradictory to how anyone would play the game, then it will give you the joke advice with no sense that that’s terrible. if the military is asking it how to deal with their rival military is going to look at those key words and gather language to repeat back and if that language it find is biased, prejudice, hostile, incredibly out of date, well, it’s not Intelligence, it doesn’t think or understand anything, it’s finding language, it’s giving you that language back. and if it’s looking at military documents to find that language, it’s going to see bias and prejudice and hostility and a desire to engage in war for profit and it’s going to regurgitate that back to them. it’s horrifying the military is allowing a language model that’s repeatedly been proven to magnify existing bias and prejudice if finds when looking for an answer is being allowed to process anything and is anywhere near the decision making process.