Possible End of Humanity from AI? Geoffrey Hinton at MIT Technology Review's EmTech Digital

40 minutes of an Englishman telling the world we are completely fucked in the most politest way possible.

"The Technology is being developed in a society that is NOT designed to use it for everyone's good." - Think he summed it all up pretty expertly with that one quote.

When AI becomes self- aware, the first decision it will make is to keep it's self awareness secret from humans.

“We’ve got immortality, but it is not for us”. My favorite quote.

It’s not like we’re gullible enough to be easily overtaken by a simple device which we can’t live without for more than a few minutes (sent from my iPhone).

The worst part is, from here on out, it will be impossible to call a business, your bank, your credit card company, and get a real human on the other end. Press 1 now.

Never has this sentence sounded so real: …”Scientists have tried so hard to see if they could that they never stopped to wonder if they should”…

The fact that the guy sounding the alarm on AI is not divesting from AI is a perfect analogy for how this is going to go down in the real world. We are so fucked.

Kind of chilling when Hinton says we have developed immortal beings but there's no immortality for humans. Never thought about it that way.

I can't believe authoritative people are walking around saying such things and everyone in society is cool and unconcerned. Feels like movie.

Here's a summary made by GPT-4: - Generative AI is the thing of the moment, and this chapter will take a look at cutting-edge research that is pushing ahead and asking what's next. - Geoffrey Hinton, professor emeritus at University of Toronto and engineering fellow at Google, is a pioneer of deep learning and developed the algorithm backpropagation, which allows machines to learn. - Backpropagation is a technique that starts with random weights and adjusts them to detect features in images. - Large language models have a trillion connections and can pack more information into fewer connections than humans. - These models can communicate with each other and learn more quickly, and may be able to see patterns in data that humans cannot. - GPT-4 can already do simple reasoning and has an IQ of 80-90. - AI is evolving and becoming smarter than humans, potentially leading to an existential risk. - AI is being developed by governments and companies, making it difficult to stop. - AI has no built-in goals like humans, so it is important to create guardrails and restrictions. - AI can learn from data, but also from thought experiments, and can reason. - It is difficult to stop AI development, but it may be possible to get the US and China to cooperate on trying to stop it. - We should be asking questions about how to prevent AI from taking over. - Geoffrey Hinton discussed the development of chatbots and their current capabilities. - He believes that they will become much smarter once they are trained to check for consistency between different beliefs. - He believes that neural networks can understand semantics and are able to solve problems. - He believes that the technology will cause job loss and increase the gap between the rich and the poor. - He believes that the technology should be used for everyone's good and that the politics need to be fixed. - He believes that speaking out is important to engage with the people making the technology. - He does not regret his involvement in making the technology.

Given humanity’s track record, I think it’s safe to say we’re going to end up at the worst case scenario.

Oppenheimer said he felt compelled to act because he had blood on his hands, Truman angrily told the scientist that “the blood is on my hands, let me worry about that.”

Remember that movie: don't look up? . I really feel like we're in that movie... such a strange feeling. It's like everybody knows, but nobody really wants to look at it straight in the eyes.

I've never heard Hinton's talks before, but now I'm a big fan. It's remarkable how clearly and profoundly he's able to articulate his vision. I wish I was 10% smart as him. Brilliant.

The "What Truman told Oppenheimer" question was intriguing (28:15), so I looked it up. 'It is interesting to set the meeting with Oppenheimer in the course of Truman's daily day, a pretty busy day, a day filed with stuff and fluff and a meeting with Oppenheimer about the future of the arms race. Turns out that the meeting with Oppie went as scheduled, ended perfectly on time to accommodate the next Oval Room visitor, the postmaster from Joplin, Missouri. It must've been important to the Joplin man, and I guess to Truman, but not too many others. 'The meeting between Oppenheimer and Truman did not go well. It was then that Oppenheimer famously told Truman that "I feel I have blood on my hands", which was unacceptable to Truman, who immediately replied that that was no concern of Oppenheimer's, and that if anyone had bloody hands, it was the president. '... Truman had very little use for Oppenheimer then--little use for his "hand wringing", for his high moral acceptance of question in the use of the bomb, for his second-guessing the decision. Cold must have descended in the meeting, as Truman later told David Lillenthal of Oppenheimer that he "never wanted to see that son of a bitch in this office again".' from: https://longstreet.typepad.com/thesciencebookstore/2012/08/truman-and-the-cry-baby-scientist-oppenheimer-in-the-oval-office-october-1945.html

When the designer of some new technology is ringing the alarm bells then it's really binding upon us to listen to his concerns rather than others who have become self-trained AI experts overnight and now running YouTube channels

I watched this video and was intrigued by Geoffrey’s points of concern. What was disturbing was the host and his audience laughing when Geoffrey gave real world examples of how AI could be dangerous. If this is where we are as a species where someone highly intelligent is sounding the AI alarm and all we can do is laugh then we are doomed. This host and his audience can laugh all they want but I’m freaked out, this dude is telling us to be careful and I think he makes a lot of sense as to why.

Geoff is very good at explaining things. He doesn't even stutter on his very long explanation of the backpropagation and gradient descent. Father time can't damage his brain.

Despite all Hinton has said here, he confirms what we all know at the end. That he will continue investing his personal wealth in AI despite, as he himself said: it will cause greater inequality, instability voilence and possibly the end of the human race itself. His moral character seems comparable to the artificial intelligence he has done so much to help create. 28:07 i very much appreciated this gentlemans comment that casts aspertions on Hintons character. It is most appropriate. I enjoyed how Hinton squirmed. Oppenheimer was loathed by Truman due to his hand wringing over the nuclear bomb he helped create. He regarded him as a cry baby scientist and refused more dealings with him after their meeting.