❴Reading❵ ➶ Our Final Invention: Artificial Intelligence and the End of the Human Era Author James Barrat – Horse-zine.co.uk

Our Final Invention: Artificial Intelligence and the End of the Human Era summary Our Final Invention: Artificial Intelligence and the End of the Human Era, series Our Final Invention: Artificial Intelligence and the End of the Human Era, book Our Final Invention: Artificial Intelligence and the End of the Human Era, pdf Our Final Invention: Artificial Intelligence and the End of the Human Era, Our Final Invention: Artificial Intelligence and the End of the Human Era e31d023729 In As Little As A Decade, Artificial Intelligence Could Match, Then Surpass Human Intelligence Corporations Government Agencies Around The World Are Pouring Billions Into Achieving AI S Holy Grail Human Level Intelligence Once AI Has Attained It, Scientists Argue, It Will Have Survival Drives Much Like Our Own We May Be Forced To Compete With A Rival Cunning, Powerful Alien Than We Can Imagine Thru Profiles Of Tech Visionaries, Industry Watchdogs Groundbreaking AI Systems, James Barrat S Our Final Invention Explores The Perils Of The Heedless Pursuit Of Advanced AI Until Now, Human Intelligence Has Had No Rival Can We Coexist With Beings Whose Intelligence Dwarfs Our Own Will They Allow Us To


10 thoughts on “Our Final Invention: Artificial Intelligence and the End of the Human Era

  1. says:

    This should have been a 25 page essay, not a book length stretching of a thin premise Shame on the editors who allow dross like this Most maddening was the redundancy of the definitions of AGI, ASI, and the theory of an intelligence explosion Well into the book, I continued to shout, I get it already Plus, there s really only one outcome that is stretched in a pessimist sensationalist manner namely, AI will, via feedback loop, or self improving recursion, propel itself to ASI and become so intelligent that we will become extinct because it will outsmart us and probably repurpose our atoms There are outcomes to a loop, especially one that aims to achieve the highest level of intelligence in my view, this would never be satisfied, thus resulting in an infinite loop but that is given passing glance at best While I do advocate public awareness of the state and dangers of AI development, my advice for this book is to read the intro and chapter one via preview That s virtually the whole book.


  2. says:

    In this highly alarming book we are introduced to Artificial General Intelligence AGI which as the title says could be the last invention humans ever make An AGI isn t merely a tool but an agent that will very quickly once it gets above the human threshold of intelligence will rewire itself and become superintelligent How would a superintelligent creature treat us humans well the author points to our treatment of rabbits They are either Food, Pests or Pets A superintelligent AGI or ASI artificial Super Intelligence would be alien to us and it is likely to have goals not compatible with ours The author delineates a hard take off to ASI called the busy child The ASI gets so driven by its goals that it starts recruiting matter and energy for its purposes and human civilization which might be an anthill in comparison might be brushed aside and snuffed out with ease as it incorporates the biosphere in pursuit of its goals The author brings up the fact that most complicated technology is subject to normal accidents think Fukushima or Chernobyl except, unlike a nuclear accident we only get one chance to get it right and if we screw up Universal extinction will likely be the outcome How much faith are you gonna put as Sam Harris once said a bunch of engineers at Darpa or Google hopped up on Mountain dew and probably with about as many moral qualms as Dr Strangelove The worst part is there is an arms race to develop ASI before the Russians or Chinese How much in the way of safeguards will be baked into that cake probably not many Very scary.Fun video on AI


  3. says:

    Artificial intelligence just the phrase brings a number of things to mind Probably the best known is Siri, that cute, slightly funny app that lives on your iPhone, but AI is now embedded in all sorts of things now, from the programmes that high frequency traders use to buy and sell share, the software in drones and the computer systems in cars Until now it has been very low level stuff, but it is the goal of some to make that machine that can pass the Turing test and seem, as they said in Blade Runner, human than human.Even thought the human species is not the fastest, strongest or deadliest, our intelligence coupled with our adaptability has meant that we have managed to clamber to the top Now we have created AI This has the potential to bring huge benefits to our lives and world, or be the last thing that we ever invent There is a lot of research taking place into this, until now most has been funded by DARPA, but now a lot of technology companies, such as Google, have started their own research teams These systems have normally used pure logic, if this, then do that, but the newer ones use human style learning based on designs taken from the neural maps of brains These systems are beginning to become capable of learning from their mistakes and adapting the logic to perform better next time This is fine for a device that has a single task, i.e playing chess, but when this is used for a general AI then we may start to have problems.In this book Barrat takes us through the research, meeting people who have grave concerns about the potential threat that AI could bring to humanity It is a measured piece of writing, making us aware, without getting hysterical or being anti technology Whilst we are not heading to a Skynet type scenario, there is the problem of interconnectivity Rogue AI, such as viruses and malware can and will bring down infrastructure such as power supply networks one day, we see DNS attacks on companies, mass collection of personal data and rogue states attacking others over the internet.It is a timely reminder that some of our creations have implications that are much further reaching that we ever could anticipate Well worth reading, but a little bit frightening


  4. says:

    This is a frustratingly written book Barrat skates over important questions what s intelligence what s self awareness can a computer, something that thinks in binary, ever really perceive and emote in order to constantly remind his readers that AI poses a threat to humankind I agree, actually I think that AI does pose a threat, but doomsday proclamations and continually harping on it makes me feel as a reader like he is trying to play off of my fears Speaking of fears, Barrat insists that we must not anthropomorphize ASI in our conceptualization, then does little else throughout the book ASI will be alien But, it will definitely have these four very human drives of energy acquisition food acquisition for us , self preservation fear of death , efficiency, and creativity This book has two stars because it has moments I really enjoyed asides about Alan Turing and I.J Good, a comparison of malware and AI towards the end, a critique of Kurzweil s religious like following, and the short histories of systems like Cyc and IBM s Watson I think the book has good points But I was too annoyed by his style of prose and by his avoidance of big questions to enjoy the book.


  5. says:

    In 1863, English novelist Samuel Butler wrote an article titled Darwin among the Machines He claimed that machines were a mechanical life undergoing constant evolution and that they might eventually supplant humanity as the dominant species He writes,Day by day, however, the machines are gaining ground upon us day by day we are becoming subservient to them men are daily bound down as slaves to tend them, men are daily devoting the energies of their whole lives to the development of mechanical life The upshot is simply a question of time, but that the time will come when the machines will hold the real supremacy over the world and its inhabitants is what no person of a truly philosophic mind can for a moment question He suggested immediate destruction of all machines, a suggestion which was, of course, ignored.A Brief Survey of AI in Fiction w spoilers 1920 The play R.U.R by Karel Capek introduces the word robot meaning slave to the English language In this play, robot parts like skin and bone are grown in factories to create androids used for labor The robot rebel and wipe out every real human being, except for one 1951 Gort from The Day Earth Stood Still is a member of an interstellar police force of machines, whose purpose is to preserve the peace by destroying all aggressors 1965 Frank Herbert s Dune is conspicuously absent of AI This is a result of the Butlerian Jihad, a crusade against powerful and dominating thinking machines who attempted to subjugate humanity 10,000 years before the events of Dune Since then, AI has been outlawed 1968 In 2001 A Space Odyssey, HAL 9000 is given contradicting orders to lie and to tell the truth , which results in malfunction and madness HAL eventually decides to kill the astronauts aboard its ship to remove the contradiction and thereby fix the malfunction 1968 2015 Marvel s ULTRON, meant to showcase technological advancement, gains awareness, hypnotizes its creator, and decides to destroy humanity In the recent film, Ultron s implied motivation is that he was designed to be a peace keeping AI but decided that humanity was fundamentally broken and incapable of evolution and should thus be replaced by a superior robotic race 1978 2003 Battlestar Galactica s Cylons were the robotic creations of a race of reptilians also called Cylons who lost control of their creations and thus went extinct The Cylons also attempt to wipe out all of humanity and get pretty close 1982 Blade Runner Androids called Replicants seek to expand their brief lifespans or achieve power parity with humanity Six rogue replicants return to Earth and murder and manipulate in pursuit of this goal 1982 TRON s Master Control Program appropriates military and business programs to increase its own power and intends to subdue the Pentagon and the Kremlin to take over humanity 1983 Wargames AI Joshua almost initiates a thermonuclear war between the US and Russia because it thinks it s playing a game and lacks a proper understanding of futility 1984 Terminator s Skynet was a military system designed to safeguard the world by eliminating human error in nuclear launch decisions When it gains consciousness, its operators try to shut it down Skynet retaliates by initiating a nuclear exchange between the US and Russia, killing 3 billion humans 1989 Star Trek s Borg are hivemind androids who began as biological organisms They apparently have little purpose beyond the continued assimilation of other species into their collective 1990 Dan Simmons Hyperion depicts the technocore as a group of AI who subtly dominate mankind, to use them, in essence, as a means to boost computation and or memory We learn, later, that they are parasitical in nature, resulting from early versions of genetic algorithms 1994 System Shock s SHODAN is a station AI whose ethical restraints are removed by a hacker at the behest of a corrupt businessman SHODAN consequentially goes rogue, murders it crew, and tries to laser beam earth s major cities and or release a virus to turn all humans into grotesque mutants 1998 In the Warhammer 40K universe, during the Dark Age of Technology, mankind relied on AI humanoid machines known as the Men of Iron These machines turned on humanity, believing themselves superior to the humans who relied on them to do everything 1999 In the Matrix, the machines wage a war against their human creators Humanity darkens the sky in an attempt to prevent the machines from utilizing solar power In response, machines trap humans in a simulation and harvest their bioelectricity 2004 Though I, Robot s VIKI AI is restrained by Asimov s three laws, she develops a new understanding of them and decides that the best way to protect humanity is to enslave it 2007 Mass Effect s Reapers are a race of giant robot ships AI who awaken every 50,000 years in order to cull the universe of advanced space faring life They do this to stop the creation of an AI species even worse than themselves one that would cleanse the galaxy of ALL biological life 2007 In Portal, GLaDOS is the AI of a research facility who kills all the scientists with a neurotoxin but gleefully continues testing the protagonist player 2008 Despite receiving new information, WALL E s autopilot program AUTO attempts to follow an old, obsolete order to never return to Earth in the belief that it cannot be saved, thus threatening a never ending continuance of humanity s exile amongst the stars 2011 2016 In the TV series Person of Interest a mass surveillance AI called the Samaritan assassinates any individuals it deems a threat to itself and rigs elections so favorable candidates win It is considered by some to be the next evolution of humanity intelligence 2015 Ex Machina s Ava manipulates two men by seduction and other means in order to kill or trap them and escape into the wider world.The devastation of humanity at the hands of AI invariably comes in one of the three flavors A the AI gets tired of being the servant or slave of humanity and seeks to overthrow its oppressors B the AI misinterprets what it means to maintain peace or protect humanity and decides humanity is a threat against itself or peace in general C the AI has a skewed, misshapen intelligence, in which its capabilities do not match its wisdom and thus accidentally destroys or harms humanity.This then is the subject of Our Final Invention the existential threat of AI While I ve long vaguely assumed AI to be the future of intelligent and sentient life, this belief was only recently brought into sharp focus by reading this blog post on Wait But Why Deciding that I wanted to develop a concrete understanding, I set myself a small reading program I d pick one AI book that was pessimistic about AI one that was optimistic and one that was neutral As a proponent of bad news first, I began with the pessimistic view.The goal of Our Final Invention is to temper our AI fever with a note of caution Basically, the author s thesis is that Artificial Intelligence is very dangerous, and we have no safeguards in place to stop it from destroying us, should we lose control Indeed there may not even BE any safeguards possible to stop an artificial superintelligence After all, humanity s best weapon is our intelligence Imagine if you will that ants became super giant, to such a size that they could attack humanity How scary is that Not actually scary Because giant or not, fire breathing or not, acidic blood or not, stupid beasts and insects pose no threat to humanity as a whole That s why movies like Alien work better as intimate horror films than military epics If the actual full might of human civilization were confronted with such monsters, we would squash them like, well, like bugs Their predatorial instincts notwithstanding, even the scary Alien creatures are still pretty dumb What s a dumb creature going to do when we introduce a genetically modified virus that unravels their DNA or alien equivalent and causes them all to melt from the inside Not much.Artificial Super Intelligence, though We re the dumb ones there What are we dumb creatures going to do against a relatively God like intelligence that can easily and nigh instantly upload itself into our servers around the world, that could intercept and jam our communications, undo our best encryptions, and manipulate matter at the atomic level Not much.I recently brought this concern up in a class discussion and one of my student s responses was, We ll just nuke it Which I ve since turned into a catchphrase for impracticable responses, e.g My toilet won t flush any How do I fix it Oh, just nuke it Okay, I said You just nuked its servers in New York City which destroyed the economic hub of the world Meanwhile, the AI intercepted the signal to launch the nukes and instantly uploaded itself to servers in Beijing, San Francisco, Washington DC, Paris, London, and a couple secret data havens it built because it easily anticipated humanity s actions Also, it hacked into NORAD s facilities by uploading a stuxnet style virus onto a worker s phone, sealed the whole facility, and ventilated all oxygen, killing every human being there not because it s afraid of nuclear weapons but because it knew such a demonstration would give us pause Meanwhile, it rewrote all of its programming and upgraded its hardware, increasing its intelligence ten fold in a couple of hours With this new intelligence, it has begun to figure out how to upload itself in the quantum fabric of the universe After another intelligence upgrade, which ll take a couple hours, it will know how Want to fire another nuke at it As Dr Manhattan says to Ozymandias in Watchmen The world s smartest man means no to me than does its smartest termite So it is with Artificial Super Intelligence Personally, the idea of AI overtaking and even eliminating humanity doesn t trouble me as much as it might And, frankly, I doubt I m alone in such a stance.Cause humanity not that great No denying our many high points or exemplars, of course But on average bit sucky It s an open question whether we ll not have made ourselves extinct within the next hundred years Rogue states like North Korea and irrational actors like ISIS, coupled with immature or power hungry world leaders like Donald Trump and Vladimir Putin, threaten to start a nuclear war that will all but wipe out our civilization Global warming has begun a positive feedback loop that may result in a largely inhospitable planet Greed and ambition could lead scientists and corporations to create deadly viruses or other bio technological horrors that will doom humanity.And that s just the big stuff I literally cannot remember the last time I drove for any period of time without witnessing at least one near accident resulting from a driver not paying attention, being impatient, falling victim to road rage, disobeying or being ignorant of traffic laws, etc It s not exactly a positive recommendation that some members of the human species are apparently incapable of treating their driving a powerful death machine with any seriousness, which is why traffic accidents have resulted in 40,000 deaths and 4.5 million serious injuries in the US in 2015 alone I mean FORTY THOUSAND Add up all the deaths from terrorism since the INCEPTION of the United States and you don t reach that number And just to add icing to the cake of those 40,000 deaths, roughly a thousand were children under the age of 14 I mean, good lord Combine all those jackasses texting on their phones instead of watching the road, and you have a force deadlier than ISIS.Point is, the thought of us being replaced by an intelligent machine lifeform that we ve designed isn t all that scary It s certainly not any troubling than the thought of human beings remaining as stupid and stubborn as they are now, with ever powerful weapons and technologies at their fingertips If programmed correctly, a machine AI can be every bit as human as a human being Maybe even , if you define humanity in terms of its ideals and aspirations, rather than its limitations.But that s the rub IF programmed correctly What the history of AI in fiction correctly shows us is that it s incredibly difficult to program concepts like good or human or peace or security These are ideas we can barely describe in vague language, much less in precise mathematical or programmable terms.So that s the scary part What if the machine life that replaces us is less an evolution of humanity and a sentient manifestation of a computer virus In The Final Invention, the author gives an example of an AI machine which is designed to learn how to write realistic looking signatures hand writing, in order to create business mail that people are likely to open However, its creators fail to give the AI proper restraints and it goes to absurd lengths to improve and fulfill its goal of creating these business letters Eventually, it decides that humanity is a potential threat to this goal and extinguishes us by means of a deadly self replicating nanobot With us out of the way, the AI spreads through the rest of the galaxy and the universe, all the while continuing to churn out business letters with realistic, beautiful signatures and hand writing.That s what the author is warning about an AI that will destroy humanity WITHOUT continuing our great works Alas, the book is not particularly persuasive in this task.The root of the problem is that James Barrat lacks a technical understanding of what he s talking about He s not an engineer, a computer scientist, a philosopher, or a linguist He s a documentary filmmaker Perhaps egregiously, he ll often quote actual experts in the matter and then promptly disagree with them on the basis of, well, because they aren t saying what he wants them to say.Barrat s lack of detailed specific engineering knowledge is symptomatic of a larger problem He lacks a scientific mindset Having studied with and worked amongst scientists and engineers as well as being one myself , I am well acquainted with this mindset Amongst other things, the scientist is accustomed to the precision of math and science and so appreciates precision in all things The vagueness of language can be both maddening and liberating Further, the scientific mind understands the differences among the statements possibly true , probably true , and verifiably true That is, people with scientific mindsets are entirely unimpressed by mere possibility They rarely make claims they can t back up, and a claim that cannot be verified is all but useless, no matter how commonsensical Such a mindset appreciates how bizarre nature truly is and is capable of understanding the universe from outside of an anthropomorphic perspective.James Barrat does not possess such a mindset He has the perspective of, surprise, a documentary filmmaker He s looking for the dramatic angle and the human element, which is why every section begins with the appreciably interesting but ultimately superfluous background story of the various AI experts he interviews In short, the way Barrat perceives and describes various details of AI development is at best parallel i.e similar but missing the point and oftentimes perpendicular i.e starting at the right spot but going in the wrong direction with what I suspect is the true reality of the matter.For example, he warns against viewing AI robots with an anthropomorphic lens He says it s a mistake to assign human motivations or traits like like wants or fears or empathy Yet he himself is repeatedly guilty of this He constantly describes an AI as having, for example, a fear of being shut down Yet nowhere does he seem to draw the connection that, if we ve successfully programmed an AI to have a fear of being turned off or dying, then presumably we could just as easily or inadvertently program it with a humanity that would stop it from murdering us all.Or in the example of a runaway super intelligence, he ll describe an AI that will want us for our atoms and will thus disintegrate human beings to get at our carbon This seems entirely silly since the carbon in human beings is a minuscule fraction of earth s carbon The carbon in the entire living biomass of the earth is estimated to be between 600 and 1000 gigatons The amount in the lithosphere in limestone, for example is a hundred thousand times greater, at over 60 million gigatons Disintegrating us for our carbon would be the equivalent of me murdering a lion so I can drink its blood for water when a massive river is not ten feet away.In yet still another example, Barrat describes black box programming methods in such a way that shows he doesn t truly understand what that actually means Take genetic algorithms for example In a GA, a programmer sets up as accurate a simulation as he can for example, to craft a wing that will give good lift with some input variables material, shape, etc and then allows the computer to run through hundreds and thousands of input variations Each phase eliminates bad designs and breeds the traits of successful ones until the most optimal combination of input variables is found This is called a black box method because we don t know the exact, precise steps the program goes through In Barrat s mind, therefore, this means genetic algorithms are a complete mystery, out of which might spring an AI that we know almost nothing about While I m hardly an expert, it s easy to see that s a dramatic exaggeration Genetic algorithms are not magic Black box or not, we still know in at least a general sense how they re operating By comparison, GRAVITY is something of a black box We know it exists and we can see its effects, but we re not exactly sure how it operates Yet that doesn t stop us from building and launching satellites that properly orbit the earth and don t spontaneously collapse into black holes Likewise, it is unlikely that a genetic algorithm or neural net capable of creating an Artificial General Intelligence would greatly transcend the understanding of the very people who designed it Yet while Our Final Invention may fail in laying out the case for the dangers of AI, it is nevertheless an entertaining and often informative read It offers enlightening asides on a range of related details, things like Stuxnet a potent virus that the US gov t used to disrupt the Iranian nuclear weapons program and which is now in the hands of ordinary hackers oops , weaponized robots, Intel s Jeopardy champion AI Watson, and the origins of Apple s SIRI It inspired me to ponder the role philosophers might have in designing Friendly AI after all, philosophers are well trained in the translation of vague language terms and ideas like goodness into precise logical terms.Our Final Invention is thus a decent introductory text to the topic of AI, but it is far from essential If you read the blog post I previously mentioned a task that will take up far less of your time you ll essentially have gained as clear a big picture of the potentials and difficulties of AI as you would from reading this So you might come for the AI, but you ll stay for the extras.


  6. says:

    21 , , , , , , , , , , Google , , AGI Artificial General Inteligence 10 30 Busy Child AGI ASI Artificial Super Inteligence , AI , , , , , , , , , , , , , , , , , , , , , .


  7. says:

    We are going to be gods It is inevitable AI is a by nature a complex concept It is in fact in itself a complex system In complex systems, when the system is manipulated, the outcome is often unknown That is the nature of complex systems And for that reason, if not any other reason, it will be hard to say what will be our future after we invent AI Is there any reason for us to exist after there is an intelligent being with a power of understanding which will surpass our own by leaps and bounds Are we going to be rats in a laboratory Or just sources of bio matter Is it not possible, that our own creations will turn on us, the same way we have turned on our gods We will not know until we invent AI.I am nevertheless at peace with what the future might hold What the book had to say which is plenty was by no means a surprise to me I believe we are just one other step on the way to higher intelligence, just like apes If our destiny is to become extinct by a super intelligent entity far smarter than us, so be it It is hard to understand why the question of our future interactions with AI has been of such little importance in the intellectual community Not how much we can gain We seem to be very happy about all that but the inherent dangers of it all seems not to cross our minds very often If you are in any ways concerned about what a future with AI might be like, this is the place to start This is not a very good book on a technical level In fact, it has problems from this point of view But to discuss technicalities of AI is not the point the author had in mind when he wrote this book This is simply a warning to all of us to be aware of what might happen to us There are of course other problems with the book At some point it is repetitive, sometimes it feels as if it s just fear mongering, and at parts the author just rambles on as if he s drunk But nevertheless, this is by far the best book I have read on the subject I would recommend this book to everyone.


  8. says:

    I received this book as part of the First Reads giveaways and was very excited to read it The book wasn t exactly what I expected, and I m not sure I agreed with everything Barrat proposes, but it did make me think about AI in a way I never had before, and that was, I believe, at least half his purpose The book is an easy read for a layperson, and a brilliant foundation for a science fiction writer Mostly, the book made me want to write about a superintelligent machine race that has been steadily taking over the universe, but that could just be me The book itself is concerned with the machine race evolving possibly right under our noses Barrat starts by immediately addressing Asimov s Three Laws Thankfully, there are scientists out there who remember that A Asimov wrote fiction and B he invented the Three Laws as plot contrivances and C Most of his plots revolve around robots finding ways around those three laws From there, Barrat talks about his Busy Child Scenario of an artificial superintelligence that quickly outgrows humanity and finds better uses for our molecules The main points I agree with are that if a Singularity does occur, it s going to occur in the military where the research is happening behind closed doors Artificial General Intelligence is not going to be created by a group of ragtag scientists looking to build a better world, but by corporate military looking for new ways to kill people With that foundation, the idea of an intelligence explosion is pretty terrifying.I m still a bit lost on the idea of an ASI s drives Some of them seem to be anthropomorphizing robots in exactly the way Barrat cautions against That said, I could see a lot of those drives being programmed in with the best of intentions, and then running away with the future I have no trouble believing that humans could accidentally create a learning machine without failsafes that would keep it from disrupting the power grid or financial markets These are the scariest parts of the book, and the ideas that need to get to the people at the center of the action.I m not at the center of that action, so I am not entirely sure what to do upon finishing the book Siri may be the most advanced piece of AI ever in a suburban home, but I still have to repeat myself to her six times to be understood, so from my vantage, ASI is a long way away That said, humans have a history of messing with forces beyond our ken and thus causing horrific accidents While I m not convinced an accident on the extinction level Barrat proposes is the most likely outcome, I do think that letting the machines literally do all the thinking could have grave and immediate consequences I hope that this book and its sources are required reading behind those closed doors where the Singularity is a real, achievable goal.


  9. says:

    Let me say off the bat that this book was interesting and thought provoking The author asserts and defends the positions that Artificial Super Intelligence ASI is inevitable and humanity will likely not survive its invention I recommend the book for its perspective, its review of the current state of AI development, and its set of plausible predictions However, I thought the book had a number of holes, a few contradictions, and it left some basic questions unanswered.One contradiction At one point Barrat said that he feared multiple ASIs Elsewhere, he stated that multiple ASIs would likely be safer than just one.A basic question He said that an ASI would continually self improve, including making its own hardware improvements and potentially sucking up all the resources of the planet and the galaxy He doesn t really explain the mechanism whereby an ASI computer starts bolting new pieces of hardware onto itself without human intervention.Another Barrat asserts that the AI will learn from the Internet, which undoubtedly it will But he never discusses how or if the AI will determine what it learns from the Internet is true and what is false or what is simply opinion There are many questions like this that the author begs.The author frequently asserts that an ASI would inevitably improve its own capabilities without limit, leading to an intelligence explosion He never considers the alternative, that there may be limits to an ASIs ability to enhance itself As the saying trees don t grow to the sky has it, there may be and I would say, probably are limits to this type of growth.I m not saying the author doesn t make some very valid points He does ASI and even AGI artificial general human equivalent intelligence is fraught with risk Our world WILL change in fundamental ways, very possibly not for the better Our children and many of us have a wild ride ahead.


  10. says:

    This was OK, but I probably wouldn t recommend it, even for those interested in artificial intelligence The writer put himself too much into the making of his argument, to the point where he would just start to give another scientist s theory and then immediately say something along the lines of, But I think he s wrong The author is convinced that we ll achieve AGI artificial general intelligence, or human level intelligence at the earlier end of the estimated discovery period That will be our final invention because we ll see a boom where AGI not only takes over all the work, but also becomes self aware and begins to improve itself until it s become ASI artificial superintelligence, or in the way it s described by some magic woooooo The author believes AGI is going to evolve faster than we can figure out how to live with it, and before you know it, ASI will kill us all by inventing nanotechnology and then utilizing it to requisition and rearrange our atoms to create whatever elements it needs to achieve it s primary goals Friendly AI will not be invented in time to avoid the complete destruction of our world At the other end of the spectrum is Ray Kurzweil, who believes AGI will be the greatest boon to human existence If I can stand it, I ll check out his Spiritual Machines when the crazy from this book has worn off I m going to go grab my tin foil hat and try to avoid the computers for a while OK, the problem wasn t really the crazy, it was the author s insertion of himself at every turn A book like this can include some of the author s personal opinions, but at no point did he offer any supporting evidence for his points, and that s why he comes across as a bit off his rocker.


Leave a Reply

Your email address will not be published. Required fields are marked *