Superintelligent AI and the pathway to total destruction

[SINGAPORE] To those who have reaped productivity gains from large language models (LLMs), artificial intelligence (AI) seems to be a logical progression of technological advancement – the next generation of software making humans more efficient.

Yet, that is only half correct.

As a layman, I found it fascinating to learn in a new book, If Anyone Builds It, Everyone Dies by Eliezer Yudkowsky and Nate Soares, that AI is not quite software in the traditional sense of programs being hand-coded line by line, but is instead “grown”.