There are lots of people that want to take put a pause a super AI. Instead here is a thought experiment on how we use a Super AI (a powerful super-intelligence that is autonomous and can self learn) for human flourishing.
— Accept we are no longer the Apex predator. This will take a big mental and psychological shift for most people.
— Accept that the incentive is for an arms race to build, control and live underneath the most powerful AGI (the cat is out of the bag here, we cannot slow it down. Ai safety and alignment is just political smoke cover. Unless it is ‘winner take all’ there will be likely competing government and corporate super AGI’s chatting and trading with each other.
THIS BRINGS US TO THE CORE ISSUE OF WHO OWNS THEM — WHO DO WE TRUST.
— We will need competing databases ie pool all of our personal data on AGIs we collectively trust to look after our own interests
— We will need public AI that will negotiate on our behalf — thknk like labour our credit unions. It will look after our collective interests.
— We will need apersonal AGI will be our better self — it will lift us up the ladder of consciousness and help us make the most of our time. Think of it like a super coach and protector. It has access to all our information, can predict how we will act in certain situations and help us make the right decisions.
— We will need a personal AI enshrined in the constitution — digital rights as human rights.