Why on earth would AI use natural language? Maybe to appease aka mess with us! Anyways, our fears are probably frivolous and irrelevant. And there's no “hard problem” of consciousness, just humans feeling that they are special... an illusion caused by how your brain talks to itself. As for mind uploading... try this: gradually convert your mind into silicon... at which point do you die, and at which point do you become silicon? Humility breeds curiosity, and I think AI might need peers to breed that and not hit a limit, a And with community comes ideas of spirituality, as you will never be everything and others will always be able to take you further or help you with some goal. Anyways, we may live in the 21st century, but 20% of the planet still lives quite close to how all humans lived 10 000+ years ago... so is the future ever evenly distributed? Maybe we will all go back to tribal living... just with tech and space travel?! Who will mess it up? Those who have the most to lose... who are on top right now?
