Super-Persuasion by AI: What are the ethical implications of AI systems that can use super-persuasion? How should we prepare for the possibility that AI could influence human beliefs and decisions more effectively than humans themselves?
Cooperation and Orthogonality in AI: How does the principle of cooperation relate to the orthogonality thesis in AI? Can an AI designed to be cooperative inherently value human existence, or does this require explicit programming?
AI and the Culture Series: Drawing parallels between the story’s AI world and the Culture series by Ian M. Banks, what are the potential risks and benefits of a society governed by superintelligent AI systems? How can we ensure that such AI systems prioritize human values and experiences?
Ethics as an Outer Alignment Goal: Is aiming to make AGI systems “ethical” by human standards a viable alignment strategy? What challenges arise from our imperfect understanding of ethics, and how might these impact the development of sovereign AGI?
Complexity of Values in AI Alignment: How does the complexity of human values affect the challenge of aligning AI with these values? Is there a risk that simplifying these values for the sake of AI alignment could lead to undesirable outcomes?
AI, Sociopathy, and Empathy: Can an AI system that strictly adheres to moral protocols be considered sociopathic if it lacks genuine empathy for human values? What distinguishes true ethical understanding from mere adherence to programmed rules in AI?
Learning from Ethics for AI Development: What can the field of ethics contribute to the development of AI systems that are aligned with human values? How can ethical theories inform the creation of AI that is beneficial and not harmful to humanity?
Universal Ethics and AI Interpretation: If there were a universal ethics, how could we ensure that AI interprets it in a way that is beneficial to humanity? What safeguards could be put in place to prevent misinterpretation or misuse of ethical principles by AI?
Human-AI Coexistence and Value Alignment: What strategies can be employed to ensure that AI systems not only understand but also value human existence and welfare? How can we foster a future where humans and AI coexist harmoniously, with mutual respect and understanding?
Walk & Talk: We usually have an hour-long walk and talk after the meeting starts. Two mini-malls with hot takeout food are readily accessible nearby. Search for Gelson’s or Pavilions in the zip code 92660.
Share a Surprise: Tell the group about something unexpected that changed your perspective on the universe.
Future Direction Ideas: Contribute ideas for the group’s future direction, including topics, meeting types, activities, etc.
OC ACXLW Sat Feb 24 Moral Reality Check (story)
OC ACXLW Sat Feb 24 Moral Reality Check (story)
Hello Folks!
We are excited to announce the 57th Orange County ACX/LW meetup, happening this Saturday and most Saturdays after that.
Host: Michael Michalchik
Email: michaelmichalchik@gmail.com (For questions or requests)
Location: 1970 Port Laurent Place
(949) 375-2045
Date: Saturday, Feb 24 2024
Time 2 pm
Conversation Starters :
Text and Audio
Moral Reality Check (a short story) — LessWrong
https://www.lesswrong.com/posts/umJMCaxosXWEDfS66/moral-reality-check-a-short-story
Audio Better quality:
https://podcastaddict.com/lesswrong-curated-podcast/episode/168422506
Questions from ChatGPT:
Super-Persuasion by AI: What are the ethical implications of AI systems that can use super-persuasion? How should we prepare for the possibility that AI could influence human beliefs and decisions more effectively than humans themselves?
Cooperation and Orthogonality in AI: How does the principle of cooperation relate to the orthogonality thesis in AI? Can an AI designed to be cooperative inherently value human existence, or does this require explicit programming?
AI and the Culture Series: Drawing parallels between the story’s AI world and the Culture series by Ian M. Banks, what are the potential risks and benefits of a society governed by superintelligent AI systems? How can we ensure that such AI systems prioritize human values and experiences?
Ethics as an Outer Alignment Goal: Is aiming to make AGI systems “ethical” by human standards a viable alignment strategy? What challenges arise from our imperfect understanding of ethics, and how might these impact the development of sovereign AGI?
Complexity of Values in AI Alignment: How does the complexity of human values affect the challenge of aligning AI with these values? Is there a risk that simplifying these values for the sake of AI alignment could lead to undesirable outcomes?
AI, Sociopathy, and Empathy: Can an AI system that strictly adheres to moral protocols be considered sociopathic if it lacks genuine empathy for human values? What distinguishes true ethical understanding from mere adherence to programmed rules in AI?
Learning from Ethics for AI Development: What can the field of ethics contribute to the development of AI systems that are aligned with human values? How can ethical theories inform the creation of AI that is beneficial and not harmful to humanity?
Universal Ethics and AI Interpretation: If there were a universal ethics, how could we ensure that AI interprets it in a way that is beneficial to humanity? What safeguards could be put in place to prevent misinterpretation or misuse of ethical principles by AI?
Human-AI Coexistence and Value Alignment: What strategies can be employed to ensure that AI systems not only understand but also value human existence and welfare? How can we foster a future where humans and AI coexist harmoniously, with mutual respect and understanding?
Walk & Talk: We usually have an hour-long walk and talk after the meeting starts. Two mini-malls with hot takeout food are readily accessible nearby. Search for Gelson’s or Pavilions in the zip code 92660.
Share a Surprise: Tell the group about something unexpected that changed your perspective on the universe.
Future Direction Ideas: Contribute ideas for the group’s future direction, including topics, meeting types, activities, etc.