Abstract; Personal and professional relationships between people take a wide variety of forms, with many including both socially and legally enforced powers, responsibilities, and protections. Artificial intelligence (AI) systems are increasingly supplementing, or even replacing, people in such roles including as advisors, assistants, and (soon) doctors, lawyers, and therapists. Yet it can be quite unclear to what degree they are bound by the same sorts of responsibilities. Much has been written about fairness, accountability, and transparency in the context of AI use and trust. But largely missing from this conversation is the concept of “AI loyalty”: for whom does an AI system work? AI systems are often created by corporations or other organizations, and may be operated by an intermediary party, such as a government agency or business, but the end-users are often distinct individuals. This leads to potential conflict between the interests of the users and those of the creators or intermediaries, and, problematically, to AI systems that appear to act purely in users’ interest even when they are not. Here, we investigate the concept of “loyalty” both in human and AI systems, and advocate its central consideration in AI design. Systems for which high loyalty is appropriate should be designed, from the outset, to primarily and transparently benefit their end users, or at minimum transparently communicate unavoidable conflict-of-interest tradeoffs. This chapter discusses both market and social advantages of high-loyalty AI systems, and potential governance frameworks in which AI loyalty can be encouraged and—in appropriate contexts—required.
