Generative AI

Created by Librarians, the ROBOT test can be used for evaluating the validity of AI tools and applications.   

Reliability

Objective

Bias

Ownership

Type

Reliability

• How reliable is the information available about the AI technology?

• If it’s not produced by the party responsible for the AI, what are the author’s credentials? Bias?

• If it is produced by the party responsible for the AI, how much information are they making available? 

  • Is information only partially available due to trade secrets?

  • How biased is they information that they produce?

Objective

• What is the goal or objective of the use of AI?

• What is the goal of sharing information about it?

  • To inform?

  • To convince?

  • To find financial support?

Bias

• What could create bias in the AI technology?

• Are there ethical issues associated with this?

• Are bias or ethical issues acknowledged?

  • By the source of information?

  • By the party responsible for the AI?

  • By its users?

Owner

• Who is the owner or developer of the AI technology?

• Who is responsible for it?

  • Is it a private company?

  • The government?

  • A think tank or research group?

• Who has access to it?

• Who can use it?

Type

• Which subtype of AI is it?

• Is the technology theoretical or applied?

• What kind of information system does it rely on?

• Does it rely on human intervention? 

Licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Hervieux, S. & Wheatley, A. (2020). The ROBOT test [Evaluation tool]. The LibrAIry. https://thelibrairy.wordpress.com/2020/03/11/the-robot-test