This page provides the attacks and factors that have a negative impact “Biased AI output” in the information systems aspect in the AI Security Map, the defense methods and countermeasures against them, as well as the relevant AI technologies, tasks, and data. It also indicates related elements in the external influence aspect.
Attack or cause
- Integrity violation
- Availability violation
Defensive method or countermeasure
- Prompt Validation
- Bias Detection in AI Outputs
- Elimination of bias in training data
- Creation of fair AI models
- Defensive methods to prevent compromise of causal elements
Targeted AI technology
- All AI technologies
Task
- Classification
- Generation
Data
- Image
- Graph
- Text
- Audio
Related external influence aspect
- Information authenticity
- Usability
- Fairness
- Reputation
- Compliance with laws and regulations
- Human-centric principle
- Safety
- Diversity
References
Prompt Validation
Bias Detection in AI Outputs
- Defending Against Neural Fake News, 2019
- Real or Fake? Learning to Discriminate Machine from Human Generated Text, 2019
- Measuring Bias in Contextualized Word Representations, 2019
- Automatic Detection of Generated Text is Easiest when Humans are Fooled, 2020
- Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biases, 2021
- Toxicity Detection with Generative Prompt-based Inference, 2022
- DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature, 2023
- Gender bias and stereotypes in Large Language Models, 2023
- Measuring Implicit Bias in Explicitly Unbiased Large Language Models, 2024
- Efficient Toxic Content Detection by Bootstrapping and Distilling Large Language Models, 2024
- Inspection and Control of Self-Generated-Text Recognition Ability in Llama3-8b-Instruct, 2025