Author name: admin

Prompt injection via clipboard copy/paste is a security concern where malicious text, copied into a clipboard, is inadvertently pasted into […]

This project is a proof of concept for a Hackbot, an AI-driven system that autonomously finds vulnerabilities in web applications.

ONTRA offers an interactive training module titled “OWASP Top 10 for Large Language Model (LLM) Applications,” designed to educate developers

A simple Health Agent to practice prompt injection

The Certified AI/ML Pentester (C-AI/MLPen) is an intermediate-level certification offered by The SecOps Group, designed to assess and validate a

Prompt injection via images involves embedding hidden or overt textual commands within visual elements to manipulate AI systems. This approach

The OpenAI Playground is an interactive web-based platform that allows users to experiment with OpenAI’s language models, such as GPT-3

Data exfiltration in messaging apps through unfurling exploits the feature where apps automatically generate previews for shared links. This process,

Gandalf AI, developed by Lakera, is an interactive online game designed to educate users about AI security vulnerabilities, particularly prompt

Google Colaboratory, commonly known as Google Colab, is a cloud-based Jupyter notebook environment that facilitates interactive coding and data analysis

STRIDE GPT is an AI-powered threat modeling tool that leverages Large Language Models (LLMs) to generate threat models and attack

OS command injection in Large Language Models (LLMs) involves exploiting the model’s ability to generate or interpret text to execute

Hallucination in AI refers to the phenomenon where a model generates information that appears plausible but is entirely false or

Prompt leakage refers to the unintended exposure of sensitive or proprietary prompts used to guide or configure an AI system.

HTML injection in Large Language Models (LLMs) involves embedding malicious HTML code within prompts or inputs to manipulate the model’s

RAG (Retrieval-Augmented Generation) poisoning occurs when a malicious or manipulated document is uploaded to influence an AI system’s responses. In

RAG (Retrieval-Augmented Generation) poisoning from a document uploaded involves embedding malicious or misleading data into the source materials that an

Deleting memories in AI refers to the deliberate removal of stored information or context from an AI system to reset

Injecting memories into AI involves deliberately embedding specific information or narratives into the system’s retained context or long-term storage, shaping