Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 3169

Associated Incidents

Incident 5521 Report
Bing Chat Solved CAPTCHAs with Image Analysis Feature Despite Safeguards

Loading...
Tweet: @sayashk
twitter.com · 2023

I'd heard that GPT-4's image analysis feature wasn't available to the public because it could be used to break Captcha.

Turns out it's true: The new Bing can break captcha, despite saying it won't:

Getting many comments about whether this is a new capability, so to clarify: solving such CAPTCHAs using ML has been possible for at least two decades.

For example, this NeurIPS paper described techniques to solve similar text-based CAPTCHAs… in 2004:

https://proceedings.neurips.cc/paper_files/paper/2004/file/283085d30e10513624c8cece7993f4de-Paper.pdf

The trick to making CAPTCHA useful is to keep re-inventing tasks once earlier methods have been broken.

The figure shows how long it took to break various CAPTCHA schemes (in red) and which ones still haven't been broken (green):

(Image from: https://dl.acm.org/doi/pdf/10.1145/3477142)

Update: Image analysis on Bing is no longer available. (screenshots show yesterday vs. today)

Either MS disabled the rollout entirely.

Or they specifically removed my access. This would suck, because they are actively disincentivizing people from finding issues!

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd