This is the first description of isolated prosopagnosia in a patient with primary CNS Whipple disease. Because CNS Whipple disease can lead to serious, irreversible lesions if not promptly treated, clinicians must suspect the diagnosis, treat with long-term antibiotics, and follow patients carefully to prevent recurrence.