Visual agnosia may also occur in association with other underlying disorders (secondary visual agnosia) such as Alzheimer's disease, agenesis of the corpus callosum, MELAS, and other diseases that result in progressive dementia. Disorders that may precede the development of primary visual agnosia (and may be useful in identifying an underlying cause of some forms of this disorder) include Alzheimer's disease, Pick's disease, and a rare disorder called Balint's syndrome.

Some researchers separate visual agnosia into two broad categories: apperceptive agnosia and associative agnosia. Apperceptive agnosia refers to individuals who cannot properly process what they see, meaning they have difficult identifying shapes or differentiating between different objects (visual stimuli). Affected individuals may not be able to recognize that pictures of the same object from different angles are of the same object. Affected individuals may be unable to copy (e.g., draw a picture) of an object. Associative agnosia refers to people who cannot match an object with their memory. They can accurately describe an object and even draw a picture of the object, but are unable to state what the object is or is used for. However, if told verbally what the object is, an affected individual will be able to describe what it is used for.

In some cases, individuals with primary visual agnosia cannot identify familiar people (prosopagnosia). They can see the person clearly and can describe the person (e.g., hair and eye color), but cannot identify the person by name. People with prosopagnosia may identify people by touch, smell, speech, or the way that they walk (gait). In some rare cases, affected individuals cannot recognize their own face.

Some people have a form of primary visual agnosia associated with the loss of the ability to identify their surroundings (loss of environmental familiarity agnosia). Symptoms include the inability to recognize familiar places or buildings. Affected individuals may be able to describe a familiar environment from memory and point to it on a map.

Simultanagnosia is a characterized by the inability to read and the inability to view one's surroundings as a whole. The affected individual can see parts of the surrounding scene, but not the whole. There is an inability to comprehend more than one part of a visual scene at a time or to coordinate the parts.

In rare cases, people with primary visual agnosia may not be able to recognize or point to various parts of the body (autotopagnosia). Symptoms may also include loss of the ability to distinguish left from right.

A variety of psychophysical tests can be conducted to pinpoint the nature of the visual process that is disrupted in an individual. Brain damage that causes visual agnosia may be identified through imaging techniques, including computed tomography (CT scan) and magnetic resonance imaging (MRI).