OVER 98% PASS RATE FOR THE NCS, PCS, OCS, AND GCS EXAMS › forums › PCS Advantage › sensitivity vs specificity
- This topic has 7 replies, 3 voices, and was last updated 2 years, 9 months ago by Helen Carey.
-
AuthorPosts
-
-
February 20, 2020 at 9:17 pm #318901Kasey MurphyParticipant
Can you give guidance on sensitivity vs specificity and sPin vs sNout?
- This topic was modified 2 years, 8 months ago by Chrissy Durrough Lugge.
-
February 22, 2020 at 5:54 pm #320333Helen CareyParticipant
Hi Kasey,
These concepts have rattled me for years! a. is the correct answer for this question: “The assessment has a high success rate of identifying gross motor delays but may also suggest that there is a gross motor delay when there is not really a delay present.”SNout: When a test has a high sensitivity, a negative result rules out the diagnosis and positive result confirms the diagnosis.
SPin: When a test has a high specificity, a positive result tends to rule in the diagnosis and negative result rules out condition.
(I actually find these very confusing, so trying looking at it from the examples below):Sensitivity (true positive rate): Likelihood that someone with the condition will be positive on the diagnostic test; refers to the percentage of children who are correctly identified as meeting criteria for a condition; VALUABLE FOR CONFIRMING DX; 80% sensitivity is preferable.
Specificity (true negative rate): Likelihood that someone who does not have the condition will be negative on the diagnostic test; refers to the percentage of children without problems who are correctly identified as such; VALUABLE TO RULE OUT THE PRESENCE OF A CONDITION; 90% is preferable for a diagnostic test.**For the TIMP, Specificity is higher, indicating that it is a good measure for detecting large numbers of high risk infants who are not developing typically (rule out GM delay) and have delayed posture and motor development, which is it’s intended purpose. Sensitivity is much lower, so it is not as sensitive for identifying (or confirming) CP.
**The AIMS has been found to be more beneficial when administered at critical age ranges. While the 5th centile cut off value is best to identify the most delayed children (and those likely to have CP) (because of high specificity and relatively high sensitivity), the 10th centile cut off is best for identification of the greatest # of infants with abnormal motor development (because of high sensitivity).There is always a “trade-off” between sensitivity and specificity: for a screening test in which early diagnosis is beneficial and when it is desirable to identify all those at risk for having a condition, high sensitivity is preferable to higher specificity.
-
February 24, 2020 at 12:33 pm #321695Kasey MurphyParticipant
Thank you.. I have to read over it multiple times, I don’t know why these terms always seem to confuse me.
When you give the example of the TIMP – Specificity is higher –Likelihood that someone who does not have the condition will be negative on the diagnostic test; refers to the percentage of children without problems who are correctly identified as such; — so with the TIMP, when looking at Specificity, we are looking at the percentage of children without the the condition who are correctly negative on the test, and ruling out a condition — so we are ruling out GM delay with the TIMP Score —
But I am still confused by the explanation of TIMP: “indicating that it is a good measure for detecting large numbers of high risk infants who are not developing typically” — this seems like sensitivity – we are are identifying infants not developing typically (those who have GM Delay)?Sorry, this topic as had me since PT school
-
February 24, 2020 at 7:41 pm #321956Helen CareyParticipant
Sensitivity focuses on a specific condition (the example I gave is CP) whereas specificity focuses on ruling out the presence of a condition (the example I gave is GM delay). A child with poor gross motor skills will very likely score below average on the TIMP and be correctly identified as being delayed, however, we won’t be able to necessarily determine if the low performance is due to CP or another condition affecting GM development. A test with high sensitivity is best when your focus is identifying CP, not just GM delay.
My brain wants to switch the concepts since I tend to think of “specificity” as identifying a specific condition (being “specific” about a condition), when it is actually the opposite.
Hope this helps!
Helen -
February 24, 2020 at 8:28 pm #321964Kasey MurphyParticipant
That does help! i also had a lengthy discussion with my co-workers on the topic, which also helped. Thank you for the time you spend in helping understand this… less than 3 weeks to test day!
-
November 27, 2021 at 12:42 pm #477971Kellie ReidingerParticipant
Hello – I am reading over the PCS Advantage Research and Statistics Review sheet and this forum and I am mixed up. The Campbell book states Specificity as the True positive rate and Sensitivity as the True negative rate. SPIN rules in with a positive test result and SNout rules out with a negative test result. This contradicts the information you have here, unless I am missing how to apply the concept to different scenarios.
-
November 27, 2021 at 2:29 pm #477974Kellie ReidingerParticipant
Just wanted to f/u – I went back to my college notes (Waaay back haha) – and it explains it how you have it here, which makes sense to me.
-
November 28, 2021 at 8:30 am #478006Helen CareyParticipant
Hi Kellie,
This is a challenging concept that still confuses me as well! Below is a posting from last year that seemed to help (not sure if you could see it so I copied it below).SNout: When a test has a high sensitivity, a negative result rules out the diagnosis and positive result confirms the diagnosis.
SPin: When a test has a high specificity, a positive result tends to rule in the diagnosis and negative result rules out condition.
(I actually find these very confusing, so trying looking at it from the examples below):Sensitivity (true positive rate): Likelihood that someone with the condition will be positive on the diagnostic test; refers to the percentage of children who are correctly identified as meeting criteria for a condition; VALUABLE FOR CONFIRMING DX; 80% sensitivity is preferable.
Specificity (true negative rate): Likelihood that someone who does not have the condition will be negative on the diagnostic test; refers to the percentage of children without problems who are correctly identified as such; VALUABLE TO RULE OUT THE PRESENCE OF A CONDITION; 90% is preferable for a diagnostic test.**For the TIMP, Specificity is higher, indicating that it is a good measure for detecting large numbers of high risk infants who are not developing typically (rule out GM delay) and have delayed posture and motor development, which is it’s intended purpose. Sensitivity is much lower, so it is not as sensitive for identifying (or confirming) CP.
**The AIMS has been found to be more beneficial when administered at critical age ranges. While the 5th centile cut off value is best to identify the most delayed children (and those likely to have CP) (because of high specificity and relatively high sensitivity), the 10th centile cut off is best for identification of the greatest # of infants with abnormal motor development (because of high sensitivity).Sensitivity focuses on a specific condition (the example I gave is CP) whereas specificity focuses on ruling out the presence of a condition (the example I gave is GM delay). A child with poor gross motor skills will very likely score below average on the TIMP and be correctly identified as being delayed, however, we won’t be able to necessarily determine if the low performance is due to CP or another condition affecting GM development. A test with high sensitivity is best when your focus is identifying CP, not just GM delay.
There is always a “trade-off” between sensitivity and specificity: for a screening test in which early diagnosis is beneficial and when it is desirable to identify all those at risk for having a condition, high sensitivity is preferable to higher specificity.
-
-
AuthorPosts
- You must be logged in to reply to this topic.