Our discussion forums are available to anyone to read, but you must be a member to reply or start new topics. Log-in or register to get started.

Viewing 7 reply threads
  • Author
    Posts
    • #318901
      Kasey Murphy
      Participant

      Can you give guidance on sensitivity vs specificity and sPin vs sNout?

    • #320333
      Helen Carey
      Participant

      Hi Kasey,
      These concepts have rattled me for years! a. is the correct answer for this question: “The assessment has a high success rate of identifying gross motor delays but may also suggest that there is a gross motor delay when there is not really a delay present.”

      SNout: When a test has a high sensitivity, a negative result rules out the diagnosis and positive result confirms the diagnosis.
      SPin: When a test has a high specificity, a positive result tends to rule in the diagnosis and negative result rules out condition.
      (I actually find these very confusing, so trying looking at it from the examples below):

      Sensitivity (true positive rate): Likelihood that someone with the condition will be positive on the diagnostic test; refers to the percentage of children who are correctly identified as meeting criteria for a condition; VALUABLE FOR CONFIRMING DX; 80% sensitivity is preferable.
      Specificity (true negative rate): Likelihood that someone who does not have the condition will be negative on the diagnostic test; refers to the percentage of children without problems who are correctly identified as such; VALUABLE TO RULE OUT THE PRESENCE OF A CONDITION; 90% is preferable for a diagnostic test.

      **For the TIMP, Specificity is higher, indicating that it is a good measure for detecting large numbers of high risk infants who are not developing typically (rule out GM delay) and have delayed posture and motor development, which is it’s intended purpose. Sensitivity is much lower, so it is not as sensitive for identifying (or confirming) CP.
      **The AIMS has been found to be more beneficial when administered at critical age ranges. While the 5th centile cut off value is best to identify the most delayed children (and those likely to have CP) (because of high specificity and relatively high sensitivity), the 10th centile cut off is best for identification of the greatest # of infants with abnormal motor development (because of high sensitivity).

      There is always a “trade-off” between sensitivity and specificity: for a screening test in which early diagnosis is beneficial and when it is desirable to identify all those at risk for having a condition, high sensitivity is preferable to higher specificity.

    • #321695
      Kasey Murphy
      Participant

      Thank you.. I have to read over it multiple times, I don’t know why these terms always seem to confuse me.

      When you give the example of the TIMP – Specificity is higher –Likelihood that someone who does not have the condition will be negative on the diagnostic test; refers to the percentage of children without problems who are correctly identified as such; — so with the TIMP, when looking at Specificity, we are looking at the percentage of children without the the condition who are correctly negative on the test, and ruling out a condition — so we are ruling out GM delay with the TIMP Score —
      But I am still confused by the explanation of TIMP: “indicating that it is a good measure for detecting large numbers of high risk infants who are not developing typically” — this seems like sensitivity – we are are identifying infants not developing typically (those who have GM Delay)?

      Sorry, this topic as had me since PT school

    • #321956
      Helen Carey
      Participant

      Sensitivity focuses on a specific condition (the example I gave is CP) whereas specificity focuses on ruling out the presence of a condition (the example I gave is GM delay). A child with poor gross motor skills will very likely score below average on the TIMP and be correctly identified as being delayed, however, we won’t be able to necessarily determine if the low performance is due to CP or another condition affecting GM development. A test with high sensitivity is best when your focus is identifying CP, not just GM delay.

      My brain wants to switch the concepts since I tend to think of “specificity” as identifying a specific condition (being “specific” about a condition), when it is actually the opposite.

      Hope this helps!
      Helen

    • #321964
      Kasey Murphy
      Participant

      That does help! i also had a lengthy discussion with my co-workers on the topic, which also helped. Thank you for the time you spend in helping understand this… less than 3 weeks to test day!

    • #477971
      Kellie Reidinger
      Participant

      Hello – I am reading over the PCS Advantage Research and Statistics Review sheet and this forum and I am mixed up. The Campbell book states Specificity as the True positive rate and Sensitivity as the True negative rate. SPIN rules in with a positive test result and SNout rules out with a negative test result. This contradicts the information you have here, unless I am missing how to apply the concept to different scenarios.

    • #477974
      Kellie Reidinger
      Participant

      Just wanted to f/u – I went back to my college notes (Waaay back haha) – and it explains it how you have it here, which makes sense to me.

    • #478006
      Helen Carey
      Participant

      Hi Kellie,
      This is a challenging concept that still confuses me as well! Below is a posting from last year that seemed to help (not sure if you could see it so I copied it below).

      SNout: When a test has a high sensitivity, a negative result rules out the diagnosis and positive result confirms the diagnosis.
      SPin: When a test has a high specificity, a positive result tends to rule in the diagnosis and negative result rules out condition.
      (I actually find these very confusing, so trying looking at it from the examples below):

      Sensitivity (true positive rate): Likelihood that someone with the condition will be positive on the diagnostic test; refers to the percentage of children who are correctly identified as meeting criteria for a condition; VALUABLE FOR CONFIRMING DX; 80% sensitivity is preferable.
      Specificity (true negative rate): Likelihood that someone who does not have the condition will be negative on the diagnostic test; refers to the percentage of children without problems who are correctly identified as such; VALUABLE TO RULE OUT THE PRESENCE OF A CONDITION; 90% is preferable for a diagnostic test.

      **For the TIMP, Specificity is higher, indicating that it is a good measure for detecting large numbers of high risk infants who are not developing typically (rule out GM delay) and have delayed posture and motor development, which is it’s intended purpose. Sensitivity is much lower, so it is not as sensitive for identifying (or confirming) CP.
      **The AIMS has been found to be more beneficial when administered at critical age ranges. While the 5th centile cut off value is best to identify the most delayed children (and those likely to have CP) (because of high specificity and relatively high sensitivity), the 10th centile cut off is best for identification of the greatest # of infants with abnormal motor development (because of high sensitivity).

      Sensitivity focuses on a specific condition (the example I gave is CP) whereas specificity focuses on ruling out the presence of a condition (the example I gave is GM delay). A child with poor gross motor skills will very likely score below average on the TIMP and be correctly identified as being delayed, however, we won’t be able to necessarily determine if the low performance is due to CP or another condition affecting GM development. A test with high sensitivity is best when your focus is identifying CP, not just GM delay.

      There is always a “trade-off” between sensitivity and specificity: for a screening test in which early diagnosis is beneficial and when it is desirable to identify all those at risk for having a condition, high sensitivity is preferable to higher specificity.

Viewing 7 reply threads
  • You must be logged in to reply to this topic.