Adapted from the weed risk assessment (WRA) of Pheloung, Williams, and Halloy, the fish invasiveness scoring kit (FISK) was proposed as a screening tool for freshwater fishes. This article describes improvements to FISK, in particular the incorporation of confidence (certainty/uncertainty) ranking of the assessors' responses, and reports on the calibration of the score system, specifically: determination of most appropriate score thresholds for classifying nonnative species into low-, medium-, and high-risk categories, assessment of the patterns of assessors' confidences in their responses in the FISK assessments. Using receiver operating characteristic (ROC) curves, FISK was demonstrated to distinguish accurately (and with statistical confidence) between potentially invasive and noninvasive species of nonnative fishes, with the statistically appropriate threshold score for high-risk species scores being ≥19. Within the group of species classed as high risk using this new threshold, a "higher risk" category could be visually identified, at present consisting of two species (topmouth gudgeon Pseudorasbora parva and gibel carp Carassius gibelio). FISK represents a useful and viable tool to aid decision- and policymakers in assessing and classifying freshwater fishes according to their potential invasiveness.