Fig. 1

Framework for development of clinically validated and generalizable AI tools. Suggested steps in AI algorithm development, testing, and validation. Of note, step 5 should be preceded by validation of the algorithm in a data set other than the derivation data set (“external validation”) which may also be done retrospectively, preferably within datasets from different institutions. Prospective validation may be one type of in-house validation