"what does it mean to report a P value here?"
That's the correct question to be asking. A p-value returns the probability of getting the results of some test given that the null hypothesis is correct. If the p value is low enough, you reject the null hypothesis.
If you have 5 different distributions all with different fit values, what's the null hypothesis about those 5 values? When the question is framed that way, it's clear that this isn't the right question to ask.
The One-sample Kolmogorov-Smirnov test returns a test decision (output 1) for the null hypothesis that the input data comes from a standard normal distribution, against the alternative that it does not come from such a distribution. The p-value (output 2) is the probability value used to make the test decision.
Lastly, the confusion over p-values is common which has motivated hundreds of statisticians and researchers across the globe to deemphasize the use of p-values in statistical reporting (Nature, March 2019).
