I recall reading Peter Chinn's engine reviews. He didn't seem to have a problem putting HP numbers on engines. Maybe some of the whiz-bang experts of today would find reason to challenge his methods. I always accepted him as THE authority on engines.
They wrote and referred to their use of both calibrated props and a dynamometer. Nothing has changed much about since the time of James Watt, so I am not sure what you are talking about "whiz-bang experts" doing differently. The only real change is that some people replaced the spring scale or the swing weights with an arm and a load cell. That just makes it easier to use, not any better or more accurate.
BTW, you used to be able to buy a set of calibrated props for doing exactly what you are doing. But to come up with the curves in the plot from above, you have to have a dynamometer of some type.
When Ted and I did power and torque testing, we used a swing-weigh dynamometer than was available as a kit and would have been completely familiar to PGF Chinn and his bunch. The only issue I have ever had with his results, or any other engine tester, is the tendency to jump to conclusions based on static tests. Almost any engine for any specific application has to be tested in that application, and maybe you can make some sense of the results by looking at dyno tests, but you sure can't tell without actually testing in the specific application*.
The other objection I have had (after PGF Chinn), is that people following him wanted to write things like he did, and ended up with the most pompous and overwrought Proper English, you could almost read it with an RP accent! That is a big problem with all technical writing, I end up rejecting papers *all the time* trying to get it cut down to only the necessary information. Write like Hemingway, not Edgar Rice Burroughs. In Chinn's case, you get the impression that it was not an act, but everybody else since, yes, it seems like an affectation.
The best-ever example of this was a series of articles in Stunt News where a proclaimed "engine expert" inspected and tested a series of engines, and came to the conclusion that the OS 40VF was "unsuitable for stunt" because the timing was "typical radio numbers" - shortly after it won 4 NATS in a row and a WC!, while in the process of redefining the standards for the entire event. Some of the others, traditional baffle-piston chug motors like giant Foxes, all passed his muster!
Brett
*p.s. Chinn frequently waited until some engine was showing itself as competitive before testing it, like when the Olympic 15 and even more so, the Tee Dee 15 blew up FAI FF Power. He even refers to the contest success frequently in the articles. So, what he was doing made more sense than testing it first and them proclaiming it good or not just based on the test.