If you can't get an RPM easily, letting us know line length, airplane used (or weight and span), and prop used (diameter, pitch and brand) will kinda sorta not-very-reliably let us know if your RPM was in the ballpark of being able to be regulated. Stepping out into the driveway and getting a quick RPM reading would be much, much better.
Basically, your regulated RPM needs to be no more than 75% to 80% of your calculated RPM, where your calculated RPM is Kv times the nominal pack voltage (and nominal pack voltage is 3.7V per cell).
I suspect that what's happening is that the smaller battery also has a higher internal resistance; this higher internal resistance means less voltage available to the ESC, which means less voltage to the motor, which means a lower speed. What's the "C" rating on the packs, and are they the same brand? "C" ratings are pretty loosey-goosey, but given two packs from a reputable manufacturer with differenc "C" ratings, you could reasonably expect that the one with the higher "C" rating will have a lower internal resistance.