Upon further review, it seems there are now available rechargeable 1.5V AA Li-ion batteries. See review of youtube vid
Seems you won't have to change anything in terms of form factor and most are more than quadruple the capacity you're used to per cell.
It would seem to me these have to have some control circuitry to convert a normal 3.7V to 1.5. Some have a USB port for charging so they must have charging circuitry. The way the video is shown, the batteries are run till fully "drained" which normally renders Lithium batteries unusable so internally it must have a cutoff. Looking at the most expensive battery tested -
VAPCELL P1418A PROTECTED LITHIUM ION AA 1.5V BATTERY WITH USB PORT, it does state
It has a chip inside that regulates the voltage to work with them.. However the site also shows a very long list of battery warnings typical of an unprotected lithium battery type.