"inadvanced" ? I don't think that's a word... You mean "primitive" ? ;-)
As always, the question is "primitive -- compared to what"? Batteries that can supply lots of power for a very long time are harder to design - and manufacture cheaply - than you might realize. Size and weight are also a big factor -- you could definitely have an iPod that would run for weeks without recharging -- if you didn't mind it being the size of a kleenex box and weighing 15 lbs.
A lot of the longevity we DO see in modern batteries is actually due to the devices being engineered to use less power. In many ways, this is a simpler task than battery design. The issues involved with improving battery life are quite different from those involved with designing a faster microprocessor or a denser hard drive -- and therefore, advances in computer tech do not always lead to advances in battery design.
Still, better batteries are a very red-hot market, and many companies are working on new designs. Fuel cells may lead to quite a revolution. Better solar cells may enable devices to self-charge with any ambient light. And more advanced electrode materials may greatly increase the storage capacity of regular chemical batteries.