Ask Dave: Is Felony Disenfranchisement Unconstitutional?

In some states, people convicted of felonies lose certain rights -- notably, the right to vote. What's the legal justification for a practice that indefinitely suspends the civil rights of convicts, even after they've served their sentences?