The lungs of a stillborn (born dead) baby
The baby who is born dead never respired through the nostrils into the lungs (breathing of the baby begins only after birth). The lungs will not contain any air. Recall that the placenta aids in gas exchange for the foetus. So, such a lung with no air does not float in the water.