You would struggle, because the pressure on the outside of the balloon underwater would be much greater than the pressure on the outside in the air, so you would have to work that much harder to blow it up, and somehow stop water from getting in first.
Comments