In our experiment we have a 1 W closed-cycle, low-vibration 4 K cryostat which refrigerates the Paul trap of the highly charged ion (HCI) experiment. An extreme high vacuum is achieved providing long HCI storage times on the order of 45 min. A vibration suppression system ensures a mechanically stable trap.