Another approach is to use one layer, and to split your transparent object in half.
First, draw the background. Bake the layer.
Next, draw the half object rotated so that it is facing away from you. Reduce the RGB Intensity and activate Draw>Refraction. When satisfied, snapshot the object.
Now you can draw anything that will be inside the object.
Bake the layer.
Lastly, draw the half object again, rotated so that it is now in front of everything else (facing you). Tweak the RGB Intensity and Refraction settings if you want. Snapshot the object.
You will now be able to see the back of the object refracted through the front of the object. Anything that is inside the object will also be refracted, and the background will be refracted through everything.