Sortable chomps events of contained items

I'm currently building a little layer system (a stack basically). The idea is that the user should be able to modify the ordering of the layers using drag and drop. I thought Sortable plugin might just be the thing for this. I came upon a problem, though.

The thing is that each of those layers contains some functionality (ie. hide/show, select). Using sortable on the stack makes it possible to reorder it. After enabling Sortable I cannot access the functionality of the layers anymore, however. It seems Sortable overrides the events defined for each layer.

I guess like in the case of Draggable providing a handle element for sorting just might do the trick. Or if it's possible to do without, that would be even better. :)