The following is a new architecture for robust segmentation. It may perform better than a U-Net :) for binary segmentation. I will update the code when I have some spare time within the next month. However you can simply read this one and will soon notice the pattern after a bit -
View it on GitHub