I connected the other types of ports and have a "set bonus" of 250 %, but it does not seem to apply.
I only have the boost from my Blooming Trade Guild AW (and no core upgrade yet):
So basically it doesn't seem to make an actual difference if I connect the sets or not.