Would it therefore make sense to pull from the LEDE project again?
It seems that they added the mentioned patchset to their Kernel 4.4: https://github.com/lede-project/source/tree/master/target/linux/mvebu/patches-4.4
Or did someone already try with that patchset?