Good news, I have managed to rotate a video (well partially, as in it works somehow but not how I want it to). Bad news, it took me like 4 hours to debug it.