What I had in mind was having a separate computer to be the server, the drone would stream video to the server and it would use OpenCV and the like to make decisions and control the drone based on that.

So that way I can just have a video stream that I can process in whatever language I want ( Python ) and then send commands back to the drone in real time.

Which drone is best suited for this kind of task ? I heard that the parrot drones are programmable to a degree.

I like the Parrot Bebop 2 but am not sure if it's suitable for my use case.