Patchwork: A Patch-wise Attention Network for Efficient Object Detection and Segmentation in Video Streams