To benchmark progress in visual relationship detection, we also introduce a new dataset containing 5000 images with 37,993 thousand relationships. THe dataset contains 100 object categories and 70 predicate categories connecting those objects together. Predicates can be widely categorized into the 5 following types: