INTERACT Category-level ZSL Qualitative Results

Training IllustrationsMost Confident True Positive for Each CategoryMost Confident False Positive for Each Category




















No Prediction
Predicted: Person A is arguing with Person B.

No Prediction.
Predicted: Person A is arguing with Person B.
True: Person A is kicking Person B.




















No Prediction
Predicted: Person A is carrying Person B.

No Prediction.
Predicted: Person A is carrying Person B.
True: Person A is hugging Person B.




















No Prediction
Predicted: Person A is catching Person B.

No Prediction.
Predicted: Person A is catching Person B.
True: Person A is jumping to Person B.




















No Prediction
Predicted: Person A is crawling after Person B.

No Prediction.
Predicted: Person A is crawling after Person B.
True: Person A is walking past Person B.




















No Prediction
Predicted: No prediction.

No Prediction.
Predicted: Person A is crawling away from Person B.
True: Person A is jumping past Person B.




















No Prediction
Predicted: Person A is crawling past Person B.

No Prediction.
Predicted: Person A is crawling past Person B.
True: Person A is crawling away from Person B.




















No Prediction
Predicted: Person A is crawling to Person B.

No Prediction.
Predicted: Person A is crawling to Person B.
True: Person A is tripping Person B.




















No Prediction
Predicted: Person A is crawling with Person B.

No Prediction.
Predicted: Person A is crawling with Person B.
True: Person A is lying behind Person B.




















No Prediction
Predicted: Person A is crouching behind Person B.

No Prediction.
Predicted: Person A is crouching behind Person B.
True: Person A is wrestling with Person B.




















No Prediction
Predicted: Person A is crouching in front of Person B.

No Prediction.
Predicted: Person A is crouching in front of Person B.
True: Person A is standing behind Person B.




















No Prediction
Predicted: Person A is crouching next to Person B.

No Prediction.
Predicted: Person A is crouching next to Person B.
True: Person A is standing behind Person B.




















No Prediction
Predicted: Person A is crouching with Person B.

No Prediction.
Predicted: Person A is crouching with Person B.
True: Person A is lying next to Person B.




















No Prediction
Predicted: Person A is dancing with Person B.

No Prediction.
Predicted: Person A is dancing with Person B.
True: Person A is carrying Person B.




















No Prediction
Predicted: Person A is elbowing Person B.

No Prediction.
Predicted: Person A is elbowing Person B.
True: Person A is tripping Person B.




















No Prediction
Predicted: Person A is hitting Person B.

No Prediction.
Predicted: Person A is hitting Person B.
True: Person A is dancing with Person B.




















No Prediction
Predicted: Person A is holding hands with Person B.

No Prediction.
Predicted: Person A is holding hands with Person B.
True: Person A is dancing with Person B.




















No Prediction
Predicted: Person A is hugging Person B.

No Prediction.
Predicted: Person A is hugging Person B.
True: Person A is dancing with Person B.




















No Prediction
Predicted: Person A is jumping after Person B.

No Prediction.
Predicted: Person A is jumping after Person B.
True: Person A is jumping to Person B.




















No Prediction
Predicted: Person A is jumping away from Person B.

No Prediction.
Predicted: Person A is jumping away from Person B.
True: Person A is walking away from Person B.




















No Prediction
Predicted: Person A is jumping over Person B.

No Prediction.
Predicted: Person A is jumping over Person B.
True: Person A is jumping past Person B.




















No Prediction
Predicted: No prediction.

No Prediction.
Predicted: Person A is jumping past Person B.
True: Person A is crouching with Person B.




















No Prediction
Predicted: Person A is jumping to Person B.

No Prediction.
Predicted: Person A is jumping to Person B.
True: Person A is reaching for Person B.




















No Prediction
Predicted: Person A is jumping with Person B.

No Prediction.
Predicted: Person A is jumping with Person B.
True: Person A is jumping after Person B.




















No Prediction
Predicted: Person A is kicking Person B.

No Prediction.
Predicted: Person A is kicking Person B.
True: Person A is lying behind Person B.




















No Prediction
Predicted: Person A is laughing at Person B.

No Prediction.
Predicted: Person A is laughing at Person B.
True: Person A is waving at Person B.




















No Prediction
Predicted: Person A is laughing with Person B.

No Prediction.
Predicted: Person A is laughing with Person B.
True: Person A is laughing at Person B.




















No Prediction
Predicted: Person A is looking at Person B.

No Prediction.
Predicted: Person A is looking at Person B.
True: Person A is shaking hands with Person B.




















No Prediction
Predicted: Person A is looking away from Person B.

No Prediction.
Predicted: Person A is looking away from Person B.
True: Person A is catching Person B.




















No Prediction
Predicted: Person A is lying behind Person B.

No Prediction.
Predicted: Person A is lying behind Person B.
True: Person A is lying in front of Person B.




















No Prediction
Predicted: Person A is lying in front of Person B.

No Prediction.
Predicted: Person A is lying in front of Person B.
True: Person A is crouching with Person B.




















No Prediction
Predicted: Person A is lying next to Person B.

No Prediction.
Predicted: Person A is lying next to Person B.
True: Person A is lying in front of Person B.




















No Prediction
Predicted: Person A is lying with Person B.

No Prediction.
Predicted: Person A is lying with Person B.
True: Person A is lying in front of Person B.




















No Prediction
Predicted: Person A is pointing at Person B.

No Prediction.
Predicted: Person A is pointing at Person B.
True: Person A is reaching for Person B.




















No Prediction
Predicted: Person A is pointing away from Person B.

No Prediction.
Predicted: Person A is pointing away from Person B.
True: Person A is jumping away from Person B.




















No Prediction
Predicted: Person A is pulling Person B.

No Prediction.
Predicted: Person A is pulling Person B.
True: Person A is standing behind Person B.




















No Prediction
Predicted: Person A is pushing Person B.

No Prediction.
Predicted: Person A is pushing Person B.
True: Person A is hugging Person B.




















No Prediction
Predicted: No prediction.

No Prediction.
Predicted: Person A is reaching for Person B.
True: Person A is pulling Person B.




















No Prediction
Predicted: Person A is running after Person B.

No Prediction.
Predicted: Person A is running after Person B.
True: Person A is running to Person B.




















No Prediction
Predicted: Person A is running away from Person B.

No Prediction.
Predicted: Person A is running away from Person B.
True: Person A is running past Person B.




















No Prediction
Predicted: Person A is running past Person B.

No Prediction.
Predicted: Person A is running past Person B.
True: Person A is running with Person B.




















No Prediction
Predicted: Person A is running to Person B.

No Prediction.
Predicted: Person A is running to Person B.
True: Person A is running away from Person B.




















No Prediction
Predicted: Person A is running with Person B.

No Prediction.
Predicted: Person A is running with Person B.
True: Person A is sitting next to Person B.




















No Prediction
Predicted: Person A is shaking hands with Person B.

No Prediction.
Predicted: Person A is shaking hands with Person B.
True: Person A is crouching in front of Person B.




















No Prediction
Predicted: Person A is sitting behind Person B.

No Prediction.
Predicted: Person A is sitting behind Person B.
True: Person A is crouching with Person B.




















No Prediction
Predicted: Person A is sitting in front of Person B.

No Prediction.
Predicted: Person A is sitting in front of Person B.
True: Person A is sitting behind Person B.




















No Prediction
Predicted: Person A is sitting next to Person B.

No Prediction.
Predicted: Person A is sitting next to Person B.
True: Person A is sitting behind Person B.




















No Prediction
Predicted: Person A is sitting with Person B.

No Prediction.
Predicted: Person A is sitting with Person B.
True: Person A is holding hands with Person B.




















No Prediction
Predicted: Person A is standing behind Person B.

No Prediction.
Predicted: Person A is standing behind Person B.
True: Person A is walking after Person B.




















No Prediction
Predicted: No prediction.

No Prediction.
Predicted: Person A is standing in front of Person B.
True: Person A is dancing with Person B.




















No Prediction
Predicted: Person A is standing next to Person B.

No Prediction.
Predicted: Person A is standing next to Person B.
True: Person A is standing with Person B.




















No Prediction
Predicted: Person A is standing with Person B.

No Prediction.
Predicted: Person A is standing with Person B.
True: Person A is standing in front of Person B.




















No Prediction
Predicted: Person A is talking with Person B.

No Prediction.
Predicted: Person A is talking with Person B.
True: Person A is arguing with Person B.




















No Prediction
Predicted: Person A is tripping Person B.

No Prediction.
Predicted: Person A is tripping Person B.
True: Person A is crawling with Person B.




















No Prediction
Predicted: Person A is walking after Person B.

No Prediction.
Predicted: Person A is walking after Person B.
True: Person A is running with Person B.




















No Prediction
Predicted: Person A is walking away from Person B.

No Prediction.
Predicted: Person A is walking away from Person B.
True: Person A is looking away from Person B.




















No Prediction
Predicted: No prediction.

No Prediction.
Predicted: Person A is walking past Person B.
True: Person A is walking after Person B.




















No Prediction
Predicted: Person A is walking to Person B.

No Prediction.
Predicted: Person A is walking to Person B.
True: Person A is running with Person B.




















No Prediction
Predicted: Person A is walking with Person B.

No Prediction.
Predicted: Person A is walking with Person B.
True: Person A is standing with Person B.




















No Prediction
Predicted: Person A is waving at Person B.

No Prediction.
Predicted: Person A is waving at Person B.
True: Person A is jumping with Person B.




















No Prediction
Predicted: Person A is wrestling with Person B.

No Prediction.
Predicted: Person A is wrestling with Person B.
True: Person A is sitting next to Person B.