1 Introduction  
2 Background  
3 Multimodal representation learning  
4 Graphs  
5 Knowledge  
6 Multimodal Tasks with knowledge  
7 Knowledge in Visual Question Answering (K-VQA)  
8 Knowledge in Visual Word Sense Disambiguation (K-VWSD)  
9 Knowledge in Visual Reasoning (K-VR)  
10 Knowledge in Visual Commonsense Reasoning (K-VCR)  
11 Knowledge in Image Captioning (K-IC)  
12 Knowledge in Visual Dialog (K-VD)  
13 Knowledge in Visual Storytelling (K-VIST)  
14 Knowledge in Image Generation  
15 Multi-task transformers with knowledge  
16 The future of knowledge in VL  
17 Conclusion  