1 Introduction
2 Background
3 Challenges of Automatic Evaluation
4 Challenges of Human Evaluation
5 Challenges with Datasets
6 Suggestions for NLG Researchers
7 Every Cloud has a Silver Lining
8 Discussion
9 Conclusion