Understanding the Limitations of Using Large Language Models for Text Generation