Yes, any user that will be creating templates/document actions or that will be clicking button to generate documents will need to be a licensed user. If other Salesforce users only need access to the generated document (another app user clicked button to generate) then they can access the documents under Notes & Attachments.