(If you click the <# time ago> link in the comment, you get taken to a page just for that comment tree. That page will always have a reply box, even if the main comments page hides it.)