I haven't tested but you may need to have previously clicked on "follow" for new posts button to appear when you open the conversation?
"New" posts button always shows up if there are new posts since the last visit. It works independently from the "Follow" a conversation button. 😉
Click on the "New" blue button at the bottom right of the screen to scroll to new posts.