".. just like how you're going to remember the lanterns once you're out of the tower back home, right?"

Yes, that's a 'once'. Because Inigo believes fiercely that there's no way Rapunzel will be stuck there forever. He will fly his world-hopping dragon over if that's what it takes, he'll find a way!