Mandy Moore was scared to continue touring while pregnant