I do not know if a puppy's heart murmur ALWAYS goes away, but I can tell you that when we brought Charlie home that the vet said he had a heart murmur. Within a month, it was gone. Hope this helps.
Charlie's Mommy
Charlie - 11 month old - flashy fawm