"The name was exciting to figure out," the new dad tells PEOPLE, adding that "it created an unbelievable debate" within their family when they unveiled the moniker