Found in historical society records. 454 Canal St.
They note that it's now known as Commerce st.
It's worth mentioning that the current address at "454 Canal St" is the Harley Davidson museum. Google maps does not recognize the number 454. I'd have to take a drive down Commerce St to see if there are any old civil war era buildings whatsoever.