I'd add that good steel is necessary, too, if you want a mortar small enough to be man-portable (the impression I got from the OP was something on the order of a 60mm mortar; a weapon with a crew of two or three that can be carried by a single human, but must be set up to fire).
Good enough steel limits us to the end of the 19th century at the earliest, I think.