The fifth sub is still out there somewhere, but nobody has even a remote idea of where to look. According to this website,
Advance Force Pearl Harbor, the last midget sub actually fired torpedoes into the U.S.S. West Virginia, and radioed the success to the mother sub I-16. Hours later, radio contact was lost, and the sub was never heard from again.