What happened to Joseph the carpenter when Jesus is already in manhood?

It is generally assumed that Joseph was dead by then since there is no mention of him in that part of the Bible.