The symbol originates from the Catholic tradition that when sentenced to death, Peter requested that his cross be upside down, as he felt unworthy of being crucified in the same manner as Jesus.

You can imagine today the shock for some tourist when they have to re-learn this.