Your settlement permit or EU permanent residence permit is valid in Germany if your passport has expired and you have received a new one.

Living in Germany for a long time may grant you the opportunity to apply for German citizenship upon fulfilling additional criteria

As soon as you get your German citizenship, you can apply for a German passport. You’d require a passport to travel outside of the EU