Ilkay Gundogan gave Joachim Low's side the perfect start when he scored a clinical goal in the 14th minute, but Silvan Widmer earned their smaller neighbours a deserved draw with an equaliser just before the hour.
In the end, Germany may have been grateful for the draw in the League A Group 4 game as the much livelier hosts created the better chances.
Germany failed to win any of their four games in the inaugural Nations League two years ago and have drawn their opening two games this time around. Switzerland have one point after losing their opener to Ukraine.
Low was left frustrated by his team's failure to capitalise on their early lead.
"We didn't take our chances for a second goal and allowed Switzerland to take control in the second half -- in the end I thought a draw was the right result," he said.
"When you lead 1-0 in two games and don't win either, it's annoying. It's a problem that we are not finishing off games... I doubt that Switzerland would have come back from 2-0 behind."
Low stuck with his three-man defence and his side made an early breakthrough.
Julian Draxler should have added a second shortly afterwards but shot straight at Sommer.
The Benfica striker also hit the post just before half-time.
Breel Embolo's runs from midfield constantly troubled Germany and he set up the equaliser in 58th minute.
The visitors lost possession in midfield, Embolo burst into the area and laid the ball off to Widmer who scored on his return to the side after a three-year absence.