They only lost 60k beating 70 French and 10 British divisions. Just no
The terrain and other factors in France were massively different. Switzerland was better prepared, and had excellent defensive positions. Border crossings were an issue, for one thing. In the words of General Franz Halder...
"Jura frontier offers no favorable base for an attack."
He went on to say...
"Switzerland rises, in successive waves of wood-covered terrain across the axis of an attack. The crossing points on the river Doubs and the border are few; the Swiss frontier position is strong."
Further, the Swiss Army was decently equipped, well trained, positioned for an invasion with formations positioned in key areas and a centrally placed reserve, and prepared for conflict. German attackers would have no shock in launching the attack, and limited options for crossing into Swiss territory against tough, determined, dug-in defenders.
The fourth draft of Operation
Tannenbaum, submitted by the German 12th Army in October of 1940, called for a force of twenty-one German divisions, later revised down to eleven, and fifteen Italian divisions in the south to keep the defenders busy, meaning the Swiss were looking at attack upon two fronts by somewhere between 300,000 and 500,000 men.
The invasion would doubtless have suffered some enormous casualties even if all had gone to plan, which it would not have, but Hitler's hatred of Switzerland might have pushed him anyway. As it stands, he did not order the invasion for whatever reason, Operation Overlord compelled the Germans to shelve the invasion plans, and Switzerland remained officially neutral.