Scherer was a founding member of the "Rot-Blau" group that formed around Ernst Ludwig Kirchner in Davos in the early 20th Century and is considered one of the leading sculptors of the expressionist movement.
Born into a poor farmer's family, Scherer had to work for a living, and was apprenticed to a stone cutter in Germany at the age of 14. During WWI, Scherer lived in Basel, where he worked as an assistant to the Sculptor Otto Roos. It was also during this time that he created the first of his own scultures. It was also in Basel that Scherer met Kirchner, who invited him to Davos, where he created the group Rot-Blau with his friends Albert Müller und Paul Camenisch.