Agreed. Unless he made it clear that the synagogue was not the church, and that it was just Jesus' habit to go to the synagogue (a habit that translates well into church.)
Either way, if was a relatively minor abuse of a scriptural text, and one I'd be prone to overlook. There are several...