Whom does Faber blame for book burning in Fahrenheit 451?

I think the best way to answer this is to say that Faber blames himself and other people like him for the burning.

There is a quote I've seen from someone who survived the Holocaust -- he wasn't a Jew but was another kind of person that Hitler didn't like.  He said something to the effect that when the police came for other people, he didn't defend them and by the time the police came for him, there was no one to defend him.

This is what Faber is saying about him and books. He says that he was an innocent person back when the book burning type of thing started.  He says he could have spoken out against it and maybe stopped it.  But instead he was afraid to speak out, and then it was too late.