I stopped knitting a few years ago, but back when I knitted regularly, I tended to bring my knitting bag with me everywhere I went.
There are a lot of idle minutes in your typical day. Waiting for the bus, waiting in line for the ATM, waiting for a meeting to start. There's not enough time in those idle minutes to do anything substantial, but...