Remove bitflags

Bitflags are generally useful in large (couple kbs) data structure, not (anymore) to store a couple of booleans.

• Get rid of the 3 last spots where they were used.
• Remove a dependency and get a small speed bump (around 1-2%).
• Make the code more straightforward