Eliminate Some Cloning

With this change, there should be much less memory copies as the
pipeline expansion logic has been rewritten to take mutable references
instead of creating all new `Pipeline` objects.