@stobot performance is something I think about a great deal as well, and I think you are facing many of the same questions and challenges that I had with Streams.
I started writing a response but it got long enough that I have posted it separately: