Can an exhaust manifold be too big on a diesel?

[Morse]

This is probably going to sound odd, though here's the delimma. I ordered a turbo to run as a large single on my 06. It has a T6 mounting flange. Should I run a normal T3 style exhaust manifold with the T6 adaptor? Should I run a T4 style ATS big foot exhaust manifold with a T4 to T6 adaptor? Or the last choice.. Joe Helmann makes custom exhaust manifolds that are huge. He said he will make me a large exhaust manifold with a T6 flange if that's what I want. That option is more expensive, yet custom. On gas motors, you can actually go too large on the exhaust (especially headers) and it sometimes hurts power. Could our exhaust manifolds ever be too big?