Hi Mic-uh

The magic behind Get-IshPublicationOutputData is an HTTP request to the server, probably a secured SOAP request depending on your server-version. In turn all your parallel requests arrive at the application server to execute on, for this the server needs to have CPU/Memory available. The application server goes to the database server to retrieve your small-medium-large files, for this the server needs to have CPU/Memory available. Bigger requests (stretches of 1GB of memory) take longer than small requests. And on these servers, you are not alone, you have colleagues who potentially are doing the same or worse

So as often in IT, there is a next bottleneck... typically maxed out CPU, or memory or I/O throughput. The system will cope with queueing and retries, but at some point you hit an absolute timeout.

Based on the above description for your environment you'll need to try to find the balance in how many requests the server can run in parallel... leave some room for your colleagues... often for throughput less parallel could still mean you arrive at the finish line faster.

Best wishes,
Dave

Hey Dave, thanks for the answer. Is there some fundamental between the API call and going into the web GUI and download the publication?

fundamental difference*

Yes there is a difference, and it was tuned over the various Tridion Docs versions. In essence the Public SOAP API has no easy notion of streaming binaries from the database server over the web/application server over the network to the client (your PowerShell session). So it does chunked retrieval, retrieving blocks of data. The chunks can be controlled client side (over $ISHRemoteSessionStateIshSession.ChunkSize defaults to 10485760 bytes so 10Mb) but again the chunks mostly affect the server, so requesting larger chunks pressures the shared web/app server eventually leading to Out-Of-Memory errors.

The web browser, and Private web API behind it, do have better streaming capabilities end-to-end. So a web browser will show you a continuous stream of incoming data in the progress bar; while in Publication Manager you see the progress bar move in chunks/jumps. 

Yes there is a difference, and it was tuned over the various Tridion Docs versions. In essence the Public SOAP API has no easy notion of streaming binaries from the database server over the web/application server over the network to the client (your PowerShell session). So it does chunked retrieval, retrieving blocks of data. The chunks can be controlled client side (over $ISHRemoteSessionStateIshSession.ChunkSize defaults to 10485760 bytes so 10Mb) but again the chunks mostly affect the server, so requesting larger chunks pressures the shared web/app server eventually leading to Out-Of-Memory errors.

The web browser, and Private web API behind it, do have better streaming capabilities end-to-end. So a web browser will show you a continuous stream of incoming data in the progress bar; while in Publication Manager you see the progress bar move in chunks/jumps.