Re: Feature request: data stream upload after server response

fungs via curl-users <[email protected]>
Newsgroups gmane.comp.web.curl.general
Message-ID <[email protected]>
Hi,

I was waiting for other answers, but let me explain a little more:

- I proposed a feature to make curl file upload work with existing HTTP endpoints (not mine) on existing infrastructure (cloud providers with managed reverse proxies and edge routers).

- Nowadays, it is common that requests are delegated, for instance to an authentication proxy, before data is uploaded to an endpoint. This is just how modern cloud and microservices work.

- With those setups, it does not make sense to start a data upload until an end to end connection has been authenticated and established, because the data to be passed among systems and needs to be cached in the process of routing. Such intermediate systems need to handle many requests and have storage and time limits.

- The solution I see and which seems to work for me is to wait for the response before starting to upload or stream data, which ensure that all the infrastructure negotiation has succeeded.

- The solution would work well with the async upload option in curl, as far as I can tell.

I understand, that from a traditional perspective on the HTTP protocol and its
operations, the problem seems to be with the infrastructure providers
not handling the requests properly. However, HTTP today is used in many
complex situations. A global edge router simply cannot know how a
request is going to be used in the following layers. Therefore, the
workaround presented to me seems like a useful (non-standard) addition
to curl. The alternative would be to provide alternative HTTP upload
clients for the operations (like the shell workaround I posted before).
The is what I would like to avoid.

Happy to discuss it!

Best
Johannes

-- 
Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
Etiquette:   https://curl.se/mail/etiquette.html
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.