fix(http): read more before triggering TooLargeError
This includes a custom BufReader, since the one in libstd doesn't allow reading additional data into the buffer without consuming it. This is required because some connections may send shorter packets, and so we need to perform multiple reads. After each read, the contents of the buffer are passed to httparse to see if have a valid message. If so, the proper amount of bytes are consumed. The additional bytes are left in the buffer since they are the beginning of the body. The buffer in this BufReader also grows in size, compared to the libstd which is sized once. This is because we start with a smaller buffer, since the majority of messages will be able to include their head in a packet or 2. Therefore, it's a wasteful performance hit to allocate the maximum size for every message. However, some headers can be quite big, and to allow for many of them to be set, we include a maximum size. Once we've hit the maximum buffer size, and still haven't determined the end of the headers, a HttpTooLargeError will be returned. Closes #389
This commit is contained in:
@@ -1,8 +1,9 @@
|
||||
//! Client Responses
|
||||
use std::io::{self, Read, BufReader};
|
||||
use std::io::{self, Read};
|
||||
use std::num::FromPrimitive;
|
||||
use std::marker::PhantomData;
|
||||
|
||||
use buffer::BufReader;
|
||||
use header;
|
||||
use header::{ContentLength, TransferEncoding};
|
||||
use header::Encoding::Chunked;
|
||||
@@ -103,9 +104,10 @@ impl Read for Response {
|
||||
mod tests {
|
||||
use std::borrow::Cow::Borrowed;
|
||||
use std::boxed::BoxAny;
|
||||
use std::io::{self, Read, BufReader};
|
||||
use std::io::{self, Read};
|
||||
use std::marker::PhantomData;
|
||||
|
||||
use buffer::BufReader;
|
||||
use header::Headers;
|
||||
use header::TransferEncoding;
|
||||
use header::Encoding;
|
||||
|
||||
Reference in New Issue
Block a user