WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

[Xen-devel] Re: [PATCH] libxl: reimplement buffer for bootloading and dr

To: Ian Campbell <Ian.Campbell@xxxxxxxxxx>
Subject: [Xen-devel] Re: [PATCH] libxl: reimplement buffer for bootloading and drop data if buffer is full
From: Roger Pau Monné <roger.pau@xxxxxxxxxxxxx>
Date: Thu, 13 Oct 2011 11:32:47 +0200
Cc: "xen-devel@xxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxx>, Ian Jackson <Ian.Jackson@xxxxxxxxxxxxx>
Delivery-date: Thu, 13 Oct 2011 02:34:06 -0700
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=26HPzfm3EhspWEPcZEG6okoxvQJ2uUerUAAAH5yeHpg=; b=vhHhR8RPIKVHlGKePakHrA1bezH6twsrVJmU7lDGSoOC9gihd2u8qawNXxADJSCY8r GU3hXFTCUsCYwXa+xohcFMXCXuCmwTFR+i3MS8Jpxxeo/T5zY1SxGGshikDttexCXi9k fxtAxMyZ+X7U0lkVK5T4cHZFTSK3JG6nLmjJY=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <1318496762.21903.806.camel@xxxxxxxxxxxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <2fb4bf8c16cd35ddc0bf.1318336005@loki> <1318410713.21903.598.camel@xxxxxxxxxxxxxxxxxxxxxx> <CAPLaKK5QiyxxOL8XwTvEpFN1F7iJHOayFB2aqq3Vo=v3gBNyfw@xxxxxxxxxxxxxx> <1318496762.21903.806.camel@xxxxxxxxxxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
2011/10/13 Ian Campbell <Ian.Campbell@xxxxxxxxxx>:
> On Thu, 2011-10-13 at 09:43 +0100, Roger Pau Monné wrote:
>
>> >>          FD_ZERO(&rsel);
>> >>          FD_SET(fifo_fd, &rsel);
>> >>          nfds = fifo_fd + 1;
>> >> -        if (xenconsoled_prod == 0 || (xenconsoled_prod < 
>> >> BOOTLOADER_BUF_SIZE && xenconsoled_cons == 0)) {
>> >> +        if (xenconsoled_prod == 0 || (xenconsoled_prod < 
>> >> BOOTLOADER_BUF_SIZE && xenconsoled_cons == 0) || timeout) {
>> >
>> > If you've had a timeout there will be data pending on this FD won't
>> > there, so this change essentially means that after the first timeout the
>> > timeout on the select becomes effectively zero?
>>
>> Well, I cannot know this for sure, but it's the most likely situation.
>>
>> > Can you just make this:
>> >           if (xenconsoled_prod == 0 || xenconsoled_cons == 0) {
>>
>> I don't think there's any need for this pair of "ifs", since they will
>> always be hit, because xenconsoled_cons and bootloader_cons is always
>> 0 at this point, I agree with you that this might be dropping data to
>> aggressively, since the timeout will not be needed. Something like
>> this might be more suitable:
>>
>> if (bootloader_prod == 0 || ret == 0) {
>>
>> The "timeout" variable is not really needed, I've just added it to
>> make the code cleaner and easier to understand,
>
> Actually, the timeout variable was ok my concern was more the use of
> continue and the code flow it seemed to create which wasn't easy to
> follow.

Ok, I think I've managed to write it in a more friendly way.

> If the buffer is full and we therefore don't add it to the select then
> either
>      * some other file descriptor in the select becomes read for
>        read/write as appropriate, in which case some progress will be
>        made, - or -
>      * the timeout will fire and we will discard some data, such that
>        next time round the loop we can make progress.
>
> Do we need to care about the case where no fd's get added to the select?

I don't think it's possible, since read fd's get added when there's
space in the buffer, and write fd's gets added when there's data in
the buffer, so either way there will be fd's in select.

buffer empty: read fd's are added
buffer contains data but it's not full: read & write fd's are added
buffer full: write fd's are added.

> Doesn't dropping any part of the data stream have that same property? Is
> dropping the tail somehow worse?

Dropping from the head and adding data to the tail makes the data
stream in the buffer contiguous, there are no breaks inside it. On the
other hand, rewriting data in the tail (or the head) introduces one
(or possible more) breaks in the data stream. What I mean with "break"
is that the data is no longer in the same order as it came from the
fd.

>>
>> > Hmm. that might discard a bit too aggressively, perhaps leaving this
>> > check as it was and doing the discard if (ret == 0 && xenconsoled_prod
>> > == BOOTLOADER_BUF_SIZE) in the else clause if the FD_ISSET works?
>>
>> This might make the select loop too fast, since we add all the
>> descriptors to the set, and it's a strong possibility that the timeout
>> will never be hit, so ret will never be 0 and we will be looping
>> forever.
>
> That's why we should not add fd's to the set which we cannot make
> progress with if they become/are ready.
>
> Ian.
>
>>
>> >>              FD_SET(xenconsoled_fd, &rsel);
>> >>              nfds = xenconsoled_fd + 1 > nfds ? xenconsoled_fd + 1 : nfds;
>> >>          }
>> >> -        if (bootloader_prod == 0 || (bootloader_prod < 
>> >> BOOTLOADER_BUF_SIZE && bootloader_cons == 0)) {
>> >> +        if (bootloader_prod == 0 || (bootloader_prod < 
>> >> BOOTLOADER_BUF_SIZE && bootloader_cons == 0) || timeout) {
>> >>              FD_SET(bootloader_fd, &rsel);
>> >>              nfds = bootloader_fd + 1 > nfds ? bootloader_fd + 1 : nfds;
>> >>          }
>> >> @@ -208,12 +226,23 @@ static char * bootloader_interact(libxl_
>> >>              nfds = bootloader_fd + 1 > nfds ? bootloader_fd + 1 : nfds;
>> >>          }
>> >>
>> >> -        ret = select(nfds, &rsel, &wsel, NULL, NULL);
>> >> +        ret = select(nfds, &rsel, &wsel, NULL, &wait);
>> >>          if (ret < 0)
>> >>              goto out_err;
>> >> +        if (ret == 0) {
>> >> +            timeout = 1;
>> >> +            continue;
>> >> +        }
>> >> +        timeout = 0;
>> >>
>> >>          /* Input from xenconsole, read xenconsoled_fd, write 
>> >> bootloader_fd */
>> >>          if (FD_ISSET(xenconsoled_fd, &rsel)) {
>> >> +            if (xenconsoled_prod == XENCONSOLED_BUF_SIZE) {
>> >> +                if (ioctl(xenconsoled_fd, FIONREAD, &read_ahead) < 0)
>> >
>> > I think we can avoid this as described above, but if not then you need
>> > to be wary of the case where read_ahead > XENCONSOLED_BUF_SIZE.
>>
>> Yes, I've also missed that one, this should be checked to avoid
>> passing a negative integer to read or moving memory regions outside of
>> the buffer.
>>
>> >> +                    goto out_err;
>> >> +                memmove(xenconsoled_buf, &xenconsoled_buf[read_ahead], 
>> >> XENCONSOLED_BUF_SIZE - read_ahead);
>> >> +                xenconsoled_prod -= read_ahead;
>> >> +            }
>> >>              ret = read(xenconsoled_fd, 
>> >> &xenconsoled_buf[xenconsoled_prod], XENCONSOLED_BUF_SIZE - 
>> >> xenconsoled_prod);
>> >>              if (ret < 0 && errno != EIO && errno != EAGAIN)
>> >>                  goto out_err;
>> >> @@ -230,6 +259,12 @@ static char * bootloader_interact(libxl_
>> >>
>> >>          /* Input from bootloader, read bootloader_fd, write 
>> >> xenconsoled_fd */
>> >>          if (FD_ISSET(bootloader_fd, &rsel)) {
>> >> +            if (bootloader_prod == BOOTLOADER_BUF_SIZE) {
>> >> +                if (ioctl(bootloader_fd, FIONREAD, &read_ahead) < 0)
>> >> +                    goto out_err;
>> >> +                memmove(bootloader_buf, &bootloader_buf[read_ahead], 
>> >> BOOTLOADER_BUF_SIZE - read_ahead);
>> >> +                bootloader_prod -= read_ahead;
>> >> +            }
>> >>              ret = read(bootloader_fd, &bootloader_buf[bootloader_prod], 
>> >> BOOTLOADER_BUF_SIZE - bootloader_prod);
>> >>              if (ret < 0 && errno != EIO && errno != EAGAIN)
>> >>                  goto out_err;
>> >
>> >
>> >
>>
>> I'm wrapping another patch which I will send right now.
>
>
>

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel