From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 4565 invoked by alias); 25 Sep 2007 18:33:18 -0000 Received: (qmail 4557 invoked by uid 22791); 25 Sep 2007 18:33:18 -0000 X-Spam-Check-By: sourceware.org Received: from mx1.redhat.com (HELO mx1.redhat.com) (66.187.233.31) by sourceware.org (qpsmtpd/0.31) with ESMTP; Tue, 25 Sep 2007 18:33:14 +0000 Received: from int-mx1.corp.redhat.com (int-mx1.corp.redhat.com [172.16.52.254]) by mx1.redhat.com (8.13.1/8.13.1) with ESMTP id l8PIXC64025980 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 25 Sep 2007 14:33:12 -0400 Received: from pobox.toronto.redhat.com (pobox.toronto.redhat.com [172.16.14.4]) by int-mx1.corp.redhat.com (8.13.1/8.13.1) with ESMTP id l8PIXCQo012249; Tue, 25 Sep 2007 14:33:12 -0400 Received: from tortoise.toronto.redhat.com (tortoise.toronto.redhat.com [172.16.14.92]) by pobox.toronto.redhat.com (8.12.11.20060308/8.12.11) with ESMTP id l8PIXAtA016425; Tue, 25 Sep 2007 14:33:11 -0400 Message-ID: <46F95466.7070700@redhat.com> Date: Tue, 25 Sep 2007 18:33:00 -0000 From: Thomas Fitzsimmons User-Agent: Thunderbird 2.0.0.5 (X11/20070719) MIME-Version: 1.0 To: David Herron CC: =?UTF-8?B?U3RldmUgTWNLYXnimIQ=?= , mauve-discuss@sources.redhat.com Subject: Re: Tweaking default java.awt.Robot settings References: <4f2ee4520709241331o1a77379cudffb314dc1622914@mail.gmail.com> <46F8238C.8020606@sun.com> In-Reply-To: <46F8238C.8020606@sun.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-IsSubscribed: yes Mailing-List: contact mauve-discuss-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: mauve-discuss-owner@sourceware.org X-SW-Source: 2007-q3/txt/msg00028.txt.bz2 David Herron wrote: > Steve McKay☄ wrote: >> Hi All, >> >> I've noticed that at least some of the tests using java.awt.Robot are >> non-deterministic due to lags is the underlying window system. The >> java.awt.Component.keyPressTest, for example, fails some of the time >> (on linux, windows, linux+wine, ...). It looks like enabling >> autoWaitForIdle (waits for the awt EventQueue to be empty before >> adding new events to the queue), and setting autoDelay (pauses for an >> arbitrary period of time) to some magic number of millis well above >> zero (I use 100) significantly reduces failures. Would anyone object >> to configuring the Robot with settings like this by default? If no, >> should the config mechanism be updated to allow tweaking these >> settings? >> >> > > I don't know what the classpath implementation of Robot looks like, but > I do know what Sun's Linux/Unix implementation looks like (having > written the original version). It uses the XTEST extension. > > Generally Robot has to request the OS or X11 to synthesize the event. > On Windows there's a direct API call, while on Unix/Linux there is a > child process which ends up calling XTEST extension methods. In both > cases it means there is a nondeterministic delay due to the current > process scheduling characteristics of the given system. In other words > it depends on an external entity, who Robot cannot coerce into > performing the request within a bounded set of time. > > I think that means depending on Robot doing it's thing within a given > period of time is an invalid test. Interesting... > Robot does not add events to EventQueue but it requests the OS to > synthesize an OS-level event. How has Sun implemented GUI testing? When I was considering how to do GUI testing in Mauve, I considered the EventQueue-posting approach, but decided on a Robot-based approach instead. I thought Robot tests would be more realistic, testing things like window manager interactions and the native peers' event processing code. I knew Robot tests would be more fragile, but I assumed that we could compensate for the fragility: e.g. fix timing problems by introducing delays, as Steve has proposed. Did Sun experiment with Robot tests, then abandon them? If Robot can't be counted on to do something within some time delay, is it also useless in non-test applications? I've always wondered how the TCK certified AWT and Swing functionality. Does it use EventQueue-posting? Tom