eCos and RedBoot test farm

eCos and RedBoot test farm

[Alex Schuilenburg]

Hi Folks

Just to follow up all the conversations at FOSDEM about an eCos and 
RedBoot test farm for the benefit of those not present.

eCosCentric are in the progress of rebuilding the eCos and RedBoot test 
farm. This test farm will be similar to the one that was available at 
Red Hat (only better ;-). As such, this test farm will be used to 
validate eCos and RedBoot builds as well as execution of binaries.

Naturally the eCos and RedBoot maintainers within eCosCetric will derive 
a lot of benefit from this and I would also like to make this test farm 
freely available to *all* eCos and RedBoot maintainers but for 
non-commercial use only.  The farm will of course also be made available 
for commercial use (e.g. validation of ports etc), but this kind of use 
will have to be paid for to help maintain the farm.

(For the benefit of lurkers, it was almost a full time job maintaining 
the old test farm - burning in new RedBoots, replacing/fixing 
unresponsive boards, etc etc)

To clarify non-commercial use, only the results of builds and test runs 
for public and sponsored boards will be published on the web (for all to 
read). This will allow all the maintainers equal opportunity to validate 
new or contributed code to public or sponsored boards. Also, only 
maintainers will be allowed access to the boards in the farm, they will 
not be public resources.  The farm will also be capable of 
driving/testing boards at remote sites, but again this will only be 
permitted for non-commercial purposes only.

As stated previously, the intention is to provide a free resource to the 
maintainers to allow them to identify and fix problems, test/verify 
contributions, etc for eCos and RedBoot.  Test results will also be made 
public for the subset of public and sponsored boards running in the farm.

Andrew, Gary and Mark - please let me know if you are interested in 
having access to such a facility or have any problems, suggestions etc 
with our offer.

It is eCosCentric's intention to use the test farm to certify their 
paying customers' ports as well as to make the farm available 
commercially for other commercial organisations to use, if there is 
sufficient interest. The test farm will be housed in one of Paul's sheds 
and eCosCentric will be paying for the net connection, etc, so the 
service will cost us money to provide. However, by having board sponsors 
and commercial customers we hope to meet these costs. Obviously no 
guarantees on the availability of boards can be made as well as the test 
farm - as can be expected with embedded hardware etc.

Cheers
-- Alex

Re: eCos and RedBoot test farm

[Andrew Lunn]

> Andrew, Gary and Mark - please let me know if you are interested in 
> having access to such a facility or have any problems, suggestions etc 
> with our offer.

Yes please. 

One suggestion. Make access to it firewall friendly. Outgoing SSH and
https get through Ascom's firewall, but not a lot else. Incoming it
totally blocked.
 
        Andrew

Re: eCos and RedBoot test farm

[Alex Schuilenburg]

Andrew Lunn wrote:
>>Andrew, Gary and Mark - please let me know if you are interested in 
>>having access to such a facility or have any problems, suggestions etc 
>>with our offer.
> 
> 
> Yes please. 
> 
> One suggestion. Make access to it firewall friendly. Outgoing SSH and
> https get through Ascom's firewall, but not a lot else. Incoming it
> totally blocked.

Yup, remote access to the farm will only be through SSH and SSH tunnels 
(and reverse tunnels for remote h/w), although test results will be 
available via http and controlling builds etc via https.

Cheers
-- Alex

Re: eCos and RedBoot test farm

[Gary Thomas]

On Thu, 2003-02-13 at 02:30, Andrew Lunn wrote:
> > Andrew, Gary and Mark - please let me know if you are interested in 
> > having access to such a facility or have any problems, suggestions etc 
> > with our offer.
> 
> Yes please. 
> 
> One suggestion. Make access to it firewall friendly. Outgoing SSH and
> https get through Ascom's firewall, but not a lot else. Incoming it
> totally blocked.

Moi, aussi, merci :-)

SSH is the only way to go as far as I'm concerned as well.

Alex, what sort of hardware do you have available?
I'm building up quite a set here, and if the infrastructure was
such that it can easily run outside of Cambridge, I'd be interested
in supporting what I can here.

-- 
------------------------------------------------------------
Gary Thomas                 |
MLB Associates              |  Consulting for the
+1 (970) 229-1963           |    Embedded world
http://www.mlbassoc.com/    |
email: <gary@mlbassoc.com>  |
gpg: http://www.chez-thomas.org/gary/gpg_key.asc
------------------------------------------------------------

Re: eCos and RedBoot test farm

[Alex Schuilenburg]

Hi Gary

Gary Thomas wrote:
> On Thu, 2003-02-13 at 02:30, Andrew Lunn wrote:
> 
>>>Andrew, Gary and Mark - please let me know if you are interested in 
>>>having access to such a facility or have any problems, suggestions etc 
>>>with our offer.
>>
>>Yes please. 
>>
>>One suggestion. Make access to it firewall friendly. Outgoing SSH and
>>https get through Ascom's firewall, but not a lot else. Incoming it
>>totally blocked.
> 
> 
> Moi, aussi, merci :-)
> 
> SSH is the only way to go as far as I'm concerned as well.
> 
> Alex, what sort of hardware do you have available?

We probably have less h/w than you, but they are slowly coming in as the 
contracts come in.

The public boards we have are some MIPS & PPC boards, a Viper board, an 
iPAQ and hopefully will have some more ARM platforms (EBSA285, Assabet, 
etc) in the next couple of days.  I don't have a complete list of 
targets since the h/w is spread out a bit between the guys here and I 
have lost track a bit :-)

We still have to clean out Paul's shed and get the wireless connection 
working reliably before we can do that.


> I'm building up quite a set here, and if the infrastructure was
> such that it can easily run outside of Cambridge, I'd be interested
> in supporting what I can here.
> 

Thanks. The infra will be such that boards can be remote but builds and 
execution will be done from the farm so that results will be available 
in one place for all maintainers to see.  Traffic should still be 
minimal (gdb download via ssh tunnel) though debug speeds may be slow - 
but it should not matter much anyway as it will be automated.

We also intend to add the facility for complete email logs of test runs 
to be added (ala GUI config-tool) to the results to allow 
non-maintainers to submit results (e.g. contribs of h/w ports we/you 
dont have access to), say as a pre-requisite for a port being accepted.

The actual test farm infra (automated checkouts, perms, builds and 
executions) we intend to keep closed as it will be a commercial entity, 
hopefully earning enough money to keep itself ticking and pay the bills. 
  If it does not become profitable, then it may be open sourced later.

Cheers
-- Alex