Re: [Consult] tile: How to construct testsuite for tile architecture without hardware.

[Chen Gang <xili_gchen_5257@hotmail.com>]

Hello all:

After fix one qemu issue about floating point insns, correct the related
environments (make some symbol links), and reconfig building options (so
support g++), the current gcc testsuite result are:

                === gcc Summary ===

# of expected passes            78156
# of unexpected failures        98
# of unexpected successes       1
# of expected failures          120
# of unresolved testcases       1
# of unsupported tests          1384

                === g++ Summary ===

# of expected passes            83999
# of unexpected failures        78
# of unexpected successes       2
# of expected failures          277
# of unsupported tests          3568

[root@localhost build-gcc-tile]# gcc/xgcc -v
Using built-in specs.
COLLECT_GCC=gcc/xgcc
Target: tilegx-gchen-linux
Configured with: ../gcc/configure --target=tilegx-gchen-linux --disable-nls --enable-languages=c,c++ --enable-threads --enable-shared --enable-libssp --prefix=/upstream/release-tile --with-headers=/upstream/release-tile/include --with-sysroot=/upstream/release-tile --disable-multilib --disable-libquadmath --disable-libgomp --disable-libatomic
Thread model: posix
gcc version 6.0.0 20151012 (experimental) (GCC) 
[root@localhost build-gcc-tile]# gcc/xg++ -v
Using built-in specs.
COLLECT_GCC=gcc/xg++
Target: tilegx-gchen-linux
Configured with: ../gcc/configure --target=tilegx-gchen-linux --disable-nls --enable-languages=c,c++ --enable-threads --enable-shared --enable-libssp --prefix=/upstream/release-tile --with-headers=/upstream/release-tile/include --with-sysroot=/upstream/release-tile --disable-multilib --disable-libquadmath --disable-libgomp --disable-libatomic
Thread model: posix
gcc version 6.0.0 20151012 (experimental) (GCC)



Welcome any ideas, suggestions, and completions.

Thanks.


On 10/17/15 14:39, Chen Gang wrote:
> 
> After rebuild gcc/binutils with the latest code and correct the building
> config parameters, the gcc testsuite result is:
> 
>                 === gcc Summary ===
> 
> # of expected passes            77855
> # of unexpected failures        162
> # of unexpected successes       1
> # of expected failures          120
> # of unresolved testcases       131
> # of unsupported tests          1477
> 
> root@localhost tile]# /upstream/release-tile/bin/tilegx-gchen-linux-gcc -v
> Using built-in specs.
> COLLECT_GCC=/upstream/release-tile/bin/tilegx-gchen-linux-gcc
> COLLECT_LTO_WRAPPER=/upstream/release-tile/libexec/gcc/tilegx-gchen-linux/6.0.0/lto-wrapper
> Target: tilegx-gchen-linux
> Configured with: ../gcc/configure --target=tilegx-gchen-linux --disable-nls --enable-languages=c --enable-threads --enable-shared --enable-libssp --prefix=/upstream/release-tile --with-headers=/upstream/release-tile/include --with-sysroot=/upstream/release-tile --disable-multilib
> Thread model: posix
> gcc version 6.0.0 20151012 (experimental) (GCC) 
> 
> Welcome any members' ideas, suggestions, and completions.
> 
> 
> Thanks.
> 
> 
> On 10/5/15 19:59, Chen Gang wrote:
>> After fix the tillegx qemu's fsingle floating point insns issue, the gcc test suite result is:
>>
>> 		=== gcc Summary ===
>>
>> # of expected passes		77272
>> # of unexpected failures	365
>> # of unexpected successes	7
>> # of expected failures		113
>> # of unresolved testcases	141
>> # of unsupported tests		1476
>>
>> And I shall continue to analyze the left issues, next. :-)
>>
>>
>> Thanks.
>> --
>> Chen Gang
>>
>> Open, share, and attitude like air, water, and life which God blessed
>>
>>
>> ----------------------------------------
>>> From: xili_gchen_5257@hotmail.com
>>> To: cmetcalf@ezchip.com; walt@tilera.com
>>> CC: law@redhat.com; gcc-help@gcc.gnu.org; mikestump@comcast.net; eager@eagerm.com; rth@redhat.com; peter.maydell@linaro.org; afaerber@suse.de; rth@twiddle.net
>>> Subject: RE: [Consult] tile: How to construct testsuite for tile architecture without hardware.
>>> Date: Sun, 4 Oct 2015 19:55:44 +0800
>>>
>>> After finish additional 7 qemu patches, our tilegx qemu can test the gcc
>>> testsuite successfully (no any unimplementation issues). The test result
>>> is:
>>>
>>> === gcc Summary ===
>>>
>>> # of expected passes 77012
>>> # of unexpected failures 622
>>> # of unexpected successes 7
>>> # of expected failures 113
>>> # of unresolved testcases 143
>>> # of unsupported tests 1476
>>>
>>>
>>> For the 622 left issues:
>>>
>>> - Maybe still tilegx implementation issue, e.g.
>>>
>>> the floating point single mul instruction cann't get the result which
>>> tilegx gcc expected (it is only related with calculating: float32_mul
>>> calculation result is not match tilegx gcc expected).
>>>
>>> - Maybe envorintments configuration issues, e.g.
>>>
>>> for gcc guality_check, it may call gdb outside, so I need config the
>>> related gdb correctlly.
>>>
>>> - Maybe tilegx gcc issues, e.g.
>>>
>>> for some UNKNOWN instructions, probably generated by incorrect jump
>>> instructions, one sample is "-fpic -mcmodel=large" for gcc nested-5
>>> test.
>>>
>>> Next, I shall:
>>>
>>> - continue to fix the left 622 issues, and send related patches to
>>> qemu-devel mailing list or gcc-patches mailing list.
>>>
>>> - then rewrite floating point instructions, and try to let the related
>>> code merged into qemu mainline with qemu members' help (at present,
>>> floating point implementation is a temporary implementation).
>>>
>>> - at last, try to finish all left unimplemented instructions (there are
>>> still some unimplement insns left, but at present, gcc testsuite does
>>> not use them), and start tilegx qemu system mode, next.
>>>
>>>
>>> Welcome any members' ideas, suggestion, and completions. :-)
>>>
>>>
>>> Thanks.
>>>
>>> Chen Gang
>>>
>>> Open, share, and attitude like air, water, and life which God blessed
>>>
>>>
>>> ----------------------------------------
>>>> Date: Thu, 1 Oct 2015 12:12:48 +0800
>>>> From: xili_gchen_5257@hotmail.com
>>>> To: cmetcalf@ezchip.com; walt@tilera.com
>>>> CC: law@redhat.com; gcc-help@gcc.gnu.org; mikestump@comcast.net; eager@eagerm.com; rth@redhat.com; peter.maydell@linaro.org; afaerber@suse.de; rth@twiddle.net
>>>> Subject: Re: [Consult] tile: How to construct testsuite for tile architecture without hardware.
>>>>
>>>>
>>>> At present, tilegx is integrated into qemu master branch successfully
>>>> with the much help by qemu members.
>>>>
>>>> But sorry, I did not finish gcc testsuite in time, the main excuse is
>>>>
>>>> - I am busy on the normal work -- sometimes, have to do overtime work.
>>>> (my company started up an urgent project, but couldn't find suitable
>>>> persons for it in short time, so I have to do it during these days).
>>>>
>>>> Next, in Chinese National Day, I have enough free time resources on open
>>>> source, hope I finish our gcc testsuite within Chinese National Day (it
>>>> is from 2015-10-01 -- 2015-10-07).
>>>>
>>>> Thanks.
>>>>
>>>> On 8/30/15 11:50, Chen Gang wrote:
>>>>>
>>>>> Oh, sorry again, I did not finish qemu test within this month, again.
>>>>> Current status is:
>>>>>
>>>>> === gcc Summary ===
>>>>>
>>>>> # of expected passes 76725
>>>>> # of unexpected failures 790
>>>>> # of unexpected successes 7
>>>>> # of expected failures 113
>>>>> # of unresolved testcases 142
>>>>> # of unsupported tests 1483
>>>>>
>>>>>
>>>>> My main excuses are:
>>>>>
>>>>> - We are lack of tilegx floating point insns related documents, we have
>>>>> to 'guess' implementation details. At last, we found ways to process
>>>>> it (we spent more than a half month free time resources for it).
>>>>>
>>>>> - My related qemu code need be refactor before merging into qemu master
>>>>> tree. At present, we are refactoring and merging tilegx code to qemu
>>>>> master tree (mainly by qemu related members).
>>>>>
>>>>> Hope I can finish qemu tilegx gcc testsuite within next month (I guess,
>>>>> it should be done in time).
>>>>>
>>>>> - Test the refactored and merged code again, based on it, I continue to
>>>>> fix gcc testsuite related issues.
>>>>>
>>>>> - Fix all 700+ gcc testsuite issues (10+ for pending issues, and the
>>>>> others are for UN-implementation insns issues, I guess).
>>>>>
>>>>>
>>>>> Thanks.
>>>>>
>>>>>
>>>>> On 7/30/15 05:01, Chen Gang wrote:
>>>>>> On 7/20/15 06:26, Chen Gang wrote:
>>>>>>> Hello all:
>>>>>>>
>>>>>>> At present (after a half year), with the much help of QEMU members,
>>>>>>> tilegx linux-user can work (manually using busybox's sh, ls, cp, mv, vi
>>>>>>> are OK).
>>>>>>>
>>>>>>> Next, I shall start gcc testsuite with qemu tilegx linux-user, hope I
>>>>>>> can finish within this month (2015-07-31).
>>>>>>>
>>>>>>
>>>>>> Sorry, I can not finish the qemu test within this month. The reason is
>>>>>> my tilegx qemu is still lack of some instructions implementation, next,
>>>>>> I should finish them firstly (I implemented most insns, but not all).
>>>>>>
>>>>>> === gcc Summary ===
>>>>>>
>>>>>> # of expected passes 69830
>>>>>> # of unexpected failures 4312
>>>>>> # of unexpected successes 2
>>>>>> # of expected failures 108
>>>>>> # of unresolved testcases 1776
>>>>>> # of unsupported tests 1567
>>>>>>
>>>>>> More than 4K failures are because tilegx qemu lacks of instruction's
>>>>>> implementation, and also more than 10 issues are for TIMEOUT (I guess,
>>>>>> my original tilegx qemu instruction's implementation still has bugs).
>>>>>>
>>>>>> I shall try to finish it within next month, although I am not quite sure
>>>>>> (it needs enough time resources on it, but I am lack of time resources:
>>>>>> I can only spend less 1 hour per work day and 2 hours per week end day).
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>>> Thanks.
>>>>>>>
>>>>>>> On 1/24/15 21:31, Chen Gang S wrote:
>>>>>>>> Hello Maintainers:
>>>>>>>>
>>>>>>>> The result of gcc testsuite for tile without qemu is below, I guess the
>>>>>>>> environments construction is OK:
>>>>>>>>
>>>>>>>> === gcc Summary ===
>>>>>>>>
>>>>>>>> # of expected passes 66650
>>>>>>>> # of unexpected failures 42
>>>>>>>> # of unexpected successes 1
>>>>>>>> # of expected failures 107
>>>>>>>> # of unresolved testcases 16558
>>>>>>>> # of unsupported tests 1771
>>>>>>>>
>>>>>>>> Based on normal testsuite and microblaze testsuite configuration, it is
>>>>>>>> easy to config gcc testsuite for tile. Thank gcc testsuit member and
>>>>>>>> microblaze member very much. :-)
>>>>>>>>
>>>>>>>> - Copy the original microblaze exp file as tile exp file. Export tile
>>>>>>>> ip to /etc/hosts.
>>>>>>>>
>>>>>>>> - Change the related compiler name and related patch to tile in tile
>>>>>>>> exp file.
>>>>>>>>
>>>>>>>> - Use tile cflag "-m64 -mcpu=tilegx -mcmodel=large -mlittle-endian"
>>>>>>>> instead of the original microblaze cflag, in tile exp file.
>>>>>>>>
>>>>>>>> If OK, I shall try to make a tile patch within this month. Next month,
>>>>>>>> I shall start tile qemu (I am preparing for it within this month). After
>>>>>>>> communicate with qemu members, I guess, it is possible to finish it.
>>>>>>>>
>>>>>>>>
>>>>>>>> Welcome any ideas, suggestions, and completions.
>>>>>>>>
>>>>>>>> Thanks.
>>>>>>>>
>>>>>>>> On 1/20/15 10:02, Chen Gang S wrote:
>>>>>>>>> On 1/20/15 00:10, Chris Metcalf wrote:
>>>>>>>>>> On 1/17/2015 4:52 AM, Chen Gang S wrote:
>>>>>>>>>>> Hello Maintainers:
>>>>>>>>>>>
>>>>>>>>>>> I am trying to make gcc patches for tile, and need testsuite without
>>>>>>>>>>> related hardware, so I consult:
>>>>>>>>>>
>>>>>>>>>> Unfortunately, at the current time, the simulator is only available as part of the commercial Multicore Development Environment package. A qemu port for tile hardware would certainly be welcome, but to my knowledge, no one has completed such a port yet. ISA and ABI documentation for tilegx are available at www.tilera.com/scm.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> OK, thank you very much, and the documentation is really valuable to me.
>>>>>>>>>
>>>>>>>>> After finish gcc tile testsuite (hope I can finish within this month),
>>>>>>>>> I shall continue for tile qemu, I should try my best for it, hope I can
>>>>>>>>> finish: "can run gcc testsuite with the tile qemu".
>>>>>>>>>
>>>>>>>>> At present, it is really very hard to me, but for me, it is my duty (I
>>>>>>>>> met it, and it was within my original boarder).
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> For me, nothing is impossible, if God blessed.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> Thanks.
>>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> Chen Gang
>>>>>
>>>>> Open, share, and attitude like air, water, and life which God blessed
>>>>>
>>>>>
>>>>
>>>> --
>>>> Chen Gang (陈刚)
>>>>
>>>> Open, share, and attitude like air, water, and life which God blessed
>>>
>>  		 	   		  
>>
> 

-- 
Chen Gang (陈刚)

Open, share, and attitude like air, water, and life which God blessed