[Bug lto/45375] New: Mozilla does not build with LTO

public inbox for gcc-bugs@sourceware.org
help / color / mirror / Atom feed

* [Bug lto/45375]  New: Mozilla does not build with LTO
@ 2010-08-22  9:38 hubicka at gcc dot gnu dot org
  2010-08-22 12:40 ` [Bug lto/45375] " hubicka at gcc dot gnu dot org
                   ` (7 more replies)
  0 siblings, 8 replies; 10+ messages in thread
From: hubicka at gcc dot gnu dot org @ 2010-08-22  9:38 UTC (permalink / raw)
  To: gcc-bugs

Metabug to track all the issues ;)


-- 
           Summary: Mozilla does not build with LTO
           Product: gcc
           Version: 4.6.0
            Status: UNCONFIRMED
          Severity: blocker
          Priority: P3
         Component: lto
        AssignedTo: unassigned at gcc dot gnu dot org
        ReportedBy: hubicka at gcc dot gnu dot org
GCC target triplet: x86_64-linux


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375


^ permalink raw reply	[flat|nested] 10+ messages in thread

* [Bug lto/45375] Mozilla does not build with LTO
  2010-08-22  9:38 [Bug lto/45375] New: Mozilla does not build with LTO hubicka at gcc dot gnu dot org
@ 2010-08-22 12:40 ` hubicka at gcc dot gnu dot org
  2010-08-22 12:43 ` hubicka at gcc dot gnu dot org
                   ` (6 subsequent siblings)
  7 siblings, 0 replies; 10+ messages in thread
From: hubicka at gcc dot gnu dot org @ 2010-08-22 12:40 UTC (permalink / raw)
  To: gcc-bugs



------- Comment #1 from hubicka at gcc dot gnu dot org  2010-08-22 12:39 -------
Quick summary :)
1) -g build is currently broken because of dwarf2out recursion. 
2) sqlite still gets miscompiled at 32bit (PR44897), but works now at 64bit for
some reason
3) Workaround attached to PR44846 is needed to avoid ICE due to one decl C++ FE
issues
4) 32bit mozilla now builds fine for me when linked with -O2, but -Os (the
default) leads to segfault at startup apparently because xpcom components do
not reproduce correctly
5) Older versions of gold seems to have issues. 
6) Martin's devirtualization seems to behave funny doing 7400 clones and the
redirecting just about 20 calls.
7) Both Martin and Taras reported ICE in lto-symtab I can't reproduce
8) Mozilla needs some changes, since __attribute__ ((used)) is missing. I will
attach diff.
9) One needs 4GB in /tmp, with sane partitioning this goes down to 1GB
10) 32bit build gets close to addressing space issues at WPA stage, probably we
should not mmap all the .o files, since only about 1GB goes to garbage
collected memory.


-- 

hubicka at gcc dot gnu dot org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |mjambor at suse dot cz
             Status|UNCONFIRMED                 |NEW
     Ever Confirmed|0                           |1
   Last reconfirmed|0000-00-00 00:00:00         |2010-08-22 12:40:00
               date|                            |


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375


^ permalink raw reply	[flat|nested] 10+ messages in thread

* [Bug lto/45375] Mozilla does not build with LTO
  2010-08-22  9:38 [Bug lto/45375] New: Mozilla does not build with LTO hubicka at gcc dot gnu dot org
  2010-08-22 12:40 ` [Bug lto/45375] " hubicka at gcc dot gnu dot org
@ 2010-08-22 12:43 ` hubicka at gcc dot gnu dot org
  2010-08-22 12:48 ` hubicka at gcc dot gnu dot org
                   ` (5 subsequent siblings)
  7 siblings, 0 replies; 10+ messages in thread
From: hubicka at gcc dot gnu dot org @ 2010-08-22 12:43 UTC (permalink / raw)
  To: gcc-bugs



------- Comment #2 from hubicka at gcc dot gnu dot org  2010-08-22 12:43 -------
Created an attachment (id=21543)
 --> (http://gcc.gnu.org/bugzilla/attachment.cgi?id=21543&action=view)
Mozilla changes needed.


-- 


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375


^ permalink raw reply	[flat|nested] 10+ messages in thread

* [Bug lto/45375] Mozilla does not build with LTO
  2010-08-22  9:38 [Bug lto/45375] New: Mozilla does not build with LTO hubicka at gcc dot gnu dot org
  2010-08-22 12:40 ` [Bug lto/45375] " hubicka at gcc dot gnu dot org
  2010-08-22 12:43 ` hubicka at gcc dot gnu dot org
@ 2010-08-22 12:48 ` hubicka at gcc dot gnu dot org
  2010-08-22 13:10 ` hubicka at gcc dot gnu dot org
                   ` (4 subsequent siblings)
  7 siblings, 0 replies; 10+ messages in thread
From: hubicka at gcc dot gnu dot org @ 2010-08-22 12:48 UTC (permalink / raw)
  To: gcc-bugs



------- Comment #3 from hubicka at gcc dot gnu dot org  2010-08-22 12:48 -------
mozconfig I use:
export CC="gcc -flto -fuse-linker-plugin"                                       
export CXX="g++ -fwhopr=24 -fuse-linker-plugin  -fpermissive"                   

#export CXX="/builds/slave/tryserver-linux/build/gcc/bin/g++ -fwhopr=16         
#-fuse-linker-plugin -static-libstdc++ -fpermissive"                            

ac_add_options --enable-application=browser                                     
ac_add_options --enable-libxul                                                  
#ac_add_options --enable-debug                                                  
ac_add_options --enable-optimize                                                
ac_add_options --disable-tests                                                  
#ac_add_options --enable-debug-symbols                                          
export LDFLAGS="-Wl,--no-keep-memory"                                           
mk_add_options MOZ_MAKE_FLAGS=-j24                                              
mk_add_options MOZ_OBJDIR=/build-mozilla-scratch-O1



-- 


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375


^ permalink raw reply	[flat|nested] 10+ messages in thread

* [Bug lto/45375] Mozilla does not build with LTO
  2010-08-22  9:38 [Bug lto/45375] New: Mozilla does not build with LTO hubicka at gcc dot gnu dot org
                   ` (2 preceding siblings ...)
  2010-08-22 12:48 ` hubicka at gcc dot gnu dot org
@ 2010-08-22 13:10 ` hubicka at gcc dot gnu dot org
  2010-08-25 10:55 ` [Bug lto/45375] [meta-bug] " pinskia at gcc dot gnu dot org
                   ` (3 subsequent siblings)
  7 siblings, 0 replies; 10+ messages in thread
From: hubicka at gcc dot gnu dot org @ 2010-08-22 13:10 UTC (permalink / raw)
  To: gcc-bugs



------- Comment #4 from hubicka at gcc dot gnu dot org  2010-08-22 13:10 -------
WPA stage profile after (with sane partitioning).  Decl reading and merging is
major issue.  I am surprised we are faster on streaming out than reading.
Execution times (seconds)
 garbage collection    :   5.71 ( 3%) usr   0.00 ( 0%) sys   5.72 ( 3%) wall   
   0 kB ( 0%) ggc
 callgraph optimization:   1.70 ( 1%) usr   0.00 ( 0%) sys   1.72 ( 1%) wall  
13488 kB ( 0%) ggc
 varpool construction  :   0.58 ( 0%) usr   0.01 ( 0%) sys   0.57 ( 0%) wall  
43924 kB ( 1%) ggc
 ipa cp                :   1.62 ( 1%) usr   0.02 ( 0%) sys   1.66 ( 1%) wall  
70914 kB ( 2%) ggc
 ipa lto gimple in     :   4.28 ( 2%) usr   0.33 ( 4%) sys   4.63 ( 2%) wall   
  15 kB ( 0%) ggc
 ipa lto gimple out    :   6.45 ( 3%) usr   0.33 ( 4%) sys   6.74 ( 3%) wall   
   0 kB ( 0%) ggc
 ipa lto decl in       :  48.34 (26%) usr   1.93 (23%) sys  50.30 (26%) wall
3021266 kB (87%) ggc
 ipa lto decl out      :  40.53 (22%) usr   0.19 ( 2%) sys  40.75 (21%) wall   
   0 kB ( 0%) ggc
 ipa lto decl init I/O :   1.03 ( 1%) usr   0.06 ( 1%) sys   1.08 ( 1%) wall  
77094 kB ( 2%) ggc
 ipa lto cgraph I/O    :   0.94 ( 1%) usr   0.21 ( 3%) sys   1.15 ( 1%) wall 
237872 kB ( 7%) ggc
 ipa lto decl merge    :  45.14 (24%) usr   1.08 (13%) sys  46.23 (24%) wall   
 273 kB ( 0%) ggc
 ipa lto cgraph merge  :   0.89 ( 0%) usr   0.00 ( 0%) sys   0.89 ( 0%) wall   
5164 kB ( 0%) ggc
 whopr wpa             :   2.38 ( 1%) usr   0.04 ( 0%) sys   2.41 ( 1%) wall   
   1 kB ( 0%) ggc
 whopr wpa I/O         :   3.08 ( 2%) usr   3.97 (48%) sys   7.38 ( 4%) wall   
   0 kB ( 0%) ggc
 ipa reference         :   1.55 ( 1%) usr   0.00 ( 0%) sys   1.59 ( 1%) wall   
   0 kB ( 0%) ggc
 ipa profile           :   0.19 ( 0%) usr   0.00 ( 0%) sys   0.18 ( 0%) wall   
   0 kB ( 0%) ggc
 ipa pure const        :   1.05 ( 1%) usr   0.00 ( 0%) sys   1.04 ( 1%) wall   
   0 kB ( 0%) ggc
 parser                :   0.58 ( 0%) usr   0.00 ( 0%) sys   0.58 ( 0%) wall  
17738 kB ( 1%) ggc
 inline heuristics     :  15.73 ( 8%) usr   0.00 ( 0%) sys  15.74 ( 8%) wall   
2974 kB ( 0%) ggc
 callgraph verifier    :   2.56 ( 1%) usr   0.02 ( 0%) sys   2.59 ( 1%) wall   
   0 kB ( 0%) ggc
 varconst              :   0.01 ( 0%) usr   0.02 ( 0%) sys   0.02 ( 0%) wall   
   0 kB ( 0%) ggc
 TOTAL                 : 186.41             8.27           195.10           
3491946 kB


-- 

hubicka at gcc dot gnu dot org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  BugsThisDependsOn|44871                       |


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375


^ permalink raw reply	[flat|nested] 10+ messages in thread

* [Bug lto/45375] [meta-bug] Mozilla does not build with LTO
  2010-08-22  9:38 [Bug lto/45375] New: Mozilla does not build with LTO hubicka at gcc dot gnu dot org
                   ` (3 preceding siblings ...)
  2010-08-22 13:10 ` hubicka at gcc dot gnu dot org
@ 2010-08-25 10:55 ` pinskia at gcc dot gnu dot org
  2010-09-04 20:39 ` hubicka at gcc dot gnu dot org
                   ` (2 subsequent siblings)
  7 siblings, 0 replies; 10+ messages in thread
From: pinskia at gcc dot gnu dot org @ 2010-08-25 10:55 UTC (permalink / raw)
  To: gcc-bugs



-- 

pinskia at gcc dot gnu dot org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Severity|blocker                     |normal
           Keywords|                            |meta-bug
            Summary|Mozilla does not build with |[meta-bug] Mozilla does not
                   |LTO                         |build with LTO


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375


^ permalink raw reply	[flat|nested] 10+ messages in thread

* [Bug lto/45375] [meta-bug] Mozilla does not build with LTO
  2010-08-22  9:38 [Bug lto/45375] New: Mozilla does not build with LTO hubicka at gcc dot gnu dot org
                   ` (4 preceding siblings ...)
  2010-08-25 10:55 ` [Bug lto/45375] [meta-bug] " pinskia at gcc dot gnu dot org
@ 2010-09-04 20:39 ` hubicka at gcc dot gnu dot org
  2010-09-16 12:09 ` hubicka at gcc dot gnu dot org
  2010-09-17  0:28 ` hubicka at gcc dot gnu dot org
  7 siblings, 0 replies; 10+ messages in thread
From: hubicka at gcc dot gnu dot org @ 2010-09-04 20:39 UTC (permalink / raw)
  To: gcc-bugs



------- Comment #5 from hubicka at gcc dot gnu dot org  2010-09-04 20:39 -------
Oprofile of WHOPR build.  It is quite suprrising how low the usual cpu hogs
shows..
113909    7.6329  lto1                     lto1                    
htab_find_slot_with_hash
42787     2.8671  libc-2.11.1.so           libc-2.11.1.so           _int_malloc
36514     2.4468  lto1                     lto1                    
iterative_hash_hashval_t
36289     2.4317  libelf.so.0.8.12         libelf.so.0.8.12        
/usr/lib64/libelf.so.0.8.12
28366     1.9008  lto1                     lto1                     htab_expand
27648     1.8527  libc-2.11.1.so           libc-2.11.1.so           memset
27045     1.8123  lto1                     lto1                    
cgraph_edge_badness
26670     1.7871  lto1                     lto1                    
inflate_fast
25955     1.7392  lto1                     lto1                    
lto_input_tree
20010     1.3408  lto1                     lto1                    
lto_input_uleb128
18853     1.2633  lto1                     lto1                    
bitmap_set_bit
16452     1.1024  as                       as                       /usr/bin/as
16215     1.0865  lto1                     lto1                    
lto_input_1_unsigned
16141     1.0816  lto1                     lto1                    
lto_output_1_stream
15244     1.0215  libc-2.11.1.so           libc-2.11.1.so           memcpy
15241     1.0213  lto1                     lto1                    
htab_hash_string
13806     0.9251  lto1                     lto1                    
record_reg_classes.constprop.10
13743     0.9209  lto1                     lto1                    
lto_output_tree
13220     0.8859  lto1                     lto1                    
ggc_internal_alloc_stat
12879     0.8630  libc-2.11.1.so           libc-2.11.1.so          
malloc_consolidate
12847     0.8609  libc-2.11.1.so           libc-2.11.1.so           _int_free
11712     0.7848  lto1                     lto1                    
lto_streamer_cache_insert_1
11593     0.7768  lto1                     lto1                    
linemap_lookup
11100     0.7438  lto1                     lto1                    
ht_lookup_with_hash
10837     0.7262  lto1                     lto1                     gtc_visit
10460     0.7009  lto1                     lto1                    
cgraph_estimate_growth
10438     0.6994  lto1                     lto1                    
value_member
9812      0.6575  lto1                     lto1                     walk_tree_1
9316      0.6243  oprofiled                oprofiled               
/usr/bin/oprofiled
8979      0.6017  libc-2.11.1.so           libc-2.11.1.so           malloc
8825      0.5914  libc-2.11.1.so           libc-2.11.1.so           free
8625      0.5780  lto1                     lto1                    
pointer_set_insert
8304      0.5564  lto1                     lto1                    
ggc_set_mark
8276      0.5546  lto1                     lto1                    
type_pair_eq
8089      0.5420  lto1                     lto1                    
gimple_types_compatible_p_1
7981      0.5348  lto1                     lto1                    
lto_output_uleb128_stream
7388      0.4951  lto1                     lto1                    
df_note_compute
7349      0.4924  lto1                     lto1                    
operand_equal_p
7349      0.4924  lto1                     lto1                    
pointer_map_contains
7117      0.4769  lto1                     lto1                    
bitmap_bit_p
7067      0.4736  lto1                     lto1                     pool_alloc
7030      0.4711  lto1                     lto1                    
verify_cgraph_node
6954      0.4660  lto1                     lto1                    
lto_input_sleb128
6947      0.4655  lto1                     lto1                    
gt_ggc_mx_lang_tree_node
6747      0.4521  libc-2.11.1.so           libc-2.11.1.so           calloc
6403      0.4291  lto1                     lto1                     htab_delete
6360      0.4262  lto1                     lto1                    
constrain_operands.part.12
6198      0.4153  lto1                     lto1                    
bitmap_clear_bit
6103      0.4090  lto1                     lto1                     cse_insn


-- 


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375


^ permalink raw reply	[flat|nested] 10+ messages in thread

* [Bug lto/45375] [meta-bug] Mozilla does not build with LTO
  2010-08-22  9:38 [Bug lto/45375] New: Mozilla does not build with LTO hubicka at gcc dot gnu dot org
                   ` (5 preceding siblings ...)
  2010-09-04 20:39 ` hubicka at gcc dot gnu dot org
@ 2010-09-16 12:09 ` hubicka at gcc dot gnu dot org
  2010-09-17  0:28 ` hubicka at gcc dot gnu dot org
  7 siblings, 0 replies; 10+ messages in thread
From: hubicka at gcc dot gnu dot org @ 2010-09-16 12:09 UTC (permalink / raw)
  To: gcc-bugs



------- Comment #6 from hubicka at gcc dot gnu dot org  2010-09-16 12:09 -------
PR 45679 also reproduce during -O3 build.  I am testing patch for it now.


-- 

hubicka at gcc dot gnu dot org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  BugsThisDependsOn|                            |45679


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375


^ permalink raw reply	[flat|nested] 10+ messages in thread

* [Bug lto/45375] [meta-bug] Mozilla does not build with LTO
  2010-08-22  9:38 [Bug lto/45375] New: Mozilla does not build with LTO hubicka at gcc dot gnu dot org
                   ` (6 preceding siblings ...)
  2010-09-16 12:09 ` hubicka at gcc dot gnu dot org
@ 2010-09-17  0:28 ` hubicka at gcc dot gnu dot org
  7 siblings, 0 replies; 10+ messages in thread
From: hubicka at gcc dot gnu dot org @ 2010-09-17  0:28 UTC (permalink / raw)
  To: gcc-bugs



------- Comment #7 from hubicka at gcc dot gnu dot org  2010-09-17 00:28 -------
Gold shipped with SLES:
GNU gold (GNU Binutils; SUSE Linux Enterprise 11 2.20.0.20100122-0.7.9) 1.
is known to have problems leading to PR45194

The following version: GNU gold (GNU Binutils 2.20.51.20100706) 1.9
works for me.


-- 


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375


^ permalink raw reply	[flat|nested] 10+ messages in thread

[parent not found: <bug-45375-4@http.gcc.gnu.org/bugzilla/>]

* [Bug lto/45375] [meta-bug] Mozilla does not build with LTO
       [not found] <bug-45375-4@http.gcc.gnu.org/bugzilla/>
@ 2010-10-15  1:29 ` hubicka at gcc dot gnu.org
  0 siblings, 0 replies; 10+ messages in thread
From: hubicka at gcc dot gnu.org @ 2010-10-15  1:29 UTC (permalink / raw)
  To: gcc-bugs

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=45375

--- Comment #8 from Jan Hubicka <hubicka at gcc dot gnu.org> 2010-10-15 01:29:38 UTC ---
Updated summary...

 - Last patch needed to get Mozilla working is posted as
http://gcc.gnu.org/ml/gcc-patches/2010-10/msg01286.html
 - Configuration needs to be done with -fwhopr for C++ and -flto for C, to get
around sqlite problem (PR44897)
 - Debugging still needs to be disabled
 - Recent Gold is needed

 - Peak memory use is about 4GB, still more than we should need.  It is WPA
stage having too many declarations in it.
 - We probably could do better on devirtualization in constructors for addref.

With -O3 --param inline-unit-growth -fwhopr=jobserv the code size seems
comparable with non-LTO -Os build, speed with non-LTO -O3 build.  This seems
quite good news.

Lacking debug info build seems to be the only remaining showstopper for
practical use.


^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2010-10-15  1:29 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2010-08-22  9:38 [Bug lto/45375] New: Mozilla does not build with LTO hubicka at gcc dot gnu dot org
2010-08-22 12:40 ` [Bug lto/45375] " hubicka at gcc dot gnu dot org
2010-08-22 12:43 ` hubicka at gcc dot gnu dot org
2010-08-22 12:48 ` hubicka at gcc dot gnu dot org
2010-08-22 13:10 ` hubicka at gcc dot gnu dot org
2010-08-25 10:55 ` [Bug lto/45375] [meta-bug] " pinskia at gcc dot gnu dot org
2010-09-04 20:39 ` hubicka at gcc dot gnu dot org
2010-09-16 12:09 ` hubicka at gcc dot gnu dot org
2010-09-17  0:28 ` hubicka at gcc dot gnu dot org
     [not found] <bug-45375-4@http.gcc.gnu.org/bugzilla/>
2010-10-15  1:29 ` hubicka at gcc dot gnu.org

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).