libgccjit

libgccjit

[Ken Brown]

Emacs development (on the feature/native-comp branch) is using libgccjit.  Is it 
possible to build this library on Cygwin?

Ken

Re: libgccjit

[Corinna Vinschen]

On Mar 10 12:00, Ken Brown via Cygwin wrote:
> Emacs development (on the feature/native-comp branch) is using libgccjit.
> Is it possible to build this library on Cygwin?

Isn't this a question for Jon?  I CCed him.


Corinna

Re: libgccjit

[Jonathan Yong]

[-- Attachment #1.1.1: Type: text/plain, Size: 434 bytes --]

On 3/11/21 10:16 AM, Corinna Vinschen wrote:
> On Mar 10 12:00, Ken Brown via Cygwin wrote:
>> Emacs development (on the feature/native-comp branch) is using libgccjit.
>> Is it possible to build this library on Cygwin?
> 
> Isn't this a question for Jon?  I CCed him.
> 
> 
> Corinna
> 

I've not honestly tried setting up libgccjit, looks like its as simple 
as adding jit to --enable-languages.

Achim, mind trying?

[-- Attachment #1.1.2: OpenPGP public key --]
[-- Type: application/pgp-keys, Size: 8035 bytes --]

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

Re: libgccjit

[Achim Gratz]

Jonathan Yong via Cygwin writes:
> I've not honestly tried setting up libgccjit, looks like its as simple
> as adding jit to --enable-languages.
>
> Achim, mind trying?

That also needs --enable-host-shared and then it dies shortly after
configure because it can't find libiberty.a in $build_subdir which does
not exist.  The library itself is already made in the libiberty
directory, so some sort of install step went missing.  If I drop the
file there, it then proceeds to want the same thing in yet another
subdir.  Repeating the exercise gets me one step further after which it
looks for the same file in a third place…  dropping it there also seems
to get the compile rolling along, but there is clearly something
missing, either in configure or with the general handling of the target
triple.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

SD adaptations for KORG EX-800 and Poly-800MkII V0.9:
http://Synth.Stromeko.net/Downloads.html#KorgSDada

Re: libgccjit

[Achim Gratz]

Achim Gratz writes:
> That also needs --enable-host-shared and then it dies shortly after
> configure because it can't find libiberty.a in $build_subdir which does
> not exist.  The library itself is already made in the libiberty
> directory, so some sort of install step went missing.  If I drop the
> file there, it then proceeds to want the same thing in yet another
> subdir.  Repeating the exercise gets me one step further after which it
> looks for the same file in a third place…  dropping it there also seems
> to get the compile rolling along, but there is clearly something
> missing, either in configure or with the general handling of the target
> triple.

It removes one of those places and later expects to find libiberty.a
again there (plus for whatever reason can't run "make -j" from that
point on).  Monkey-fixing that and letting it move on finally gets me
to:

/mnt/share/cygpkgs/gcc/gcc.x86_64/build/./prev-gcc/xg++ -B/mnt/share/cygpkgs/gcc/gcc.x86_64/build/./prev-gcc/ -B/usr/x86_64-pc-cygwin/bin/ -nostdinc++ -B/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/src/.libs -B/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/libsupc++/.libs  -I/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/include/x86_64-pc-cygwin  -I/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/include  -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/libstdc++-v3/libsupc++ -L/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/src/.libs -L/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/libsupc++/.libs -fno-PIE -c  -DIN_GCC_FRONTEND -g -O2 -fno-checking -gtoggle -DIN_GCC -fPIC    -fno-exceptions -fno-rtti -fasynchronous-unwind-tables -W -Wall -Wno-narrowing -Wwrite-strings -Wcast-qual -Wno-error=format-diag -Wmissing-format-attribute -Woverloaded-virtual -pedantic -Wno-long-long -Wno-variadic-macros -Wno-overlength-strings   -DHAVE_CONFIG_H -I. -Ijit -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../include -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../libcpp/include  -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../libdecnumber -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../libdecnumber/bid -I../libdecnumber -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../libbacktrace   -o jit/jit-playback.o -MT jit/jit-playback.o -MMD -MP -MF jit/.deps/jit-playback.TPo /mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c
/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c: In member function ‘gcc::jit::result* gcc::jit::playback::context::dlopen_built_dso()’:
/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c:2652:3: error: ‘dlerror’ was not declared in this scope; did you mean ‘error’?
 2652 |   dlerror ();
      |   ^~~~~~~
      |   error
/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c:2655:6: error: ‘RTLD_NOW’ was not declared in this scope
 2655 |      RTLD_NOW | RTLD_LOCAL);
      |      ^~~~~~~~
/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c:2655:17: error: ‘RTLD_LOCAL’ was not declared in this scope
 2655 |      RTLD_NOW | RTLD_LOCAL);
      |                 ^~~~~~~~~~
/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c:2654:12: error: ‘dlopen’ was not declared in this scope; did you mean ‘open’?
 2654 |   handle = dlopen (m_tempdir->get_path_so_file (),
      |            ^~~~~~
      |            open

I can pile on another kludge to make that compile and eventully it'll
end up linking libgccjit, but the build then stops with an error that is
not so easily skipped.

So no, Cygwin is not one of the targets that libgccjit is intended to
work on yet and needs work.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

SD adaptations for KORG EX-800 and Poly-800MkII V0.9:
http://Synth.Stromeko.net/Downloads.html#KorgSDada

Re: libgccjit

[Jonathan Yong]

On 3/14/21 6:52 AM, Achim Gratz wrote:
> 
> /mnt/share/cygpkgs/gcc/gcc.x86_64/build/./prev-gcc/xg++ -B/mnt/share/cygpkgs/gcc/gcc.x86_64/build/./prev-gcc/ -B/usr/x86_64-pc-cygwin/bin/ -nostdinc++ -B/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/src/.libs -B/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/libsupc++/.libs  -I/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/include/x86_64-pc-cygwin  -I/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/include  -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/libstdc++-v3/libsupc++ -L/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/src/.libs -L/mnt/share/cygpkgs/gcc/gcc.x86_64/build/prev-x86_64-pc-cygwin/libstdc++-v3/libsupc++/.libs -fno-PIE -c  -DIN_GCC_FRONTEND -g -O2 -fno-checking -gtoggle -DIN_GCC -fPIC    -fno-exceptions -fno-rtti -fasynchronous-unwind-tables -W -Wall -Wno-narrowing -Wwrite-strings -Wcast-qual -Wno-error=format-diag -Wmissing-format-attribute -Woverloaded-virtual -pedantic -Wno-long-long -Wno-variadic-macros -Wno-overlength-strings   -DHAVE_CONFIG_H -I. -Ijit -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../include -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../libcpp/include  -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../libdecnumber -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../libdecnumber/bid -I../libdecnumber -I/mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/../libbacktrace   -o jit/jit-playback.o -MT jit/jit-playback.o -MMD -MP -MF jit/.deps/jit-playback.TPo /mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c
> /mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c: In member function ‘gcc::jit::result* gcc::jit::playback::context::dlopen_built_dso()’:
> /mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c:2652:3: error: ‘dlerror’ was not declared in this scope; did you mean ‘error’?
>   2652 |   dlerror ();
>        |   ^~~~~~~
>        |   error
> /mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c:2655:6: error: ‘RTLD_NOW’ was not declared in this scope
>   2655 |      RTLD_NOW | RTLD_LOCAL);
>        |      ^~~~~~~~
> /mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c:2655:17: error: ‘RTLD_LOCAL’ was not declared in this scope
>   2655 |      RTLD_NOW | RTLD_LOCAL);
>        |                 ^~~~~~~~~~
> /mnt/share/cygpkgs/gcc/gcc.x86_64/src/gcc-10.2.0/gcc/jit/jit-playback.c:2654:12: error: ‘dlopen’ was not declared in this scope; did you mean ‘open’?
>   2654 |   handle = dlopen (m_tempdir->get_path_so_file (),
>        |            ^~~~~~
>        |            open
> 
> I can pile on another kludge to make that compile and eventully it'll
> end up linking libgccjit, but the build then stops with an error that is
> not so easily skipped.
> 
> So no, Cygwin is not one of the targets that libgccjit is intended to
> work on yet and needs work.

Thanks for trying.
Does injecting dlfcn.h work?

Re: libgccjit

[Achim Gratz]

Jonathan Yong via Cygwin writes:
> Thanks for trying.
> Does injecting dlfcn.h work?

The include is not used because it is tied to --enable-plugins.  Plugins
do not work because the configury determines that shared objects do not
work.  If I manually force the inclusion some other stuff goes missing
apparently, but let me try to re-start the build from the beginning with
the patch already applied… well, it stops at the same problem again:

make[3]: *** No rule to make target 'xgcc', needed by 'x86_64-pc-cygwin-gcc-10.exe'.  Stop.

But really, the first steps would apparently be to make --enable-plugins
do something sane on Cygwin (there seems to have been work on this for
MingW64, but it doesn't look like there are patches anywhere I can
find).


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

SD adaptation for Waldorf Blofeld V1.15B11:
http://Synth.Stromeko.net/Downloads.html#WaldorfSDada

Re: libgccjit

[Andy Moreton]

On Sun 14 Mar 2021, Achim Gratz wrote:

> Jonathan Yong via Cygwin writes:
>> Thanks for trying.
>> Does injecting dlfcn.h work?
>
> The include is not used because it is tied to --enable-plugins.  Plugins
> do not work because the configury determines that shared objects do not
> work.  If I manually force the inclusion some other stuff goes missing
> apparently, but let me try to re-start the build from the beginning with
> the patch already applied… well, it stops at the same problem again:
>
> make[3]: *** No rule to make target 'xgcc', needed by 'x86_64-pc-cygwin-gcc-10.exe'.  Stop.
>
> But really, the first steps would apparently be to make --enable-plugins
> do something sane on Cygwin (there seems to have been work on this for
> MingW64, but it doesn't look like there are patches anywhere I can
> find).

The build scripts for Mingw64 in the MSYS2 distro are here:

  https://github.com/msys2/MINGW-packages/tree/master/mingw-w64-gcc

The PKGBUILD file is the build script (same tooling as Arch linux), and
the local patches there may help guide similar fixes for Cygwin.

    AndyM

Re: libgccjit

[Achim Gratz]

Andy Moreton via Cygwin writes:
> The build scripts for Mingw64 in the MSYS2 distro are here:
>
>   https://github.com/msys2/MINGW-packages/tree/master/mingw-w64-gcc

Ah, OK.  Thanks.

> The PKGBUILD file is the build script (same tooling as Arch linux), and
> the local patches there may help guide similar fixes for Cygwin.

It seems these take quite a different path than what I had in mind.  But
there seems to be confirmation in there that one would not need plugins
or host-shared enabled for gccjit.  Getting rid of host-shared makes the
build a lot closer to what it has been before I think and might then not
need as extensive a surgery to get the rest of the build into line.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

SD adaptations for Waldorf Q V3.00R3 and Q+ V3.54R2:
http://Synth.Stromeko.net/Downloads.html#WaldorfSDada

Re: libgccjit

[Andy Moreton]

On Sun 14 Mar 2021, Achim Gratz wrote:

> Andy Moreton via Cygwin writes:
>> The build scripts for Mingw64 in the MSYS2 distro are here:
>>
>>   https://github.com/msys2/MINGW-packages/tree/master/mingw-w64-gcc
>
> Ah, OK.  Thanks.
>
>> The PKGBUILD file is the build script (same tooling as Arch linux), and
>> the local patches there may help guide similar fixes for Cygwin.
>
> It seems these take quite a different path than what I had in mind.  But
> there seems to be confirmation in there that one would not need plugins
> or host-shared enabled for gccjit.  Getting rid of host-shared makes the
> build a lot closer to what it has been before I think and might then not
> need as extensive a surgery to get the rest of the build into line.

The MSYS2 libgccjit built from that spec works for 32bit and 64bit emacs
builds on the experimental emacs branch that uses the library. Hopefully
it will help with your porting efforts.

Thanks for working on this,

    AndyM

Re: libgccjit

[Achim Gratz]

Achim Gratz writes:
> Jonathan Yong via Cygwin writes:
>> Thanks for trying.
>> Does injecting dlfcn.h work?
>
> The include is not used because it is tied to --enable-plugins.  Plugins
> do not work because the configury determines that shared objects do not
> work.  If I manually force the inclusion some other stuff goes missing
> apparently, but let me try to re-start the build from the beginning with
> the patch already applied… well, it stops at the same problem again:
>
> make[3]: *** No rule to make target 'xgcc', needed by 'x86_64-pc-cygwin-gcc-10.exe'.  Stop.

Another monkey patch later I've kicked it over that hurdle and the build
seems to progress to the next stage build.  This is one of those few
times where I could use more threads… although the frequent configure
runs limit the achievable parallelism.

Oh it needs the same tire kick again for the final build stage… done.

Hmm, "Bootstrap comparison failure!" is not nice.  Another day, then.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Waldorf MIDI Implementation & additional documentation:
http://Synth.Stromeko.net/Downloads.html#WaldorfDocs

Re: libgccjit

[Achim Gratz]

Corinna Vinschen via Cygwin writes:
> On Mar 10 12:00, Ken Brown via Cygwin wrote:
>> Emacs development (on the feature/native-comp branch) is using libgccjit.
>> Is it possible to build this library on Cygwin?
>
> Isn't this a question for Jon?  I CCed him.

It was probably meant for me.  No I haven't looked into it yet, but
sionce there's be a consumer of this effort now I guess I should try it
and see what happens.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

SD adaptation for Waldorf rackAttack V1.04R1:
http://Synth.Stromeko.net/Downloads.html#WaldorfSDada

Re: libgccjit

[Achim Gratz]

Ken Brown via Cygwin writes:
> Emacs development (on the feature/native-comp branch) is using
> libgccjit.  Is it possible to build this library on Cygwin?

Several false starts later I've munged my patches and the MinGW ones
into something that gets me a build, packages and runs most JIT tests (a
few of them crash, though).  I've lost the ability to do a bootstrap
build again as in my first manual attempt (stage2 and stage3 differ with
wildly different object sizes), I'm not really sure what's up with that.

Other than that, I'll probably provide test packages for the 10.3.0-RC1
since I have to get that going anyway.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Wavetables for the Terratec KOMPLEXER:
http://Synth.Stromeko.net/Downloads.html#KomplexerWaves

Re: libgccjit

[Ken Brown]

On 4/4/2021 3:45 PM, Achim Gratz wrote:
> Ken Brown via Cygwin writes:
>> Emacs development (on the feature/native-comp branch) is using
>> libgccjit.  Is it possible to build this library on Cygwin?
> 
> Several false starts later I've munged my patches and the MinGW ones
> into something that gets me a build, packages and runs most JIT tests (a
> few of them crash, though).  I've lost the ability to do a bootstrap
> build again as in my first manual attempt (stage2 and stage3 differ with
> wildly different object sizes), I'm not really sure what's up with that.
> 
> Other than that, I'll probably provide test packages for the 10.3.0-RC1
> since I have to get that going anyway.

Thanks!  I'll look forward to trying it out with emacs.

Ken

Re: libgccjit

[Achim Gratz]

Achim Gratz writes:
> Other than that, I'll probably provide test packages for the 10.3.0-RC1
> since I have to get that going anyway.

Now that I have also built the 32bit version I see that the JIT tests
fail there because the JIT executables don't seem to invoke the linker
correctly and ld in turn doesn't find the necessary DLL and object files
to link to.  That may only be a problem for the test environment and go
away when the compiler is properly installed or it may be something
deeper in the build / configuration.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Samples for the Waldorf Blofeld:
http://Synth.Stromeko.net/Downloads.html#BlofeldSamplesExtra