[ITP] wget2 - modern fast parallel file and recursive website downloader

[ITP] wget2 - modern fast parallel file and recursive website downloader

[Brian Inglis]

[-- Attachment #1: Type: text/plain, Size: 1893 bytes --]

wget2 is the successor of wget supplying a shared library API like curl to build
a modern, fast, multi-threaded, parallel downloader using HTTP/2, HTTP
compression and If-Modified-Since headers; see

	https://gitlab.com/gnuwget/wget2

It is currently available on Arch, Debian/Ubuntu, openSUSE, Slackware:
see
	https://pkgs.org/download/wget2

I could release the package as is with an exe and dll, but it should be built as
separate bin, lib, devel, doc, and debuginfo packages, which I have never done
before, so could do with some advice and assistance with the apporach required,
which I based on curl, but that requires no script function overrides, and I
believe this one may or I need some hints.

I have attached my base wget2.cygport which builds one monolithic package but
contains comments for subpackage variables, plus comments showing other files
which I think should be included in the subpackages, and both references to
their locations in subpkg_CONTENTS and alterbative src_install script actions if
cygport will not move the contents into the appropriate install directory.

I also need to understand how cyg...dll package numbering should work with this
package: base zero or one and include or exclude the 2: libwget0, libwget1,
libwget2_0, or libwget2_1, and how to get that generated?

Any advice, assistance, help, or hints from more experienced packagers would be
welcome.

I can also update and release what may be the last patched version of the
original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget if he
agrees.

I could also ITA curl from Yaakov as I use that and wget a lot in scripts and
cron jobs.

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in IEC units and prefixes, physical quantities in SI.]


[-- Attachment #2: manifest.list --]
[-- Type: text/plain, Size: 987 bytes --]

build/docs/html/

build/docs/man/man3/*.3*

build/examples/*.exe

build/include/wget/wgetver.h

inst/usr/bin/wget2.exe
inst/usr/bin/cygwget-0.dll
inst/usr/bin/wget2-noinstall.exe			X

inst/usr/include/wget*.h

inst/usr/lib/libwget.dll.a

inst/usr/lib/debug/usr/bin/cygwget-0.dll.dbg
inst/usr/lib/debug/usr/bin/wget2.exe.dbg
inst/usr/lib/debug/usr/bin/wget2-noinstall.exe.dbg	X

inst/usr/lib/pkgconfig/libwget.pc

inst/usr/share/doc/wget2/AUTHORS
inst/usr/share/doc/wget2/ChangeLog
inst/usr/share/doc/wget2/COPYING
inst/usr/share/doc/wget2/NEWS
inst/usr/share/doc/wget2/README
inst/usr/share/doc/wget2/readme.md

inst/usr/share/locale/

inst/usr/share/man/man3/libwget-*.3*

inst/usr/src/debug/wget2-1.99.2-1/

src/wget2-1.99.2/ABOUT-NLS
src/wget2-1.99.2/COPYING.LESSER

src/wget2-1.99.2/docs/wget2.md
src/wget2-1.99.2/docs/wget-logo.png
src/wget2-1.99.2/docs/wget2.info

src/wget2-1.99.2/docs/man/man1/wget2.1

src/wget2-1.99.2/docs/man/man3/libwget-*.3*

src/wget2-1.99.2/examples/*.c


[-- Attachment #3: wget2.cygport --]
[-- Type: text/plain, Size: 4494 bytes --]

#|/usr/bin/cygport
# wget2.cygport - wget2 Cygwin packages build control script

NAME=wget2
VERSION=1.99.2
RELEASE=1

CATEGORY=Net
SUMMARY="fast file and recursive website downloader"
DESCRIPTION="fast multi-threaded file and recursive website downloader using HTTP2,
HTTP compression, parallel connections, and If-Modified-Since HTTP headers.
The library libwget provides the basic functions needed by a modern web client."

HOMEPAGE=https://gitlab.com/gnuwget/wget2
SRC_URI=mirror://gnu/wget/$NAME-$VERSION.tar.gz
REF_DOCS=https://gnuwget.gitlab.io/wget2/reference/
MAILING_LIST=https://savannah.gnu.org/mail/?group=wget
BUG_TRACKER=https://gitlab.com/gnuwget/wget2/issues
FUZZ_COVERAGE=https://gnuwget.gitlab.io/wget2/fuzz-coverage/

DEPEND="
	autogen autopoint doxygen pkg-config python gettext-devel
	libbrotli-devel libbz2-devel libgettextpo-devel libgnutls-devel
	libgpgme-devel libiconv-devel libidn2-devel liblzma-devel
	libnettle-devel libnghttp2-devel libpcre2-devel libpsl-devel
	libzstd-devel
"
# libhsts-devel libmetalink-devel libmicrohttpd-devel libwolfssl-devel N/A
BUILD_REQUIRES="$DEPEND"

# SPDX-License-Identifier: L/GPL-3.0-or-later
wget2_LICENSE="GPLv3+"
libwget_LICENSE="LGPLv3+"
wget2_LICENSE_SPDX="SPDX-License-Identifier: GPL-3.0-or-later"
libwget_LICENSE_SPDX="SPDX-License-Identifier: LGPL-3.0-or-later"
wget2_LICENSE_URI="COPYING"
libwget_LICENSE_URI="COPYING.LESSER"

CYGWIN_MAINTAINER=Brian%20Inglis
CYGWIN_MAINTAINER_EMAIL=Brian.Inglis@SystematicSW.ab.ca
GNU_MAINTAINER="GNU Wget2 List"
GNU_MAINTAINER_EMAIL=bug-wget@gnu.org
UPSTREAM_EMAIL=wget-dev@gnu.org
SUBJECT="Package%20$NAME%20$VERSION"
MAILTO="mailto:$GNU_MAINTAINER_EMAIL,$UPSTREAM_EMAIL\
?to=$GNU_MAINTAINER%20%3C$GNU_MAINTAINER_EMAIL%3E\
&to=$GNU_MAINTAINER%20%3C$UPSTREAM_EMAIL%3E\
&from=$CYGWIN_MAINTAINER%20%3C$CYGWIN_MAINTAINER_EMAIL%3E\
&subject=$SUBJECT&body=Hi%20$GNU_MAINTAINER,%20$SUBJECT"

#PKG_NAMES="${NAME} libwget0 lib${NAME}-devel lib${NAME}-doc"

# inst/usr/share/doc/wget2/AUTHORS	-> all
# inst/usr/share/doc/wget2/ChangeLog	-> all
# inst/usr/share/doc/wget2/COPYING	-> all
# inst/usr/share/doc/wget2/NEWS		-> all
# inst/usr/share/doc/wget2/README	-> all
# inst/usr/share/doc/wget2/readme.md	-> all

# inst/usr/bin/wget2.exe		-> bin
# inst/usr/share/locale/		-> bin

# src/wget2-1.99.2/docs/man/man1/wget2.1-> bin
# src/wget2-1.99.2/docs/wget2.info	-> bin
# src/wget2-1.99.2/docs/wget2.md	-> bin
# src/wget2-1.99.2/docs/wget-logo.png	-> bin

#wget2_CONTENTS="
#	usr/bin/wget2.exe
#	usr/share/locale/
#	usr/share/doc/wget2/
#	$S/docs/man/man1/wget2.1
#	$S/docs/wget2.info
#"
# doinfo $S/docs/wget2.info
# doman $S/docs/man/man1/wget2.1

#wget2_DOCS="
#	docs/wget2.md
#	docs/wget-logo.png
#"
# dodoc $S/docs/wget2.md
# doicon $S/docs/wget-logo.png

# inst/usr/src/debug/			-> bin-debuginfo

#wget2_debuginfo_CONTENTS=usr/src/debug/

# inst/usr/bin/cygwget-0.dll		-> lib
# src/wget2-1.99.2/COPYING.LESSER	-> lib

#libwget0_CATEGORY="$CATEGORY Libs"
#libwget0_SUMMARY="modern web client library (runtime)"
#libwget0_REQUIRES="
#	libbrotli libbz2 libgettextpo libgnutls libgpgme libiconv libidn2
#	liblzma libnettle libnghttp2 libpcre2 libpsl libzstd
#"
#	libhsts libmetalink libmicrohttpd libwolfssl	N/A
#libwget0_CONTENTS="
#	usr/bin/cygwget-0.dll
#	usr/share/doc/wget2/
#"
#libwget0_DOCS=COPYING.LESSER
# dodoc $S/COPYING.LESSER

# build/docs/html/			-> devel
# build/examples/Makefile		-> devel
# inst/usr/include/wget*.h		-> devel
# inst/usr/lib/libwget.dll.a		-> devel
# inst/usr/lib/pkgconfig/libwget.pc	-> devel
# inst/usr/share/man/man3/libwget-*.3*	-> devel
# src/wget2-1.99.2/ABOUT-NLS		-> devel
# src/wget2-1.99.2/examples/*.c		-> devel

#libwget_devel_CATEGORY="$CATEGORY Devel Libs"
#libwget_devel_SUMMARY="modern web client library (development)"
#libwget_devel_CONTENTS="
#	usr/include/wget*.h
#	usr/lib/libwget.dll.a
#	usr/lib/pkgconfig/libwget.pc
#	usr/share/doc/wget2/
#	usr/share/man/man3/libwget-*.3.gz
#"
#libwget_devel_DOCS="
#	ABOUT-NLS
#	examples/*.c
#	$B/examples/Makefile
#"
#	dodoc $S/ABOUT-NLS
#	docinto examples/
#	dodoc $S/ABOUT-NLS $S/examples/*.c examples/Makefile
#libwget_devel_HTMLDOCS=$B/docs/html/
# dodoc	$B/docs/html/

#libwget_doc_CATEGORY="$CATEGORY Devel Doc"
#libwget_doc_SUMMARY="modern web client library (API docs)"
#libwget_doc_CONTENTS="
#	usr/share/man/man3/
#	$B/docs/html/
#"
#libwget_doc_HTMLDOCS=$B/docs/html/
# dodoc	$B/docs/html/

# inst/usr/lib/debug/usr/bin/		-> lib-debuginfo

#libwget_debuginfo_CONTENTS=usr/lib/debug/usr/bin/

Re: [ITP] wget2 - modern fast parallel file and recursive website downloader

[Brian Inglis]

On 2020-07-08 14:05, Brian Inglis wrote:
> wget2 is the successor of wget supplying a shared library API like curl to build
> a modern, fast, multi-threaded, parallel downloader using HTTP/2, HTTP
> compression and If-Modified-Since headers; see
> 
> 	https://gitlab.com/gnuwget/wget2
> 
> It is currently available on Arch, Debian/Ubuntu, openSUSE, Slackware:
> see
> 	https://pkgs.org/download/wget2
> 
> I could release the package as is with an exe and dll, but it should be built as
> separate bin, lib, devel, doc, and debuginfo packages, which I have never done
> before, so could do with some advice and assistance with the apporach required,
> which I based on curl, but that requires no script function overrides, and I
> believe this one may or I need some hints.
> 
> I have attached my base wget2.cygport which builds one monolithic package but
> contains comments for subpackage variables, plus comments showing other files
> which I think should be included in the subpackages, and both references to
> their locations in subpkg_CONTENTS and alterbative src_install script actions if
> cygport will not move the contents into the appropriate install directory.

Forgot to explain I also produced a summary of the files generated and/or
available for packaging under the triplet directory in manifest.list to my
previous email.

> I also need to understand how cyg...dll package numbering should work with this
> package: base zero or one and include or exclude the 2: libwget0, libwget1,
> libwget2_0, or libwget2_1, and how to get that generated?
> 
> Any advice, assistance, help, or hints from more experienced packagers would be
> welcome.
> 
> I can also update and release what may be the last patched version of the
> original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget if he
> agrees.
> 
> I could also ITA curl from Yaakov as I use that and wget a lot in scripts and
> cron jobs.

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in IEC units and prefixes, physical quantities in SI.]

Re: [ITP] wget2 - modern fast parallel file and recursive website downloader

[Marco Atzeri]

On 08.07.2020 22:28, Brian Inglis wrote:
> On 2020-07-08 14:05, Brian Inglis wrote:
>> wget2 is the successor of wget supplying a shared library API like curl to build
>> a modern, fast, multi-threaded, parallel downloader using HTTP/2, HTTP
>> compression and If-Modified-Since headers; see
>>
>> 	https://gitlab.com/gnuwget/wget2
>>
>> It is currently available on Arch, Debian/Ubuntu, openSUSE, Slackware:
>> see
>> 	https://pkgs.org/download/wget2
>>
>> I could release the package as is with an exe and dll, but it should be built as
>> separate bin, lib, devel, doc, and debuginfo packages, which I have never done
>> before, so could do with some advice and assistance with the apporach required,
>> which I based on curl, but that requires no script function overrides, and I
>> believe this one may or I need some hints.
>>
>> I have attached my base wget2.cygport which builds one monolithic package but
>> contains comments for subpackage variables, plus comments showing other files
>> which I think should be included in the subpackages, and both references to
>> their locations in subpkg_CONTENTS and alterbative src_install script actions if
>> cygport will not move the contents into the appropriate install directory.
> 
> Forgot to explain I also produced a summary of the files generated and/or
> available for packaging under the triplet directory in manifest.list to my
> previous email.
> 
>> I also need to understand how cyg...dll package numbering should work with this
>> package: base zero or one and include or exclude the 2: libwget0, libwget1,
>> libwget2_0, or libwget2_1, and how to get that generated?
>>
>> Any advice, assistance, help, or hints from more experienced packagers would be
>> welcome.
>>
>> I can also update and release what may be the last patched version of the
>> original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget if he
>> agrees.
>>
>> I could also ITA curl from Yaakov as I use that and wget a lot in scripts and
>> cron jobs.
> 

My suggestion:

this in libwget2_0 (per consistency) or libwget0

/usr/bin/cygwget-0.dll

these in wget2

/usr/bin/wget2.exe
/usr/share/doc/wget2/AUTHORS
/usr/share/doc/wget2/COPYING
/usr/share/doc/wget2/ChangeLog
/usr/share/doc/wget2/NEWS
/usr/share/doc/wget2/README
/usr/share/locale/ca/LC_MESSAGES/wget2.mo
/usr/share/locale/cs/LC_MESSAGES/wget2.mo
/usr/share/locale/de/LC_MESSAGES/wget2.mo
/usr/share/locale/eo/LC_MESSAGES/wget2.mo
/usr/share/locale/es/LC_MESSAGES/wget2.mo
/usr/share/locale/et/LC_MESSAGES/wget2.mo
/usr/share/locale/fi/LC_MESSAGES/wget2.mo
/usr/share/locale/fr/LC_MESSAGES/wget2.mo
/usr/share/locale/ga/LC_MESSAGES/wget2.mo
/usr/share/locale/hr/LC_MESSAGES/wget2.mo
/usr/share/locale/hu/LC_MESSAGES/wget2.mo
/usr/share/locale/id/LC_MESSAGES/wget2.mo
/usr/share/locale/it/LC_MESSAGES/wget2.mo
/usr/share/locale/ja/LC_MESSAGES/wget2.mo
/usr/share/locale/nb/LC_MESSAGES/wget2.mo
/usr/share/locale/nl/LC_MESSAGES/wget2.mo
/usr/share/locale/pl/LC_MESSAGES/wget2.mo
/usr/share/locale/pt_BR/LC_MESSAGES/wget2.mo
/usr/share/locale/ru/LC_MESSAGES/wget2.mo
/usr/share/locale/sk/LC_MESSAGES/wget2.mo
/usr/share/locale/sr/LC_MESSAGES/wget2.mo
/usr/share/locale/sv/LC_MESSAGES/wget2.mo
/usr/share/locale/tr/LC_MESSAGES/wget2.mo
/usr/share/locale/uk/LC_MESSAGES/wget2.mo
/usr/share/locale/vi/LC_MESSAGES/wget2.mo
/usr/share/locale/zh_CN/LC_MESSAGES/wget2.mo
plus also the manual page that it is missing


What is this ? It seems a duplicate of wget2

/usr/bin/wget2_noinstall.exe

these in libwget2-devel or libwget-devel

/usr/include/wget.h
/usr/include/wgetver.h
/usr/lib/libwget.dll.a
/usr/lib/pkgconfig/libwget.pc
/usr/share/man/man3/libwget-base64.3.gz
/usr/share/man/man3/libwget-bitmap.3.gz
/usr/share/man/man3/libwget-console.3.gz
/usr/share/man/man3/libwget-dns-caching.3.gz
/usr/share/man/man3/libwget-dns.3.gz
/usr/share/man/man3/libwget-error.3.gz
/usr/share/man/man3/libwget-hash.3.gz
/usr/share/man/man3/libwget-hashmap.3.gz
/usr/share/man/man3/libwget-io.3.gz
/usr/share/man/man3/libwget-ip.3.gz
/usr/share/man/man3/libwget-list.3.gz
/usr/share/man/man3/libwget-mem.3.gz
/usr/share/man/man3/libwget-net.3.gz
/usr/share/man/man3/libwget-parse_atom.3.gz
/usr/share/man/man3/libwget-parse_sitemap.3.gz
/usr/share/man/man3/libwget-printf.3.gz
/usr/share/man/man3/libwget-random.3.gz
/usr/share/man/man3/libwget-robots.3.gz
/usr/share/man/man3/libwget-stringmap.3.gz
/usr/share/man/man3/libwget-thread.3.gz
/usr/share/man/man3/libwget-utils.3.gz
/usr/share/man/man3/libwget-vector.3.gz
/usr/share/man/man3/libwget-xalloc.3.gz
/usr/share/man/man3/libwget-xml.3.gz

Re: [ITP] wget2 - modern fast parallel file and recursive website downloader

[Yaakov Selkowitz]

On Thu, 2020-07-09 at 20:27 +0200, Marco Atzeri via Cygwin-apps wrote:
> On 08.07.2020 22:28, Brian Inglis wrote:
> > On 2020-07-08 14:05, Brian Inglis wrote:
> > > wget2 is the successor of wget supplying a shared library API like curl to build
> > > a modern, fast, multi-threaded, parallel downloader using HTTP/2, HTTP
> > > compression and If-Modified-Since headers; see
> > > 
> > > 	https://gitlab.com/gnuwget/wget2
> > > 
> > > It is currently available on Arch, Debian/Ubuntu, openSUSE, Slackware:
> > > see
> > > 	https://pkgs.org/download/wget2
> > > 
> > > I could release the package as is with an exe and dll, but it should be built as
> > > separate bin, lib, devel, doc, and debuginfo packages, which I have never done
> > > before, so could do with some advice and assistance with the apporach required,
> > > which I based on curl, but that requires no script function overrides, and I
> > > believe this one may or I need some hints.
> > > 
> > > I have attached my base wget2.cygport which builds one monolithic package but
> > > contains comments for subpackage variables, plus comments showing other files
> > > which I think should be included in the subpackages, and both references to
> > > their locations in subpkg_CONTENTS and alterbative src_install script actions if
> > > cygport will not move the contents into the appropriate install directory.
> > 
> > Forgot to explain I also produced a summary of the files generated and/or
> > available for packaging under the triplet directory in manifest.list to my
> > previous email.
> > 
> > > I also need to understand how cyg...dll package numbering should work with this
> > > package: base zero or one and include or exclude the 2: libwget0, libwget1,
> > > libwget2_0, or libwget2_1, and how to get that generated?
> > > 
> > > Any advice, assistance, help, or hints from more experienced packagers would be
> > > welcome.
> > > 
> > > I can also update and release what may be the last patched version of the
> > > original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget if he
> > > agrees.
> > > 
> > > I could also ITA curl from Yaakov as I use that and wget a lot in scripts and
> > > cron jobs.
> 
> My suggestion:
> 
> this in libwget2_0 (per consistency) or libwget0
> 
> /usr/bin/cygwget-0.dll

libwget0, based on the library name.

> these in wget2
> 
> /usr/bin/wget2.exe
> /usr/share/doc/wget2/AUTHORS
> /usr/share/doc/wget2/COPYING
> /usr/share/doc/wget2/ChangeLog
> /usr/share/doc/wget2/NEWS
> /usr/share/doc/wget2/README
> /usr/share/locale/ca/LC_MESSAGES/wget2.mo
> /usr/share/locale/cs/LC_MESSAGES/wget2.mo
> /usr/share/locale/de/LC_MESSAGES/wget2.mo
> /usr/share/locale/eo/LC_MESSAGES/wget2.mo
> /usr/share/locale/es/LC_MESSAGES/wget2.mo
> /usr/share/locale/et/LC_MESSAGES/wget2.mo
> /usr/share/locale/fi/LC_MESSAGES/wget2.mo
> /usr/share/locale/fr/LC_MESSAGES/wget2.mo
> /usr/share/locale/ga/LC_MESSAGES/wget2.mo
> /usr/share/locale/hr/LC_MESSAGES/wget2.mo
> /usr/share/locale/hu/LC_MESSAGES/wget2.mo
> /usr/share/locale/id/LC_MESSAGES/wget2.mo
> /usr/share/locale/it/LC_MESSAGES/wget2.mo
> /usr/share/locale/ja/LC_MESSAGES/wget2.mo
> /usr/share/locale/nb/LC_MESSAGES/wget2.mo
> /usr/share/locale/nl/LC_MESSAGES/wget2.mo
> /usr/share/locale/pl/LC_MESSAGES/wget2.mo
> /usr/share/locale/pt_BR/LC_MESSAGES/wget2.mo
> /usr/share/locale/ru/LC_MESSAGES/wget2.mo
> /usr/share/locale/sk/LC_MESSAGES/wget2.mo
> /usr/share/locale/sr/LC_MESSAGES/wget2.mo
> /usr/share/locale/sv/LC_MESSAGES/wget2.mo
> /usr/share/locale/tr/LC_MESSAGES/wget2.mo
> /usr/share/locale/uk/LC_MESSAGES/wget2.mo
> /usr/share/locale/vi/LC_MESSAGES/wget2.mo
> /usr/share/locale/zh_CN/LC_MESSAGES/wget2.mo
> plus also the manual page that it is missing
> 
> 
> What is this ? It seems a duplicate of wget2
> 
> /usr/bin/wget2_noinstall.exe

Simply based on the name, I'm guessing it shouldn't be installed?

> these in libwget2-devel or libwget-devel

libwget-devel, based on the library name.

> /usr/include/wget.h
> /usr/include/wgetver.h
> /usr/lib/libwget.dll.a
> /usr/lib/pkgconfig/libwget.pc
> /usr/share/man/man3/libwget-base64.3.gz
> /usr/share/man/man3/libwget-bitmap.3.gz
> /usr/share/man/man3/libwget-console.3.gz
> /usr/share/man/man3/libwget-dns-caching.3.gz
> /usr/share/man/man3/libwget-dns.3.gz
> /usr/share/man/man3/libwget-error.3.gz
> /usr/share/man/man3/libwget-hash.3.gz
> /usr/share/man/man3/libwget-hashmap.3.gz
> /usr/share/man/man3/libwget-io.3.gz
> /usr/share/man/man3/libwget-ip.3.gz
> /usr/share/man/man3/libwget-list.3.gz
> /usr/share/man/man3/libwget-mem.3.gz
> /usr/share/man/man3/libwget-net.3.gz
> /usr/share/man/man3/libwget-parse_atom.3.gz
> /usr/share/man/man3/libwget-parse_sitemap.3.gz
> /usr/share/man/man3/libwget-printf.3.gz
> /usr/share/man/man3/libwget-random.3.gz
> /usr/share/man/man3/libwget-robots.3.gz
> /usr/share/man/man3/libwget-stringmap.3.gz
> /usr/share/man/man3/libwget-thread.3.gz
> /usr/share/man/man3/libwget-utils.3.gz
> /usr/share/man/man3/libwget-vector.3.gz
> /usr/share/man/man3/libwget-xalloc.3.gz
> /usr/share/man/man3/libwget-xml.3.gz

--
Yaakov

Re: [ITP] wget2 - modern fast parallel file and recursive website downloader

[Brian Inglis]

On 2020-07-09 12:50, Yaakov Selkowitz wrote:
> On Thu, 2020-07-09 at 20:27 +0200, Marco Atzeri via Cygwin-apps wrote:
>> On 08.07.2020 22:28, Brian Inglis wrote:
>>> On 2020-07-08 14:05, Brian Inglis wrote:
>>>> wget2 is the successor of wget supplying a shared library API like curl to build
>>>> a modern, fast, multi-threaded, parallel downloader using HTTP/2, HTTP
>>>> compression and If-Modified-Since headers; see
>>>>
>>>> 	https://gitlab.com/gnuwget/wget2
>>>>
>>>> It is currently available on Arch, Debian/Ubuntu, openSUSE, Slackware:
>>>> see
>>>> 	https://pkgs.org/download/wget2
>>>>
>>>> I could release the package as is with an exe and dll, but it should be built as
>>>> separate bin, lib, devel, doc, and debuginfo packages, which I have never done
>>>> before, so could do with some advice and assistance with the apporach required,
>>>> which I based on curl, but that requires no script function overrides, and I
>>>> believe this one may or I need some hints.
>>>>
>>>> I have attached my base wget2.cygport which builds one monolithic package but
>>>> contains comments for subpackage variables, plus comments showing other files
>>>> which I think should be included in the subpackages, and both references to
>>>> their locations in subpkg_CONTENTS and alterbative src_install script actions if
>>>> cygport will not move the contents into the appropriate install directory.
>>>
>>> Forgot to explain I also produced a summary of the files generated and/or
>>> available for packaging under the triplet directory in manifest.list to my
>>> previous email.
>>>
>>>> I also need to understand how cyg...dll package numbering should work with this
>>>> package: base zero or one and include or exclude the 2: libwget0, libwget1,
>>>> libwget2_0, or libwget2_1, and how to get that generated?
>>>>
>>>> Any advice, assistance, help, or hints from more experienced packagers would be
>>>> welcome.
>>>>
>>>> I can also update and release what may be the last patched version of the
>>>> original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget if he
>>>> agrees.
>>>>
>>>> I could also ITA curl from Yaakov as I use that and wget a lot in scripts and
>>>> cron jobs.
>>
>> My suggestion:
>>
>> this in libwget2_0 (per consistency) or libwget0
>>
>> /usr/bin/cygwget-0.dll
> 
> libwget0, based on the library name.
> 
>> these in wget2
>>
>> /usr/bin/wget2.exe
>> /usr/share/doc/wget2/AUTHORS
>> /usr/share/doc/wget2/COPYING
>> /usr/share/doc/wget2/ChangeLog
>> /usr/share/doc/wget2/NEWS
>> /usr/share/doc/wget2/README
>> /usr/share/locale/ca/LC_MESSAGES/wget2.mo
>> /usr/share/locale/cs/LC_MESSAGES/wget2.mo
>> /usr/share/locale/de/LC_MESSAGES/wget2.mo
>> /usr/share/locale/eo/LC_MESSAGES/wget2.mo
>> /usr/share/locale/es/LC_MESSAGES/wget2.mo
>> /usr/share/locale/et/LC_MESSAGES/wget2.mo
>> /usr/share/locale/fi/LC_MESSAGES/wget2.mo
>> /usr/share/locale/fr/LC_MESSAGES/wget2.mo
>> /usr/share/locale/ga/LC_MESSAGES/wget2.mo
>> /usr/share/locale/hr/LC_MESSAGES/wget2.mo
>> /usr/share/locale/hu/LC_MESSAGES/wget2.mo
>> /usr/share/locale/id/LC_MESSAGES/wget2.mo
>> /usr/share/locale/it/LC_MESSAGES/wget2.mo
>> /usr/share/locale/ja/LC_MESSAGES/wget2.mo
>> /usr/share/locale/nb/LC_MESSAGES/wget2.mo
>> /usr/share/locale/nl/LC_MESSAGES/wget2.mo
>> /usr/share/locale/pl/LC_MESSAGES/wget2.mo
>> /usr/share/locale/pt_BR/LC_MESSAGES/wget2.mo
>> /usr/share/locale/ru/LC_MESSAGES/wget2.mo
>> /usr/share/locale/sk/LC_MESSAGES/wget2.mo
>> /usr/share/locale/sr/LC_MESSAGES/wget2.mo
>> /usr/share/locale/sv/LC_MESSAGES/wget2.mo
>> /usr/share/locale/tr/LC_MESSAGES/wget2.mo
>> /usr/share/locale/uk/LC_MESSAGES/wget2.mo
>> /usr/share/locale/vi/LC_MESSAGES/wget2.mo
>> /usr/share/locale/zh_CN/LC_MESSAGES/wget2.mo
>> plus also the manual page that it is missing
>>
>>
>> What is this ? It seems a duplicate of wget2
>>
>> /usr/bin/wget2_noinstall.exe

Test version - the "summary" in manifest.list excludes all the test and fuzz files.

> Simply based on the name, I'm guessing it shouldn't be installed?
> 
>> these in libwget2-devel or libwget-devel
> 
> libwget-devel, based on the library name.
> 
>> /usr/include/wget.h
>> /usr/include/wgetver.h
>> /usr/lib/libwget.dll.a
>> /usr/lib/pkgconfig/libwget.pc
>> /usr/share/man/man3/libwget-base64.3.gz
>> /usr/share/man/man3/libwget-bitmap.3.gz
>> /usr/share/man/man3/libwget-console.3.gz
>> /usr/share/man/man3/libwget-dns-caching.3.gz
>> /usr/share/man/man3/libwget-dns.3.gz
>> /usr/share/man/man3/libwget-error.3.gz
>> /usr/share/man/man3/libwget-hash.3.gz
>> /usr/share/man/man3/libwget-hashmap.3.gz
>> /usr/share/man/man3/libwget-io.3.gz
>> /usr/share/man/man3/libwget-ip.3.gz
>> /usr/share/man/man3/libwget-list.3.gz
>> /usr/share/man/man3/libwget-mem.3.gz
>> /usr/share/man/man3/libwget-net.3.gz
>> /usr/share/man/man3/libwget-parse_atom.3.gz
>> /usr/share/man/man3/libwget-parse_sitemap.3.gz
>> /usr/share/man/man3/libwget-printf.3.gz
>> /usr/share/man/man3/libwget-random.3.gz
>> /usr/share/man/man3/libwget-robots.3.gz
>> /usr/share/man/man3/libwget-stringmap.3.gz
>> /usr/share/man/man3/libwget-thread.3.gz
>> /usr/share/man/man3/libwget-utils.3.gz
>> /usr/share/man/man3/libwget-vector.3.gz
>> /usr/share/man/man3/libwget-xalloc.3.gz
>> /usr/share/man/man3/libwget-xml.3.gz

Thanks guys.

Two points are not clear:

- how do I get the library to build explicitly as cygwgetN - is it just from the
package name libwgetN and cygport will DTRT or ...?

- can I just add the extra files (not under inst/) to the ..._CONTENTS variable
and cygport will DTRT, or do I have to add a src_install with do... script lines
to move the extra files under inst/, then add the corresponding paths under
inst/ to the ..._CONTENTS variables?

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in IEC units and prefixes, physical quantities in SI.]

Re: [ITP] wget2 - modern fast parallel file and recursive website downloader

[Marco Atzeri]

On 10.07.2020 03:38, Brian Inglis wrote:
> On 2020-07-09 12:50, Yaakov Selkowitz wrote:
>> On Thu, 2020-07-09 at 20:27 +0200, Marco Atzeri via Cygwin-apps wrote:
>>> On 08.07.2020 22:28, Brian Inglis wrote:
>>>> On 2020-07-08 14:05, Brian Inglis wrote:
>>>>> wget2 is the successor of wget supplying a shared library API like curl to build
>>>>> a modern, fast, multi-threaded, parallel downloader using HTTP/2, HTTP
>>>>> compression and If-Modified-Since headers; see
>>>>>
>>>>> 	https://gitlab.com/gnuwget/wget2
>>>>>
>>>>> It is currently available on Arch, Debian/Ubuntu, openSUSE, Slackware:
>>>>> see
>>>>> 	https://pkgs.org/download/wget2
>>>>>
>>>>> I could release the package as is with an exe and dll, but it should be built as
>>>>> separate bin, lib, devel, doc, and debuginfo packages, which I have never done
>>>>> before, so could do with some advice and assistance with the apporach required,
>>>>> which I based on curl, but that requires no script function overrides, and I
>>>>> believe this one may or I need some hints.
>>>>>
>>>>> I have attached my base wget2.cygport which builds one monolithic package but
>>>>> contains comments for subpackage variables, plus comments showing other files
>>>>> which I think should be included in the subpackages, and both references to
>>>>> their locations in subpkg_CONTENTS and alterbative src_install script actions if
>>>>> cygport will not move the contents into the appropriate install directory.
>>>>
>>>> Forgot to explain I also produced a summary of the files generated and/or
>>>> available for packaging under the triplet directory in manifest.list to my
>>>> previous email.
>>>>
>>>>> I also need to understand how cyg...dll package numbering should work with this
>>>>> package: base zero or one and include or exclude the 2: libwget0, libwget1,
>>>>> libwget2_0, or libwget2_1, and how to get that generated?
>>>>>
>>>>> Any advice, assistance, help, or hints from more experienced packagers would be
>>>>> welcome.
>>>>>
>>>>> I can also update and release what may be the last patched version of the
>>>>> original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget if he
>>>>> agrees.
>>>>>
>>>>> I could also ITA curl from Yaakov as I use that and wget a lot in scripts and
>>>>> cron jobs.
>>>
>>> My suggestion:
>>>
>>> this in libwget2_0 (per consistency) or libwget0
>>>
>>> /usr/bin/cygwget-0.dll
>>
>> libwget0, based on the library name.
>>
>>> these in wget2
>>>
>>> /usr/bin/wget2.exe
>>> /usr/share/doc/wget2/AUTHORS
>>> /usr/share/doc/wget2/COPYING
>>> /usr/share/doc/wget2/ChangeLog
>>> /usr/share/doc/wget2/NEWS
>>> /usr/share/doc/wget2/README
>>> /usr/share/locale/ca/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/cs/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/de/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/eo/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/es/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/et/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/fi/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/fr/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/ga/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/hr/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/hu/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/id/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/it/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/ja/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/nb/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/nl/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/pl/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/pt_BR/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/ru/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/sk/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/sr/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/sv/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/tr/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/uk/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/vi/LC_MESSAGES/wget2.mo
>>> /usr/share/locale/zh_CN/LC_MESSAGES/wget2.mo
>>> plus also the manual page that it is missing
>>>
>>>
>>> What is this ? It seems a duplicate of wget2
>>>
>>> /usr/bin/wget2_noinstall.exe
> 
> Test version - the "summary" in manifest.list excludes all the test and fuzz files.

it should not be installed at at all.
Sometime I remove such files in src_install()
or you can put them in PKG_IGNORE

> 
>> Simply based on the name, I'm guessing it shouldn't be installed?
>>
>>> these in libwget2-devel or libwget-devel
>>
>> libwget-devel, based on the library name.
>>
>>> /usr/include/wget.h
>>> /usr/include/wgetver.h
>>> /usr/lib/libwget.dll.a
>>> /usr/lib/pkgconfig/libwget.pc
>>> /usr/share/man/man3/libwget-base64.3.gz
>>> /usr/share/man/man3/libwget-bitmap.3.gz
>>> /usr/share/man/man3/libwget-console.3.gz
>>> /usr/share/man/man3/libwget-dns-caching.3.gz
>>> /usr/share/man/man3/libwget-dns.3.gz
>>> /usr/share/man/man3/libwget-error.3.gz
>>> /usr/share/man/man3/libwget-hash.3.gz
>>> /usr/share/man/man3/libwget-hashmap.3.gz
>>> /usr/share/man/man3/libwget-io.3.gz
>>> /usr/share/man/man3/libwget-ip.3.gz
>>> /usr/share/man/man3/libwget-list.3.gz
>>> /usr/share/man/man3/libwget-mem.3.gz
>>> /usr/share/man/man3/libwget-net.3.gz
>>> /usr/share/man/man3/libwget-parse_atom.3.gz
>>> /usr/share/man/man3/libwget-parse_sitemap.3.gz
>>> /usr/share/man/man3/libwget-printf.3.gz
>>> /usr/share/man/man3/libwget-random.3.gz
>>> /usr/share/man/man3/libwget-robots.3.gz
>>> /usr/share/man/man3/libwget-stringmap.3.gz
>>> /usr/share/man/man3/libwget-thread.3.gz
>>> /usr/share/man/man3/libwget-utils.3.gz
>>> /usr/share/man/man3/libwget-vector.3.gz
>>> /usr/share/man/man3/libwget-xalloc.3.gz
>>> /usr/share/man/man3/libwget-xml.3.gz
> 
> Thanks guys.
> 
> Two points are not clear:
> 
> - how do I get the library to build explicitly as cygwgetN - is it just from the
> package name libwgetN and cygport will DTRT or ...?

proper built library for Cygwin are named cygwgetN.dll so you call the 
package libwget0

> 
> - can I just add the extra files (not under inst/) to the ..._CONTENTS variable
> and cygport will DTRT, or do I have to add a src_install with do... script lines
> to move the extra files under inst/, then add the corresponding paths under
> inst/ to the ..._CONTENTS variables?
> 

better you use in src_install() something like

        insinto /usr/share/man/man3
        doins ${S}/DOCS/man/man3/*

and then use the ..._CONTENTS so they are packed in the right position

see chapter 10 of
/usr/share/doc/cygport/html/manual/toc_index.html

Regards
Marco

Re: [ITP] wget2 - modern fast parallel file and recursive website downloader

[Brian Inglis]

On 2020-07-08 14:05, Brian Inglis wrote:
> wget2 is the successor of wget supplying a shared library API like curl to
> build a modern, fast, multi-threaded, parallel downloader using HTTP/2, HTTP
> compression and If-Modified-Since headers; see:
>	https://gitlab.com/gnuwget/wget2
> It is currently available on Arch, Debian/Ubuntu, openSUSE, Slackware; see:
	https://repology.org/project/wget2/versions

Thanks for help getting here and also the upstream folks!

Please review wget2 repackaged into subpackages available under:

https://drive.google.com/drive/folders/1VVuC14KuB6uShm4FQL9BuXH0hpLYnIcJ?usp=sharing

This is release 1.99.2 so ISTM this should be considered a PoC or RC for 2.0.

> I can also update and release what may be the last patched version of the
> original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget
> if he agrees.

Also wget 1.20.3 final release for ITA or non-maintainer upload as Eric seems MIA:

https://drive.google.com/drive/folders/1T6Mn5r-n8r9Gk71mI_mI1IOLPZm81TB2?usp=sharing

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in binary units and prefixes, physical quantities in SI.]

Re: [ITP] wget2 - modern fast parallel file and recursive website downloader

[Eric Blake]

On 10/30/20 4:30 PM, Brian Inglis wrote:
>> I can also update and release what may be the last patched version of the
>> original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget
>> if he agrees.
> 
> Also wget 1.20.3 final release for ITA or non-maintainer upload as Eric seems MIA:

Yes, my time for cygwin has greatly diminished, so you are welcome to
take over wget.

-- 
Eric Blake, Principal Software Engineer
Red Hat, Inc.           +1-919-301-3226
Virtualization:  qemu.org | libvirt.org

Re: [ITA] wget

[Brian Inglis]

On 2020-10-30 15:34, Eric Blake wrote:
> On 10/30/20 4:30 PM, Brian Inglis wrote:
>>> I can also update and release what may be the last patched version of the
>>> original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget
>>> if he agrees.
>>
>> Also wget 1.20.3 final release for ITA or non-maintainer upload as Eric seems MIA:

> Yes, my time for cygwin has greatly diminished, so you are welcome to
> take over wget.

Thanks Eric, good to know you're keeping so busy, expected under the circumstances!

Not a great effort as there should be no to few more wget releases.

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in binary units and prefixes, physical quantities in SI.]

Re: [ITA] wget

[Marco Atzeri]

On 30.10.2020 22:57, Brian Inglis wrote:
> On 2020-10-30 15:34, Eric Blake wrote:
>> On 10/30/20 4:30 PM, Brian Inglis wrote:
>>>> I can also update and release what may be the last patched version of the
>>>> original wget 1.20.3 (currently 1.19.1) if Eric has no time, or ITA wget
>>>> if he agrees.
>>>
>>> Also wget 1.20.3 final release for ITA or non-maintainer upload as Eric seems MIA:
> 
>> Yes, my time for cygwin has greatly diminished, so you are welcome to
>> take over wget.
> 
> Thanks Eric, good to know you're keeping so busy, expected under the circumstances!
> 
> Not a great effort as there should be no to few more wget releases.
> 

all your

Thanks
Marco

Re: [ITP] wget2 - please review if anyone has time

[Brian Inglis]

On 2020-07-08 14:05, Brian Inglis wrote:
> wget2 is the successor of wget supplying a shared library API like curl to
> build a modern, fast, multi-threaded, parallel downloader using HTTP/2, HTTP
> compression and If-Modified-Since headers; see:
>	https://gitlab.com/gnuwget/wget2
> It is currently available on Arch, Debian/Ubuntu, openSUSE, Slackware; see:
	https://repology.org/project/wget2/versions

Thanks for help getting here and also the upstream folks!

Please review wget2 repackaged into subpackages available under:

https://drive.google.com/drive/folders/1VVuC14KuB6uShm4FQL9BuXH0hpLYnIcJ?usp=sharing

This is release 1.99.2 so ISTM this should be considered a PoC or RC for 2.0.

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in binary units and prefixes, physical quantities in SI.]

Re: [ITA] wget

[Achim Gratz]

Hi Brian,

Brian Inglis writes:
>> Yes, my time for cygwin has greatly diminished, so you are welcome to
>> take over wget.
>
> Thanks Eric, good to know you're keeping so busy, expected under the circumstances!
>
> Not a great effort as there should be no to few more wget releases.

Your latest wget release is configured differently for 32bit and 64bit,
most likely due to missing dependencies / development packages.  Since
the BUILD_REQUIRES are completely missing it doesn't build at all on the
CI.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Waldorf MIDI Implementation & additional documentation:
http://Synth.Stromeko.net/Downloads.html#WaldorfDocs

Re: [ITA] wget

[Brian Inglis]

On 2020-11-14 08:19, Achim Gratz wrote:
> Brian Inglis writes:
>>> Yes, my time for cygwin has greatly diminished, so you are welcome to
>>> take over wget.
>>
>> Thanks Eric, good to know you're keeping so busy, expected under the circumstances!
>>
>> Not a great effort as there should be no to few more wget releases.
> 
> Your latest wget release is configured differently for 32bit and 64bit,
> most likely due to missing dependencies / development packages.  Since
> the BUILD_REQUIRES are completely missing it doesn't build at all on the
> CI.

I rebuilt with the original cygport updated minimally.
This is one of those packages that advertises minimal dependencies and documents 
none AFAICT.
Is there a way of determining desirable, useful, or additional dependencies?

I found cygcares-2.dll was missing(!) from cygwin 32, so reinstalled it, and 
libnpth-devel was not installed in either arch, so installed those, added all 
the lib...-devel and tools dependencies to BUILD_REQUIRES, and all the relevant 
configure --with/out-... options, so now both arches build with only minor 
--version output differences.

Is it sufficiently worth while to resolve with a release -2 package, as there 
may be no further upstream releases of the package, other than replacement by 
wget2?

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in binary units and prefixes, physical quantities in SI.]

Re: [ITA] wget

[ASSI]

Brian Inglis writes:
> I rebuilt with the original cygport updated minimally.

You're still supposed to search the configure log for any signs of it
not finding stuff you told it was available (like c-ares) and stuff that
you might not even now it wanted.

:-)

> This is one of those packages that advertises minimal dependencies and
> documents none AFAICT.

Everything older than about a year mostly looks like that.  Before
having the CI there wasn't a good way of figuring out the dependencies,
so almost nobody bothered with it.  It's still incomplete since the
dependencies pulled in by cygport will be assumed by the package (which
works only as long as these don't change).

> Is there a way of determining desirable, useful, or additional
> dependencies?

Usually the upstream documentation tells you their preferences.
Somtimes packages bundle dependencies, then you have to be careful to
direct the build to use the system libraries.  Additional dependencies
beyond those I tend to avoid.  I see you pulled in gnutls/nettle, I'd
rather use openssl unless upstream recommends against it.

Then you can look for the build specs on Linux distributions which
usually give you lots of clues (and often patches):

https://build.opensuse.org/package/view_file/openSUSE:Factory/wget/wget.spec?expand=1
https://src.fedoraproject.org/rpms/wget/blob/master/f/wget.spec

If in doubt, follow Fedora (like most other Cygwin packages).

> I found cygcares-2.dll was missing(!) from cygwin 32, so reinstalled
> it, and libnpth-devel was not installed in either arch, so installed
> those, added all the lib...-devel and tools dependencies to
> BUILD_REQUIRES, and all the relevant configure --with/out-... options,
> so now both arches build with only minor --version output differences.

Thank you.

I'm not really sure why you'd need libnpth and a bunch of other things.
You might want to add libattr-devel and see if xattr support gets
recognized.

> Is it sufficiently worth while to resolve with a release -2 package,
> as there may be no further upstream releases of the package, other
> than replacement by wget2?

Please re-release the fixed package so that both architectures are
equivalent.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Factory and User Sound Singles for Waldorf Blofeld:
http://Synth.Stromeko.net/Downloads.html#WaldorfSounds

Re: [ITA] wget

[Brian Inglis]

On 2020-11-15 00:36, ASSI wrote:
> Brian Inglis writes:
>> I rebuilt with the original cygport updated minimally.
> 
> You're still supposed to search the configure log for any signs of it
> not finding stuff you told it was available (like c-ares) and stuff that
> you might not even now it wanted.
> 
> :-)
> 
>> This is one of those packages that advertises minimal dependencies and
>> documents none AFAICT.
> 
> Everything older than about a year mostly looks like that.  Before
> having the CI there wasn't a good way of figuring out the dependencies,
> so almost nobody bothered with it.  It's still incomplete since the
> dependencies pulled in by cygport will be assumed by the package (which
> works only as long as these don't change).
> 
>> Is there a way of determining desirable, useful, or additional
>> dependencies?
> 
> Usually the upstream documentation tells you their preferences.
> Somtimes packages bundle dependencies, then you have to be careful to
> direct the build to use the system libraries.  Additional dependencies
> beyond those I tend to avoid.  I see you pulled in gnutls/nettle, I'd
> rather use openssl unless upstream recommends against it.

Build defaults to gnutls (as many GNU do now) so presumably previously used in 
our package releases and best tested (confirmed by some OpenSSL patch comments).

I now have another semi-useful adhoc packaging script to check build logs for 
program dependencies and | xargs which | xargs cygcheck -f for their packages.

> Then you can look for the build specs on Linux distributions which
> usually give you lots of clues (and often patches):
> 
> https://build.opensuse.org/package/view_file/openSUSE:Factory/wget/wget.spec?expand=1
> https://src.fedoraproject.org/rpms/wget/blob/master/f/wget.spec
> 
> If in doubt, follow Fedora (like most other Cygwin packages).

Yes, I've used both OBS and Fed elsewhere - added Fed patches to build -2.

>> I found cygcares-2.dll was missing(!) from cygwin 32, so reinstalled
>> it, and libnpth-devel was not installed in either arch, so installed
>> those, added all the lib...-devel and tools dependencies to
>> BUILD_REQUIRES, and all the relevant configure --with/out-... options,
>> so now both arches build with only minor --version output differences.
> 
> Thank you.
> 
> I'm not really sure why you'd need libnpth and a bunch of other things.

Supported, configured, specified.

> You might want to add libattr-devel and see if xattr support gets
> recognized.

Apparently not an option:

"configure: Disabling Extended Attribute support: your system is not known to 
support extended attributes."

likely to require a chunk of work, and no upstream support as now superseded.

>> Is it sufficiently worth while to resolve with a release -2 package,
>> as there may be no further upstream releases of the package, other
>> than replacement by wget2?
> 
> Please re-release the fixed package so that both architectures are
> equivalent.

Thanks for feedback and help - if you could please check out the latest cygport 
and CI jobs for any issues - I will upload upgrades if I hear nothing in a few 
days.

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in binary units and prefixes, physical quantities in SI.]

Re: [ITA] wget

[Achim Gratz]

Brian Inglis writes:
> Thanks for feedback and help - if you could please check out the
> latest cygport and CI jobs for any issues - I will upload upgrades if
> I hear nothing in a few days.

You should remove the files that are packaged for convenience and
configure re-generates when you do the full autoreconf.  You specify
those in DISTCLEANFILES and cygport removes them immediately after it
has unpacked the tar.  You may need to also list those in DIFF_EXCLUDES.
That should get rid of the spurious source patch in the package.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Samples for the Waldorf Blofeld:
http://Synth.Stromeko.net/Downloads.html#BlofeldSamplesExtra

Re: [ITA] wget

[Brian Inglis]

On 2020-11-16 10:23, Achim Gratz wrote:
> Brian Inglis writes:
>> Thanks for feedback and help - if you could please check out the
>> latest cygport and CI jobs for any issues - I will upload upgrades if
>> I hear nothing in a few days.
> 
> You should remove the files that are packaged for convenience and
> configure re-generates when you do the full autoreconf.  You specify
> those in DISTCLEANFILES and cygport removes them immediately after it
> has unpacked the tar.  You may need to also list those in DIFF_EXCLUDES.
> That should get rid of the spurious source patch in the package.

Thanks again for the feedback and help.

I dug up some Debian, Fedora, and OpenSuSE patches, and added them to the cygport.
OpenSuSE patches appear only to be available in their source package, or online 
in their HTML page, for which I came up with a script to grab a package's patch 
URLs, scrape those web pages for the patch source, and convert from HTML to 
patch text. Do you know if there is any way to access OBS patches as plain text?

This build avoids autoreconf (from Eric).
It would make sense to list DIFF_EXCLUDES in DISTCLEANFILES to avoid them being 
packaged in the first place, as long as that did not break the build.

So should I set DISTCLEANFILES to all the files *created* in the following log 
extracts, and set DIFF_EXCLUDES to those for which patches are created, or could 
more of each list be added to both?

"...
configure: creating ./config.status
config.status: creating Makefile
config.status: creating src/Makefile
config.status: creating doc/Makefile
config.status: creating util/Makefile
config.status: creating po/Makefile.in
config.status: creating tests/Makefile
config.status: creating fuzz/Makefile
config.status: creating lib/Makefile
config.status: creating testenv/Makefile
config.status: creating tests/certs/interca.conf
config.status: creating tests/certs/rootca.conf
config.status: creating src/config.h
config.status: linking 
/cygdrive/c/projects/wget/wget-1.20.3-2.i686/src/wget-1.20.3/GNUmakefile to 
GNUmakefile
config.status: executing depfiles commands
config.status: executing po-directories commands
config.status: creating po/POTFILES
config.status: creating po/Makefile
...
config.status: creating src/config.h
...
 >>> Creating source patches
  Makefile.in              |    8 +-
  aclocal.m4               |   58 +++---------------
  configure                |  147 +++++++++++++++++++++++++++++++++++++----------
  doc/Makefile.in          |    3
  fuzz/Makefile.in         |    3
  lib/Makefile.in          |    3
  src/Makefile.in          |    7 +-
  src/config.h.in          |    3
  testenv/Makefile.in      |    3
  tests/Makefile.in        |   12 ++-
  tests/certs/interca.conf |    2
  tests/certs/rootca.conf  |    2
  util/Makefile.in         |    3
..."

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in binary units and prefixes, physical quantities in SI.]

Re: [ITA] wget

[Achim Gratz]

Brian Inglis writes:
> I dug up some Debian, Fedora, and OpenSuSE patches, and added them to the cygport.
> OpenSuSE patches appear only to be available in their source package,
> or online in their HTML page, for which I came up with a script to
> grab a package's patch URLs, scrape those web pages for the patch
> source, and convert from HTML to patch text. Do you know if there is
> any way to access OBS patches as plain text?

Nothing that I've used before, but it wouldn't hurt to ask.  There
obviously is some sort of an API that the osc CLI is using (I don't know
any details of that either), but how far that extends to plain HTTPS
REST requests I don't know.

> This build avoids autoreconf (from Eric).

That is probably not urgent, but I'd check if it can be re-enabled.  For
a while Cygwin had a too old autoconf version that would not work with
some packages tha twere using the newer ones, but that's no longer an
issue I'd think.

> It would make sense to list DIFF_EXCLUDES in DISTCLEANFILES to avoid
> them being packaged in the first place, as long as that did not break
> the build.
>
> So should I set DISTCLEANFILES to all the files *created* in the
> following log extracts, and set DIFF_EXCLUDES to those for which
> patches are created, or could more of each list be added to both?

In principle you should remove all files that are recreated anyway in
DISTCLEANFILES.  Now, generated files showing up in the diff at all is a
likely deficiency in configure, as these should not be generated in the
source directory at all, I'd think.  But getting a project that isn't
quite cleaned up for a separate build dir to put the files in the right
place (and later find them) can be quite an adventure.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Waldorf MIDI Implementation & additional documentation:
http://Synth.Stromeko.net/Downloads.html#WaldorfDocs

Re: [ITA] wget

[Brian Inglis]

On 2020-11-17 12:10, Achim Gratz wrote:
> Brian Inglis writes:
>> I dug up some Debian, Fedora, and OpenSuSE patches, and added them to the cygport.
>> OpenSuSE patches appear only to be available in their source package,
>> or online in their HTML page, for which I came up with a script to
>> grab a package's patch URLs, scrape those web pages for the patch
>> source, and convert from HTML to patch text. Do you know if there is
>> any way to access OBS patches as plain text?
> 
> Nothing that I've used before, but it wouldn't hurt to ask.  There
> obviously is some sort of an API that the osc CLI is using (I don't know
> any details of that either), but how far that extends to plain HTTPS
> REST requests I don't know.
> 
>> This build avoids autoreconf (from Eric).
> 
> That is probably not urgent, but I'd check if it can be re-enabled.  For
> a while Cygwin had a too old autoconf version that would not work with
> some packages tha twere using the newer ones, but that's no longer an
> issue I'd think.
> 
>> It would make sense to list DIFF_EXCLUDES in DISTCLEANFILES to avoid
>> them being packaged in the first place, as long as that did not break
>> the build.
>>
>> So should I set DISTCLEANFILES to all the files *created* in the
>> following log extracts, and set DIFF_EXCLUDES to those for which
>> patches are created, or could more of each list be added to both?
> 
> In principle you should remove all files that are recreated anyway in
> DISTCLEANFILES.  Now, generated files showing up in the diff at all is a
> likely deficiency in configure, as these should not be generated in the
> source directory at all, I'd think.  But getting a project that isn't
> quite cleaned up for a separate build dir to put the files in the right
> place (and later find them) can be quite an adventure.

Thanks again, that appears to be working after I tracked down one outlyer, and I 
pushed the updates to run under CI, which now also builds and tests cleaner.

I will try defaulting src_compile to allow autoreconfig, and push if it works.

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in binary units and prefixes, physical quantities in SI.]

Re: [ITA] wget

[ASSI]

Achim Gratz writes:
> Brian Inglis writes:
>> I dug up some Debian, Fedora, and OpenSuSE patches, and added them to the cygport.
>> OpenSuSE patches appear only to be available in their source package,
>> or online in their HTML page, for which I came up with a script to
>> grab a package's patch URLs, scrape those web pages for the patch
>> source, and convert from HTML to patch text. Do you know if there is
>> any way to access OBS patches as plain text?
>
> Nothing that I've used before, but it wouldn't hurt to ask.  There
> obviously is some sort of an API that the osc CLI is using (I don't know
> any details of that either), but how far that extends to plain HTTPS
> REST requests I don't know.

As I suspected, that problem isn't exactly new and one solution is this
Git repo that mirrors OBS:

https://github.com/bmwiedemann/openSUSE

It covers openSUSE Factory/Tumbleweed only, but that should suffice for
your purposes.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Wavetables for the Waldorf Blofeld:
http://Synth.Stromeko.net/Downloads.html#BlofeldUserWavetables

[ITP] wget2

[Brian Inglis]

On 2020-07-08 14:05, Brian Inglis wrote:
> wget2 is the successor of wget supplying a shared library API like curl to
> build a modern, fast, multi-threaded, parallel downloader using HTTP/2, HTTP
> compression and If-Modified-Since headers; see:
>	https://gitlab.com/gnuwget/wget2
> It is currently available on Arch, Debian/Ubuntu, openSUSE, Slackware; see:

	https://repology.org/project/wget2/versions

Thanks for help getting here and also the upstream folks!

Please review wget2 repackaged into subpackages available under:

https://drive.google.com/drive/folders/1VVuC14KuB6uShm4FQL9BuXH0hpLYnIcJ?usp=sharing

Appveyor CI playground repo wget2 jobs:

	https://cygwin.com/cgi-bin2/jobs.cgi?id=1308

I have been dogfooding wget2 instead of wget in commands and cron jobs and it 
appears considerably faster, but does not support FTP or other protocols 
supported by curl or wget, and does not support wget --retr-symlinks=no option 
which retrieves symlink contents verbatim for analysis with readlink e.g. wget 
...-latest... and see if it points to the previous or a newer version.

For more compatibility info see:

	https://gitlab.com/gnuwget/wget2/-/wikis/home

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in binary units and prefixes, physical quantities in SI.]

Re: [ITP] wget2

[Hamish McIntyre-Bhatty]

[-- Attachment #1.1.1: Type: text/plain, Size: 1579 bytes --]

On 24/11/2020 21:06, Brian Inglis wrote:
> On 2020-07-08 14:05, Brian Inglis wrote:
>> wget2 is the successor of wget supplying a shared library API like
>> curl to
>> build a modern, fast, multi-threaded, parallel downloader using
>> HTTP/2, HTTP
>> compression and If-Modified-Since headers; see:
>>     https://gitlab.com/gnuwget/wget2
>> It is currently available on Arch, Debian/Ubuntu, openSUSE,
>> Slackware; see:
>
>     https://repology.org/project/wget2/versions
>
> Thanks for help getting here and also the upstream folks!
>
> Please review wget2 repackaged into subpackages available under:
>
> https://drive.google.com/drive/folders/1VVuC14KuB6uShm4FQL9BuXH0hpLYnIcJ?usp=sharing
>
>
> Appveyor CI playground repo wget2 jobs:
>
>     https://cygwin.com/cgi-bin2/jobs.cgi?id=1308
>
> I have been dogfooding wget2 instead of wget in commands and cron jobs
> and it appears considerably faster, but does not support FTP or other
> protocols supported by curl or wget, and does not support wget
> --retr-symlinks=no option which retrieves symlink contents verbatim
> for analysis with readlink e.g. wget ...-latest... and see if it
> points to the previous or a newer version.
>
> For more compatibility info see:
>
>     https://gitlab.com/gnuwget/wget2/-/wikis/home

I had a quick go on 32-bit Cygwin (figuring most people might try
64-bit), and it seems to work fine and be quite quick. I haven't
compiled the package but I'll find time soon hopefully - it's small so I
guess it doesn't take long.

Hamish



[-- Attachment #1.1.2: 0x87B761FE07F548D6.asc --]
[-- Type: application/pgp-keys, Size: 3235 bytes --]

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [ITP] wget2

[Brian Inglis]

On 2020-11-27 10:57, Hamish McIntyre-Bhatty via Cygwin-apps wrote:
> On 24/11/2020 21:06, Brian Inglis wrote:
>> On 2020-07-08 14:05, Brian Inglis wrote:
>>> wget2 is the successor of wget supplying a shared library API like
>>> curl to
>>> build a modern, fast, multi-threaded, parallel downloader using
>>> HTTP/2, HTTP
>>> compression and If-Modified-Since headers; see:
>>>      https://gitlab.com/gnuwget/wget2
>>> It is currently available on Arch, Debian/Ubuntu, openSUSE,
>>> Slackware; see:
>>
>>      https://repology.org/project/wget2/versions
>>
>> Thanks for help getting here and also the upstream folks!
>>
>> Please review wget2 repackaged into subpackages available under:
>>
>> https://drive.google.com/drive/folders/1VVuC14KuB6uShm4FQL9BuXH0hpLYnIcJ?usp=sharing
>>
>>
>> Appveyor CI playground repo wget2 jobs:
>>
>>      https://cygwin.com/cgi-bin2/jobs.cgi?id=1308
>>
>> I have been dogfooding wget2 instead of wget in commands and cron jobs
>> and it appears considerably faster, but does not support FTP or other
>> protocols supported by curl or wget, and does not support wget
>> --retr-symlinks=no option which retrieves symlink contents verbatim
>> for analysis with readlink e.g. wget ...-latest... and see if it
>> points to the previous or a newer version.
>>
>> For more compatibility info see:
>>
>>      https://gitlab.com/gnuwget/wget2/-/wikis/home
> 
> I had a quick go on 32-bit Cygwin (figuring most people might try
> 64-bit), and it seems to work fine and be quite quick. I haven't
> compiled the package but I'll find time soon hopefully - it's small so I
> guess it doesn't take long.

Thanks - nearly 15min on Appveyor with all the library, devel, and debuginfo 
bits involved.

-- 
Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada

This email may be disturbing to some readers as it contains
too much technical detail. Reader discretion is advised.
[Data in binary units and prefixes, physical quantities in SI.]

Re: [ITP] wget2

[Hamish McIntyre-Bhatty]

[-- Attachment #1.1.1: Type: text/plain, Size: 3207 bytes --]

On 27/11/2020 18:28, Brian Inglis wrote:
> On 2020-11-27 10:57, Hamish McIntyre-Bhatty via Cygwin-apps wrote:
>> On 24/11/2020 21:06, Brian Inglis wrote:
>>> On 2020-07-08 14:05, Brian Inglis wrote:
>>>> wget2 is the successor of wget supplying a shared library API like
>>>> curl to
>>>> build a modern, fast, multi-threaded, parallel downloader using
>>>> HTTP/2, HTTP
>>>> compression and If-Modified-Since headers; see:
>>>>      https://gitlab.com/gnuwget/wget2
>>>> It is currently available on Arch, Debian/Ubuntu, openSUSE,
>>>> Slackware; see:
>>>
>>>      https://repology.org/project/wget2/versions
>>>
>>> Thanks for help getting here and also the upstream folks!
>>>
>>> Please review wget2 repackaged into subpackages available under:
>>>
>>> https://drive.google.com/drive/folders/1VVuC14KuB6uShm4FQL9BuXH0hpLYnIcJ?usp=sharing
>>>
>>>
>>>
>>> Appveyor CI playground repo wget2 jobs:
>>>
>>>      https://cygwin.com/cgi-bin2/jobs.cgi?id=1308
>>>
>>> I have been dogfooding wget2 instead of wget in commands and cron jobs
>>> and it appears considerably faster, but does not support FTP or other
>>> protocols supported by curl or wget, and does not support wget
>>> --retr-symlinks=no option which retrieves symlink contents verbatim
>>> for analysis with readlink e.g. wget ...-latest... and see if it
>>> points to the previous or a newer version.
>>>
>>> For more compatibility info see:
>>>
>>>      https://gitlab.com/gnuwget/wget2/-/wikis/home
>>
>> I had a quick go on 32-bit Cygwin (figuring most people might try
>> 64-bit), and it seems to work fine and be quite quick. I haven't
>> compiled the package but I'll find time soon hopefully - it's small so I
>> guess it doesn't take long.
>
> Thanks - nearly 15min on Appveyor with all the library, devel, and
> debuginfo bits involved.

Okay, I get the following warnings:

configure: WARNING: unrecognized options: --without-lzip

configure: WARNING: *** No working backend for plugin support found

It also reports that there is no HSTS support.

I also get a bunch of warnings (for both 32-bit and 64-bit Cygwin) like:

libtool: warning: '-no-install' is ignored for x86_64-pc-cygwin
libtool: warning: assuming '-no-fast-install' instead
libtool: warning: '-no-install' is ignored for x86_64-pc-cygwin
libtool: warning: '-no-install' is ignored for x86_64-pc-cygwin
libtool: warning: '-no-install' is ignored for x86_64-pc-cygwin
libtool: warning: assuming '-no-fast-install' instead
libtool: warning: assuming '-no-fast-install' instead
libtool: warning: assuming '-no-fast-install' instead

At the end of compilation.

I guess the first warning can be dealt with by removing the (obsolete?)
option, but I'm not sure about the others/if they need fixing. I think
HSTS might be useful to have though.

Finally, I also get a source patch for src/version-text.h even though I
didn't patch it - maybe there needs to be an exception for that file?

All the steps including installing, packaging, and running unit tests
work for me on both 32-bit and 64-bit Cygwin, so it's just the warnings
that I have concerns about really.

Hamish


[-- Attachment #1.1.2: 0x87B761FE07F548D6.asc --]
[-- Type: application/pgp-keys, Size: 3235 bytes --]

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [ITP] wget2

[Achim Gratz]

Hamish McIntyre-Bhatty via Cygwin-apps writes:
> libtool: warning: '-no-install' is ignored for x86_64-pc-cygwin
[…]
> I guess the first warning can be dealt with by removing the (obsolete?)
> option

Nope, last I looked anyway.  That warning is given by a Cygwin specific
part of the toolchain and gets triggered regularly since the underlying
functionality simply can't work on Cygwin.  You can't really avoid it
since the replacment that is mentioned can't be explicitly invoked,
instead the same branch that emits the warning also sets the
corresponding hidden variable.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Wavetables for the Terratec KOMPLEXER:
http://Synth.Stromeko.net/Downloads.html#KomplexerWaves