pip install ocassionally hangs

pip install ocassionally hangs

[Daniel Abrahamsson]

Hi,

Since some time ago (perhaps a week or two), "pip install" occassionally hangs.
Ctrl+C does not work. I have to kill the process via the task manager. I can
reproduce the problem somewhat reliably by running:

    pip install --force jenkins_job_builder==5.0.4

This is the last thing printed before the process hangs:

    Downloading requests-2.31.0-py3-none-any.whl (62 kB)
      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 1.2 MB/s eta 0:00:00
    Using cached certifi-2023.11.17-py3-none-any.whl (162 kB)
    Using cached charset_normalizer-3.3.2-py3-none-any.whl (48 kB)
    Downloading idna-3.6-py3-none-any.whl (61 kB)
      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/61.6 kB ? eta -:--:--

I tried attaching to the python39 process with strace and got the following
message repeated over and over again:

    --- Process 41672 (pid: 1250), exception c0000005 at 0000000000000000

Cygwin version: 3.5.0-0.615.g1c13ca67b506.x86_64
Python version: Python 3.9.18
pip version: pip 23.3.2

Regarding the Cygwin version, a colleague ran into the same problem on the 3.4
branch, so I don't think it is related to anything new on the 3.5 branch.

Any ideas on how to debug this?

Regards,
Daniel Abrahamsson

Re: pip install ocassionally hangs

[Marco Atzeri]

On 29/01/2024 17:00, Daniel Abrahamsson via Cygwin wrote:
> Hi,
> 
> Since some time ago (perhaps a week or two), "pip install" occassionally hangs.
> Ctrl+C does not work. I have to kill the process via the task manager. I can
> reproduce the problem somewhat reliably by running:
> 
>      pip install --force jenkins_job_builder==5.0.4
> 
> This is the last thing printed before the process hangs:
> 
>      Downloading requests-2.31.0-py3-none-any.whl (62 kB)
>        ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 1.2 MB/s eta 0:00:00
>      Using cached certifi-2023.11.17-py3-none-any.whl (162 kB)
>      Using cached charset_normalizer-3.3.2-py3-none-any.whl (48 kB)
>      Downloading idna-3.6-py3-none-any.whl (61 kB)
>        ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/61.6 kB ? eta -:--:--
> 
> I tried attaching to the python39 process with strace and got the following
> message repeated over and over again:
> 
>      --- Process 41672 (pid: 1250), exception c0000005 at 0000000000000000
> 
> Cygwin version: 3.5.0-0.615.g1c13ca67b506.x86_64
> Python version: Python 3.9.18
> pip version: pip 23.3.2
> 
> Regarding the Cygwin version, a colleague ran into the same problem on the 3.4
> branch, so I don't think it is related to anything new on the 3.5 branch.
> 
> Any ideas on how to debug this?
> 
> Regards,
> Daniel Abrahamsson
> 

what if you downgrade to 3.9.16 ?

Re: pip install ocassionally hangs

[Daniel Abrahamsson]

Marco Atzeri wrote:

> what if you downgrade to 3.9.16 ?

Thank you. Yes, downgrading solves the problem. The issue is probably the same as the one reported in "python3 3.9.18-1 hanging".

As I was testing this, I noticed a peculiar thing with the Cygwin Setup. I have a script that sets up my Cygwin environment. That scripts calls the installer with a list of packages. When I pin the python version using "python39=3.9.16-1,python39-devel=3.9.16-1", the installer downgrades to 3.9.16-1. But if I run the installer again with the same options, it updates to python 3.9.18-1.

Regards,
Daniel

Re: pip install ocassionally hangs

[Marco Atzeri]

On 30/01/2024 12:50, Daniel Abrahamsson via Cygwin wrote:
> Marco Atzeri wrote:
> 
>> what if you downgrade to 3.9.16 ?
> 
> Thank you. Yes, downgrading solves the problem. The issue is probably the same as the one reported in "python3 3.9.18-1 hanging".
> 
> As I was testing this, I noticed a peculiar thing with the Cygwin Setup. I have a script that sets up my Cygwin environment. That scripts calls the installer with a list of packages. When I pin the python version using "python39=3.9.16-1,python39-devel=3.9.16-1", the installer downgrades to 3.9.16-1. But if I run the installer again with the same options, it updates to python 3.9.18-1.
> 
> Regards,
> Daniel
> 

I reset 3.9.18-1 as test, but the propagation will need some time to
be recognized by the Cygwin server and to passed to the mirrors

After that Setup should stop to propose upgrade to 3.9.18

Regards
Marco

Re: pip install ocassionally hangs

[Marco Atzeri]

On 30/01/2024 14:21, Marco Atzeri wrote:
> On 30/01/2024 12:50, Daniel Abrahamsson via Cygwin wrote:
>> Marco Atzeri wrote:
>>
>>> what if you downgrade to 3.9.16 ?
>>
>> Thank you. Yes, downgrading solves the problem. The issue is probably 
>> the same as the one reported in "python3 3.9.18-1 hanging".
>>
>> As I was testing this, I noticed a peculiar thing with the Cygwin 
>> Setup. I have a script that sets up my Cygwin environment. That 
>> scripts calls the installer with a list of packages. When I pin the 
>> python version using "python39=3.9.16-1,python39-devel=3.9.16-1", the 
>> installer downgrades to 3.9.16-1. But if I run the installer again 
>> with the same options, it updates to python 3.9.18-1.
>>
>> Regards,
>> Daniel
>>
> 
> I reset 3.9.18-1 as test, but the propagation will need some time to
> be recognized by the Cygwin server and to passed to the mirrors
> 
> After that Setup should stop to propose upgrade to 3.9.18
> 

Hi Daniel,

I have not forgot the issue, I can replicate the issue and
running as

$ PYTHONUNBUFFERED=1 PYTHONVERBOSE=1 pip3 install --force 
jenkins_job_builder==5.0.4

it goes a bit further, but at the end stop again

It seems some type of race on 3.9.18 (both -1 and -2, so irrelevant on 
my simple patch trial)

I will see if 3.9.17 has the same issue and after that bisecting until I 
find the upstream change that has problem on Cygwin.

Thanks again for the test case

Regards
Marco