Stalled import on Mac OS and Python 3.12

[danielhuppmann]

We just switched from pandas-data reader to wbdata as a dependency for the pyam package, see https://pyam-iamc.readthedocs.io.

I have the following issue on Mac OS 14.2.1, Python 3.12.2, using both Poetry 1.8.2 and pip 24.0: the kernel freezes upon doing import wbdata, with RAM of the kernel going up to 2GB.

There is no error message to report, because there is no error - just a freeze.
fyi @glatterf42

[OliverSherouse]

Thanks for this report. I've noticed that tests run slowly on Mac with Python 3.12, but I don't have a personal Mac to test. Are you using Pandas? If so, does it import ok?

[danielhuppmann]

All other imports on my machine work fine. And it seems that our test suite including an integration test with wbdata works fine on Mac OS and python 3.12, see test_data_worldbank.py here.

I made a PR in our package allowing me to skip wbdata locally for now, see IAMconsortium/pyam#833.

Not sure if there's anything that I can do to narrow down the problem, seems specific to my local environment.

[glatterf42]

Could this be related to Apple's 2021 transition to their own kind of processors? For ixmp, we had some people running into installation issues with that.
I don't own a Mac myself, but maybe you could check which kind of processor you are using vs the kind of processor the tests are using.

[shreyasgm]

Also have this issue with Python 3.11.8 and macOS Sonoma 14.3. However, the import had worked fine when I had run my script a couple of times before this, so I'm not sure if there's some rate limit I hit which blocked my machine? Tried the import with a VPN but that did not resolve the issue.

[shreyasgm]

On my mac, this was an issue with a corrupted package cache. I was able to fix this issue by deleting ~/Library/Caches/wbdata/1.0.0/cache.db.

[SunSeaLucky]

I also have the imoprting issue. I fixed it by rm -rf ~/Library/Caches/wbdata/1.0.0/cache.db.

However, I got stalled again when I try to call wbdata.get_data(indicator=indicators). Running on Mac OS 15.3.2, Python 3.11, wbdata 1.0.0.

The situation confused really me so much. @OliverSherouse @danielhuppmann

[OliverSherouse]

Since this is still an issue I had the AI take a whack at it and it turns out there's a different behavior for one of the underlying libraries on recent versions of python on Mac. wbdata 1.1.0 (just released!) should solve the problem.

[SunSeaLucky]

Thanks so much for you guys and such speed! 👍