Cannot create Iceberg Table in Azure Blob Storage

[heman026]

Feature Request / Improvement

Hi
I am unable to create iceberg table in Azure blob storage using pyiceberg. I am getting the following error:

pyiceberg.exceptions.BadRequestError: IlleagalArgumentException: Location for ICEBERG_TABLE ''test.table' cannot be associated with any configured object storage location: Mandatory ADLS endpoint is not configured for storage account container@account.dfs.core.windows.net.

But I don't have any issues when creating tables using Pyspark.

Code:

catalog = load_catalog(name="nessie",
uri="http://10.xx.xx.xx:19120/iceberg",
properties={
 "ref"="main",
"type"="rest",
"warehouse": f"wasbs://container@account.blob.core.windows.net/warehouse",
"io-impl": "pyiceberg.io.fsspec.FsspecFileIO",
"azure.account-name": account
"azure.account-key": key

table = catalog.create_table(identifier="test.table",
schema=schema,
location=f"wasbs://container@account.blob.core.windows.net/warehouse/test/table")

Could you please resolve this issue

[kevinjqliu]

Thanks for reporting this! I think the problem is with FsspecFileIO and wasbs
I see that PyArrowFileIO supports wasbs

iceberg-python/pyiceberg/io/pyarrow.py

Line 417 in 8052652

elif scheme in {"abfs", "abfss", "wasb", "wasbs"}:

but FsspecFileIO does not

iceberg-python/pyiceberg/io/fsspec.py

Lines 233 to 234 in 8052652

	"abfs": _adls,
	"abfss": _adls,

Could you use abfs or abfss?
Otherwise, we can try adding wasbs to FsspecFileIO

[kevinjqliu]

related #1663

[kevinjqliu]

ah dependent on fsspec/adlfs#493