Is it possible to pass an ADLS uri containing a st...
# general
b
Is it possible to pass an ADLS uri containing a storage account name instead of passing env / config variables? I'm getting this error `Azure Storage Account not set and is required. Set either
AzureConfig.storage_account
or the
AZURE_STORAGE_ACCOUNT
environment variable.` but I also see code attempting to parse it from the uri: https://github.com/Eventual-Inc/Daft/blob/main/src/daft-io/src/azure_blob.rs#L116. I'm not sure why that's not working. I'm using an abfs uri of the form
<abfs://container@account_name.dfs.core.windows.net/path/>
k
Hm, that's very strange. You should be correct to assume that we derive the account name from a URI like that. What version of Daft are you using?
b
I'm using the latest version - 0.6.7
k
Would you mind sharing the Python code you are trying to run?
b
sure
Copy code
import daft
from daft import col

daft.context.set_runner_ray()
df = daft.read_parquet(
    "<abfs://my_container@my_account_name.dfs.core.windows.net/path/to/in_dir/>"
)
df = df.groupby("group_col").agg(col("count_col").count()).count()
df.write_parquet(
    "<abfs://my_container@my_account_name.dfs.core.windows.net/path/to/out_dir/>"
)
(edited with the full context)
k
I'm stumped. I tried to reproduce your error and I was not able to. For now, I would recommend just passing in your storage account using
AzureConfig.storage_account
b
that's good to know - thanks for trying!