RE: Using the new Azure filesystem object (C++)

2024-07-10 Thread Jerry Adair via user
Hi Kou! Well, I thought it was strange too. I was not aware that if data lake storage is available then AzureFS will use it automatically. Thank you for that information, it helps. With that in mind, I commented out both of those lines and just let the default values be assigned (which occur

Re: Using the new Azure filesystem object (C++)

2024-07-10 Thread Sutou Kouhei
Hi, > azureOptions.blob_storage_authority = ".dfs.core.windows.net"; // If I > don't do this, then the > // > blob.core.windows.net is used; > // I > w

Using the new Azure filesystem object (C++)

2024-07-10 Thread Jerry Adair via user
Hi- I am attempting to use the new Azure filesystem object in C++. Arrow/Parquet version 16.0.0. I already have code that works for GCS and AWS/S3. I have been waiting for quite a while to see the new Azure filesystem object released. Now that it has in this version (16.0.0) I have been try

Re: [C++] How to add user defined functions to arrow compute

2024-07-10 Thread Felipe Oliveira Carvalho
The parameter to VisitArraySpanInline should be Int64Type and not int64_t. Are you going to keep nulls in plain text? PrealocateBinaryArrayForMyEncryption() was just a placeholder. You can call `Reserve()` on the builder to make the builder preallocate buffers so that Append*() don't have to grow