Re: [DISCUSS] Drop Java 8 support

2024-04-25 Thread James Duong
If we dropped JDK 8, we could use the JDK to compile module-info.java files. Then we could remove the custom maven plugin we’re using for compiling module-info.java files for JPMS support and get better IDE integration (as what we’re doing currently somewhat shoe-horns module information alongsi

Re: Unsupported/Other Type

2024-04-10 Thread James Duong
It’s worth noting that this maps well to the User data type field in the XdbcTypeInfo APIs for Flight SQL. From: David Li Date: Wednesday, April 10, 2024 at 3:23 PM To: dev@arrow.apache.org Subject: Re: Unsupported/Other Type I think this should be an extension type, yes. It could be parametri

[DISCUSS] Flight SQL Experimental status in docs

2024-03-21 Thread James Duong
Hi, We fairly recently merged a PR to remove the experimental status for Flight SQL from maven: https://github.com/apache/arrow/pull/39040 However our public documentation still has a warning saying Flight SQL is experimental: https://arrow.apache.org/docs/format/FlightSql.html “Flight SQL is

Re: [VOTE] Stateless prepared statements in FlightSQL

2024-03-21 Thread James Duong
+1 (non-binding) Thanks for the work on this Adam and Andrew! Get Outlook for Android From: David Li Sent: Thursday, March 21, 2024 8:40:10 AM To: dev@arrow.apache.org Subject: Re: [VOTE] Stateless prepared statements in FlightSQL +1 Th

Re: [ANNOUNCE] New Arrow committer: Bryce Mecum

2024-03-18 Thread James Duong
Congratulations Bryce! From: Dane Pitkin Date: Monday, March 18, 2024 at 7:28 AM To: dev@arrow.apache.org Subject: Re: [ANNOUNCE] New Arrow committer: Bryce Mecum Congratulations, Bryce!! On Mon, Mar 18, 2024 at 9:18 AM David Li wrote: > Congrats Bryce! > > On Mon, Mar 18, 2024, at 08:52, Ian

Re: [VOTE] Explicit session management for Flight RPC

2024-02-15 Thread James Duong
+1 From: Sutou Kouhei Date: Thursday, February 15, 2024 at 12:58 PM To: dev@arrow.apache.org Subject: Re: [VOTE] Explicit session management for Flight RPC +1 In "[VOTE] Explicit session management for Flight RPC" on Wed, 14 Feb 2024 11:38:24 -0500, "David Li" wrote: > Paul Nienaber wou

Re: [DISCUSS] Flight RPC: add 'fallback' URI scheme

2024-02-12 Thread James Duong
This seems like a good idea, and also improves consistency with clients that erroneously assumed that the service endpoint was always in the list of endpoints. From: Antoine Pitrou Date: Monday, February 12, 2024 at 6:05 AM To: dev@arrow.apache.org Subject: Re: [DISCUSS] Flight RPC: add 'fallb

Re: [VOTE] Accept donation of Comet Spark native engine

2024-01-27 Thread James Duong
+1 (non-binding) Get Outlook for Android From: Matt Topol Sent: Saturday, January 27, 2024 3:22:01 PM To: dev@arrow.apache.org Subject: Re: [VOTE] Accept donation of Comet Spark native engine +1 (binding) On Sat, Jan 27, 2024, 6:00 PM We

Re: ADBC: xdbc_data_type and xdbc_sql_data_type

2024-01-11 Thread James Duong
data always comes back as Arrow (unlike ODBC and JDBC where you can get a cell as whatever the ODBC/JDBC conversion tables allow). From: Curt Hagenlocher Date: Thursday, January 11, 2024 at 11:04 AM To: dev@arrow.apache.org Cc: James Duong Subject: Re: ADBC: xdbc_data_type and xdbc_sql_data_type

Re: [VOTE] Accept donation of flightsql-odbc

2024-01-05 Thread James Duong
+1 From: Santiago Mota Date: Friday, January 5, 2024 at 7:49 AM To: dev@arrow.apache.org Subject: Re: [VOTE] Accept donation of flightsql-odbc +1 Enviado desde Yahoo Mail con Android El vie, ene 5, 2024 a 16:41, David Li escribió: Hello, This vote is to determine if the Arrow PMC is in fa

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-13 Thread James Duong
r the memory > module) that would be best. > > On Wed, Dec 13, 2023, at 12:33, James Duong wrote: > > For the work on modularization, I’ve merged the flight-grpc and > > flight-core modules. I haven’t moved any other packages. > > > > I also encountered this problem w

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-13 Thread James Duong
It's not clear to > me anyways that the current split would actually be helpful if we do ever > want to support Flight without gRPC. > > On Tue, Dec 12, 2023, at 14:21, James Duong wrote: > > An update on this work. > > > > I’ve been able to update the following to JPM

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-12 Thread James Duong
this (currently we only have Flight using grpc in Java). After Flight I’d take a look at the modules that have native code: * arrow-c-data * arrow-orc * arrow-dataset * arrow-gandiva From: James Duong Date: Tuesday, December 5, 2023 at 1:39 PM To: dev@arrow.apache.org Subject

Re: [DISCUSS] Flight SQL as experimental

2023-12-06 Thread James Duong
+1 from me. It's used in a good number of databases now. Get Outlook for Android From: David Li Sent: Wednesday, December 6, 2023 9:59:54 AM To: dev@arrow.apache.org Subject: [DISCUSS] Flight SQL as experimental Flight SQL has been marked

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-05 Thread James Duong
wrote: > Thanks James for delving into this mess. > > It looks like this change is unavoidable if we want to modularize? I think > this is OK. Will the CLI argument change as we continue modularizing, or is > this the only change that will be needed? > > On Mon, Dec 4, 2023,

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-04 Thread James Duong
requires refactoring much of the memory module code and implementing a module using the foreign memory interface. From: James Duong Date: Tuesday, November 28, 2023 at 6:48 PM To: dev@arrow.apache.org Subject: Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System Hi, I’ve

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-11-28 Thread James Duong
movement, new command-line argument requirements) happens within one major Arrow version. From: James Duong Date: Tuesday, November 21, 2023 at 1:16 PM To: dev@arrow.apache.org Subject: Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System I’m following up on this topic

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-11-21 Thread James Duong
I’m following up on this topic. David has a PR from last year that’s done much of the heavy lifting for refactoring the codebase to be package-friendly. https://github.com/apache/arrow/pull/13072 What’s changed since and what’s left: * New components have been added (Flight SQL for example)

Re: [ANNOUNCE] New Arrow committer: James Duong

2023-11-16 Thread James Duong
Thank you, everyone! From: Rok Mihevc Date: Thursday, November 16, 2023 at 7:14 AM To: dev@arrow.apache.org Subject: Re: [ANNOUNCE] New Arrow committer: James Duong Congrats James! On Thu, Nov 16, 2023 at 3:58 PM Kevin Gurney wrote: > Congratulations, Ja

Re: DISCUSS: [FlightSQL] Catalog support

2023-02-14 Thread James Duong
Mon, 12 Dec 2022 18:12:06 +, James Duong wrote: > Hi David, > > I've written up the URI parsing in C++ and started adding session management > messages. I'm also planning on having the ClientCookieMiddlewareFactory be > able to report if sessions are enabled on the

Re: DISCUSS: ADBC Press Release

2023-01-17 Thread James Duong
ttps://arrow.apache.org/blog/2023/01/05/introducing-arrow-adbc/ > > [2] > > > https://github.com/apache/arrow-site/blob/master/_posts/2023-01-05-introducing-arrow-adbc.md > > > > On Wed, Jan 11, 2023 at 8:02 AM James Duong > > wrote: > > > >> Hi, >

DISCUSS: ADBC Press Release

2023-01-10 Thread James Duong
Hi, In the ADBC blog entry that Flight SQL was mentioned as a vendor-specific protocol and s Dremio is mentioned in the same sentence. The intent of the Flight SQL was to be database agnostic and this sort of implies Flight SQL as a Dremio-specific protocol which is not really what we want. P

Re: [Java]: Failures building Java pom

2022-12-13 Thread James Duong
you could try the instructions at > https://arrow.apache.org/docs/developers/java/index.html for the 10.0 > instructions. > > Hope that helps > > On Mon, Dec 12, 2022 at 7:18 PM James Duong .invalid> > wrote: > > > I have been trying to build Java from the root pom

[Java]: Failures building Java pom

2022-12-12 Thread James Duong
Arrow Plasma Client SUCCESS [ 6.158 s] [INFO] Arrow Flight ... SUCCESS [ 2.107 s] [INFO] Arrow Flight Core .. FAILURE [ 27.441 s] Does anyone know why this might be failing? Thanks -- *James

Re: DISCUSS: [FlightSQL] Catalog support

2022-12-12 Thread James Duong
>> > Thanks again -- it is amazing to hit some issue in design and then find >> out >> > the Arrow community is already hard at work on a solution. >> > >> > Andrew >> > >> > [1] https://github.com/influxdata/influxdb_iox/issues/6102 >&g

Re: DISCUSS: [FlightSQL] Catalog support

2022-11-30 Thread James Duong
er/cookie-based) > - A mapping from URI parameters and fields to session data > > > > On Tue, Nov 22, 2022, at 17:45, James Duong wrote: > > Just following up on this and if there are any thoughts. > > > > The purpose would be to standardize how we specify access t

Re: DISCUSS: [FlightSQL] Catalog support

2022-11-22 Thread James Duong
specifying a resource in an HTTP URL (ie an endpoint) which should make it easy for end users to work with and modify. On Fri, Nov 18, 2022 at 3:17 PM James Duong wrote: > As for surfacing catalogs itself, perhaps we allow the URI take in a path > and treat that as a way of specifying a multi

Re: DISCUSS: [FlightSQL] Catalog support

2022-11-18 Thread James Duong
having better support for this makes sense, but perhaps we can > > >> find a way to make it not tied to the connection itself? For instance, > > in > > >> the same way transactions were implemented (as a handle). Or rather, > > >> instead of adding conn

DISCUSS: [FlightSQL] Catalog support

2022-11-09 Thread James Duong
ional RPC for Flight SQL applications that need this) - Related to the above, expand the connection URL and Java builder to allow arbitrary application-specific properties. - Add optional RPCs for changing the catalog and relevant error codes if this is not permitted. -- *James Duong* Lead Software

DISCUSS: [FlightSQL] Data-source specific connection context

2022-10-21 Thread James Duong
in mind (https://github.com/apache/arrow/pull/8572 ) Does the ADBC driver for Flight SQL also do this? -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitquilltech.com This email message is for the sole use of the

Re: [VOTE] Substrait for Flight SQL

2022-08-31 Thread James Duong
: Accept the proposal > > > > [ ] 0 : No opinion > > > > [ ] -1 : Do not accept this proposal because... > > > > > > > > [1]: https://substrait.io/ > > > > [2]: > https://lists.apache.org/thread/l6j0nc43y7czs2m4kpzrckmrtgr9qs9z > >

Re: Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-08-02 Thread James Duong
re about 32 bits worry about the warnings in > the > > > headers. > > > > > > Regards, > > > Arkadiy > > > > > > From: dev@arrow.apache.org At: 07/22/22 10:18:09 UTC-4:00To: > > > dev@arrow.apache.org > > > Subject: Re:

[DISCUSS][FlightRPC] Lifetime of endpoints

2022-08-02 Thread James Duong
f existing headers from the originating request can be re-used. -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitquilltech.com This email message is for the sole use of the intended recipient(s) and may contain co

[FlightSQL][JDBC] Additional changes to the JDBC driver

2022-08-02 Thread James Duong
-driver branch? -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitquilltech.com This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-25 Thread James Duong
rrow libs. > >> > > >> > 2) Let those users who care about 32 bits worry about the warnings in > the > >> > headers. > >> > > >> > Regards, > >> > Arkadiy > >> > > >> > From: dev@arrow.apache.org At: 07/22/

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-22 Thread James Duong
> From: dev@arrow.apache.org At: 07/22/22 10:18:09 UTC-4:00To: > dev@arrow.apache.org > Subject: Re: Help needed with PR #13659: Fixing build/unit test issues in > msvc/win32 > > > Ah, that's a good point. Then we should probably use explicit casts. > > > Le 22/07

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-22 Thread James Duong
t; > >>>>> 2) AMD64 MacOS 10.15 Python 3 > >>>>> > >>>>> E ImportError: > >> dlopen(/usr/local/lib/python3.9/site-packages/pyarrow/ > >>>>> lib.cpython-39-darwin.so, 2): Symbol not found: > >>>>> __

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-21 Thread James Duong
cc.o) > > > > google::protobuf::MessageLite::~MessageLite() in > > > > libopentelemetry_proto.a(common.pb.cc.o) > > > > google::protobuf::MessageLite::~MessageLite() in > > > > libopentelemetry_proto.a(resource.pb.cc.o) > > >

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-21 Thread James Duong
Could NOT find SnappyAlt (missing: Snappy_LIB Snappy_INCLUDE_DIR) > > > -- Building snappy from source > > > CMake Error at C:/Program > > > > > > Files/CMake/share/cmake-3.23/Modules/FindPackageHandleStandardArgs.cmake:230 > > > (message): > > > Could

Re: [Flight][Java][JDBC] IP clearance of Flight JDBC Driver

2022-07-12 Thread James Duong
t; history > > > > [1]: https://incubator.apache.org/ip-clearance/arrow-rust-ballista.html > > [2]: https://lists.apache.org/thread/khk8b06t5wrsg2xmprcqglb7dl76x20r > > > > On Thu, Apr 7, 2022, at 17:02, James Duong wrote: > >> I have started a PR for merging to

Re: Cpp Win32/MSVC build

2022-07-03 Thread James Duong
long index; // NOLINT > >if (_BitScanForward(&index, value)) { > > return static_cast(index); > > @@ -245,7 +252,7 @@ static inline int CountTrailingZeros(uint64_t value) > { > > #if defined(__clang__) || defined(__GNUC__) > >if (value == 0) retur

Re: [FlightSQL] Structured/Serialized representation of query (like JSON) rather than SQL string possible?

2022-06-30 Thread James Duong
itial > >> > >> >> thought is a property in GetSqlInfo. > >> > >> > > >> > >> > > >> > >> > This sounds reasonable. > >> > >> > > >> > >> > > >> > >> >&g

Re: [VOTE] Accept donation of Flight SQL JDBC driver

2022-06-30 Thread James Duong
/lists.apache.org/thread/q5mn906m5788zxppjpcqvltxppc4sol0 > > [2]: > https://svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/arrow-flight-sql-jdbc-driver.xml > > [3]: https://github.com/apache/arrow/pull/12830 > > > > Best, > > David > -- *Jam

Re: [VOTE] Extend Arrow Flight SQL with more SQL type info in schemas

2022-04-20 Thread James Duong
> https://lists.apache.org/thread/ynlyjcc5k66dbjphv485nl2nt6ztbbzt > [2]: https://github.com/apache/arrow/pull/12254 > [3]: https://github.com/apache/arrow/pull/12747 > > Thanks, > David -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | j

Re: [DISCUSS] A book about Apache Arrow

2022-04-20 Thread James Duong
rchical-dp-1801071039/dp/1801071039/ > ). > > Thanks much for your time everyone! Hope to hear back from someone soon. > > Matthew Topol Vice President, Principal Software Architect > mto...@factset.com<mailto:mto...@factset.com> T 203.810.1804 FactSet > Resear

Re: Remote datasets

2022-04-12 Thread James Duong
> > I was trying to browse the JIRA issues, but the future picture wasn't clear > based on that > > Best regards, > Adam Lippai > -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitquil

Re: [Flight][Java][JDBC] IP clearance of Flight JDBC Driver

2022-04-07 Thread James Duong
against that branch. (Development can continue in the meantime, since I see > that it's now proceeding on the current GitHub PR, but I think we just need > a stable target to merge for the IP clearance) > > > > > > [1]: > https://incubator.apache.org/ip-clearance/ip

[Flight][Java][JDBC] IP clearance of Flight JDBC Driver

2022-03-30 Thread James Duong
Following up on today's sync-up: We're looking to start IP clearance of the JDBC driver in https://github.com/apache/arrow/pull/12254 I believe we discussed merging the PR into a branch to start the process. What else is involved in this process? -- *James Duong* Lead Software Dev

[C++][Java][FlightSQL] GetSqlInfo properties

2022-03-21 Thread James Duong
ers to support these properties, it'd probably be best to treat these as non-custom, but at the expense of making bridge-specific concepts "standard". I've also observed that there are missing enums and enum values in the C++ definitions of the properties in arrow/flight/sql/types.h --

Re: [FlightSQL] Higher-level facade API to increase adoption/audience? Or does this belong as a personal project

2022-03-15 Thread James Duong
of data and > > >> > servicing OLAP-type workloads > > >> > But the thing that excites me most about FlightSQL, isn't its > > performance > > >> > (always nice to have), but that it's a language-agnostic standard > for > > >> data > > >> >

Re: [VOTE] Release Apache Arrow 7.0.0 - Java artifacts

2022-03-11 Thread James Duong
flight-sql-7.0.0.pom > > > > > > You can find them at > > > > > > https://repository.apache.org/content/repositories/staging/org/apache/arrow/ > > > . > > > > > > Could someone start a vote for them? Any PMC member can > > &

Re: [PROPOSAL][RELEASE] Arrow 7.0.1

2022-03-10 Thread James Duong
m not too sure how procedures work here, but is it possible to > just vote and upload the missing 7.0.0 artifacts, instead of going through > the whole release process? > > > > On Wed, Mar 9, 2022, at 13:23, James Duong wrote: > >> Hi, > >> > >> I would l

[PROPOSAL][RELEASE] Arrow 7.0.1

2022-03-09 Thread James Duong
Hi, I would like to propose an Arrow 7.0.1 release. The main reason is to make Flight SQL Java artifacts available on maven central ( https://issues.apache.org/jira/browse/ARROW-15746). I'd be happy to help facilitate this (and learn the release process) for this. -- *James Duong*

Re: [FlightSQL] Structured/Serialized representation of query (like JSON) rather than SQL string possible?

2022-03-04 Thread James Duong
PM Gavin Ray wrote: > @James Duong > > You are absolutely right, I realized this and confirmed whether this > would be possible with Jacques to double-check. > It would amount to what I might call "dollar-store Substrait." It's not > elegant or a good solutio

Re: [FlightSQL] Structured/Serialized representation of query (like JSON) rather than SQL string possible?

2022-03-03 Thread James Duong
nly > > representation > > > for queries is as SQL strings. > > > > > > Is there any kind of lower-level API that can be used to express > > operations? > > > > > > IE instead of "SELECT name FROM user" > > > > > >

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread James Duong
> > GeoData JSON vs Binary > >>> > > > >>> > > - Binary doesn’t seem very hard in the majority of cases > >>> > > > >>> > > - base64 might add unnecessary overhead > >>> > > > >>> > > > >

Re: Flight/FlightSQL Optimization for Small Results?

2022-03-01 Thread James Duong
ia FlightInfo. I think if a > > server does return a ticket then it should be able to handle it. > > > > [1] https://github.com/apache/arrow/blob/master/format/Schema.fbs#L67 > > > > > > On Mon, Feb 28, 2022 at 11:30 AM James Duong > > wrote: > > > >&g

Re: Flight/FlightSQL Optimization for Small Results?

2022-02-28 Thread James Duong
; >> wrote: > >> > > >> >> I'm rereviewing the Flight SQL interfaces, and I'm not sure if I'm > >> missing > >> >> it but is there any optimization for small results? My concern is > that > >> the > >>

Re: [FlightSQL] Flight as a cross-language JDBC driver?

2022-02-22 Thread James Duong
y > the ability to > re-use existing JDBC drivers, albeit at a bit of a performance cost right? > > Seems like it could be useful, but I thought there might be a reason why > someone hadn't done this (Chesterton's Fence) > Thank you =) > > Gavin Ray. > -

Re: [RESULT][VOTE] Proposed addition to Arrow Flight: Arrow Flight RPC

2022-01-04 Thread James Duong
eview. Just in time for > > the holidays, Flight SQL has now been merged into the main branch, thanks > > again to everyone who participated! > > > > I will begin reviewing the additional proposals next. > > > > -David > > > > On Fri, Dec 17, 2021, a

Re: [RESULT][VOTE] Proposed addition to Arrow Flight: Arrow Flight RPC

2021-12-17 Thread James Duong
ut what exactly you mean by additional column metadata, > but if it's just going to be encoded into the key-value metadata then I > don't see a problem there. (As in: it sounds like it fits in the Field > class given it's encoded in the Field metadata!) > > -David >

Re: [RESULT][VOTE] Proposed addition to Arrow Flight: Arrow Flight RPC

2021-12-16 Thread James Duong
> > > > Is there an integration test between the two > languages? > > > > > > > >> > > > > > > > > > > >> > > > On Tue, Dec 7, 2021 at 1:35 PM David Li < > > > > lidav...@apache.org> > > > &g

getFlightInfo behavior

2021-07-27 Thread James Duong
hould be able to retrieve from any endpoint in any order (and do so concurrently) without having to order the data at the end. If the order of the data is significant, I'd expect the producer to just return one endpoint with data in the correct order. Is this the case? -- *James Duong* Lea

[FlightRPC][C++][Python] Exposing internal middlewares

2020-11-16 Thread James Duong
e the way to go, although less efficient. The latter is obviously less convoluted, but brings up issues if we ever change the Python implementation from being a wrapper around C++. -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam.

Re: Arrow 2.0.0 versioning

2020-11-03 Thread James Duong
Thanks. I ran the command and created a PR: https://github.com/apache/arrow/pull/8577 On Mon, Nov 2, 2020 at 11:14 PM Krisztián Szűcs wrote: > On Tue, Nov 3, 2020 at 5:07 AM James Duong > wrote: > > > > I can go ahead and make the change, but should this get force pushed

[Discuss] Arrow Release Schedule

2020-11-02 Thread James Duong
Hello, My understanding is that Arrow releases are 3 months apart. Are there any plans for a more frequent release cadence? Do we have a guide for what goes into major releases vs. minor releases vs. patch releases? Thanks, -- *James Duong* Lead Software Developer Bit Quill Technologies Inc

Re: Closing of Server Resources

2020-11-02 Thread James Duong
en add a "close" Action to the server which > > would invoke the closeHandler for release of the session resources. > > > > We would then maintain a clear distinction between stateless > FlightServers > > and those that opt into session headers where there may be

Re: Arrow 2.0.0 versioning

2020-11-02 Thread James Duong
g similar > > On Mon, Nov 2, 2020 at 6:12 PM James Duong > wrote: > > > > Hi, > > > > I noticed that in the Java POM files, the version in master is still > 2.0.0 > > even after the release. This patch updated versions to 3.0.0-SNAPSHOT

Arrow 2.0.0 versioning

2020-11-02 Thread James Duong
Hi, I noticed that in the Java POM files, the version in master is still 2.0.0 even after the release. This patch updated versions to 3.0.0-SNAPSHOT in other languages: https://github.com/apache/arrow/commit/b1f36acca85d0845c1e64c0a3270651d4a1467b7 -- *James Duong* Lead Software Developer Bit

Re: [FlightRPC][Java] HTTP cookie support

2020-10-30 Thread James Duong
rhead searching for the Set-Cookie header. On Fri, Oct 30, 2020 at 7:05 AM David Li wrote: > Hey James, > > I looked over the PR and it seems quite straightforward - thanks for > contributing this. > > Best, > David > > On 10/29/20, James Duong wrote: > > Hi all,

[FlightRPC][Java] HTTP cookie support

2020-10-29 Thread James Duong
ed as Ignore for now. -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitquilltech.com This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any

Re: mutual TLS peer_identity in arrow flight

2020-10-26 Thread James Duong
f there is a flight Authentication Handler, the lower level > identity > > would be ignored (but that is the case in the current implementation > > already). > > > > I can send out a PR unless there is another solution in the works > -- *James Duong* Lead Softw

Flight gRPC version and disabling server verification in C++ [was Re: 2.0.0 release timeline: October 9]

2020-10-08 Thread James Duong
r build with the bundled grpc included. > That's > > > > not > > > > > a bad experience, and if the user doesn't like it, presumably they > can > > > > > upgrade system gRPC and rebuild. > > > > > > > > How do you upgrade

Re: 2.0.0 release timeline: October 9

2020-10-07 Thread James Duong
a > > problem with requiring a < 1 year old version of gRPC > > > > On Wed, Oct 7, 2020 at 2:23 PM Antoine Pitrou > wrote: > >> > >> > >> Le 07/10/2020 à 21:19, James Duong a écrit : > >>> Hi Neal, > >>> > >>> A

Re: 2.0.0 release timeline: October 9

2020-10-07 Thread James Duong
, October 9. > >> > > >> > According to > >> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+2.0.0+Release > , > >> > there are still 178 issues tagged for 2.0 that are not yet started. > That > >> > seems... ambitious

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-05 Thread James Duong
27;re disabling validation? (Also, is there > a bug report for gRPC/would you like to file one?) > > For #2, I think you can get cmake to pass -D flags, perhaps you can > get it to define a symbol you can check (though that is maybe not a > preferable solution). > > David > >

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-05 Thread James Duong
ersions.txt[2], for the other > CI builds it's set in various config files. > > Best, > David > > [1]: https://arrow.apache.org/docs/developers/cpp/building.html > [2]: > https://arrow.apache.org/docs/developers/cpp/building.html#bundled-dependency-versions > > On

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-02 Thread James Duong
p starting with 1.30.x - Where do we specify which version of gRPC we depend on? In java it's in maven and looks to be 1.30.2. - The Java implementation looks fairly straightforward. - Python implementation is pending. - Tests are pending. On Wed, Sep 30, 2020 at 8:12 A

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-09-30 Thread James Duong
Will do David. I've created a JIRA for the TLS_SNI extension as well: https://issues.apache.org/jira/browse/ARROW-10144 On Wed, Sep 30, 2020 at 7:52 AM David Li wrote: > Hi James, > > Please feel free to tag me as a reviewer if needed. > > Best, > David > > O

[FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-09-28 Thread James Duong
Hi Arrow-Dev, I've created a JIRA for supporting using Flight clients to connect to Flight servers without verifying the server certificate. This is something I've seen done frequently for other connectivity tools such as JDBC drivers. I'll be looking to implement this one for the and hopefully

Re: [Flight Format] Authentication Redesign

2020-09-04 Thread James Duong
va) and much more limited (unless recent > versions changed this). C++/Python might function better as a set of > middleware implementations in the client which can attach/read headers > as necessary. > > David > > On 9/2/20, James Duong wrote: > > Looking towards th

Re: [Flight Format] Authentication Redesign

2020-09-02 Thread James Duong
o attend tomorrow, but seeing as I've been commenting > so far - the changes as summarized in the presentation (+I think the > latest comments in the doc) look good to me, thanks for working > through the proposal with us. > > Best, > David > > On 9/1/20, James Duong wro

Re: [Flight Format] Authentication Redesign

2020-09-01 Thread James Duong
020, 13:12 James Duong wrote: > Hi everyone, > I've updated the PR and responded to comments in the proposal document. > > The PR now makes handshake optional and sends auth information with every > request. > The client now needs to supply a CredentialCallOption containing

Re: Authentication Redesign

2020-08-26 Thread James Duong
to a gRPC CallCredentials under the hood, and use that to write headers. On Thu, Aug 20, 2020 at 2:14 PM James Duong wrote: > Comments should be enabled now. > > Thanks for the feedback so far. > -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct:

Re: Authentication Redesign

2020-08-20 Thread James Duong
Comments should be enabled now. Thanks for the feedback so far.

Re: Authentication Redesign

2020-08-20 Thread James Duong
540852009 | rym...@dremio.com > > > > On Wed, Aug 19, 2020 at 9:43 PM James Duong > wrote: > > > Hi Arrow-Dev, > > > > I've written up a proposal to make some enhancements to the > authentication > > process. I've captured the overall g

Authentication Redeisgn

2020-08-19 Thread James Duong
pabilities) as part of the proposal. I've written a POC of the proposed changes here for authentication only (not the handshake): https://github.com/apache/arrow/pull/7994 Thanks! -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquil