[ 
https://issues.apache.org/jira/browse/PHOENIX-6938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816025#comment-17816025
 ] 

Istvan Toth commented on PHOENIX-6938:
--------------------------------------

One basic problem is that PQS is supposed to work with several phoenix 
releases, but getting the tests working with more than one release is an 
onorous process, which would require several complex profiles.
The connectors should be buildable with either 5.1 or 5.2, but we may not want 
to put in the work to make sure that the tests work with 5.1 and 5.2.

The next problem is Hive. 
HBase support in Hive 3 is very broken, and getting the connector working 
requires Hacking the hive distro. (Documented on the website)
This is all fixed in Hive 4, but that requires several minor changes to the 
code. We have these downstream, but I haven't gotten around to
upstreaming them (also, there is no Hive 4 release yet.)
This is not a release blocker, just an unfortunate fact.

Another issue is the shaded artifacts.
If we target 5.1, then the shaded artifacts are absolutely required.
For 5.2, the new mapreduce shaded artifact can be used instead, it uses the 
same shading as the shaded connectors.
For $dayjob, the preference is to keep the shaded artifacts, so that we can use 
the codebase for building connectors for 5.1.
I think most users would also prefer if we didn't drop 5.2 compatibility.

I have built and tested the connector both with Spark 3.2 and 3.4, so I don't 
expect serious problems with that.

As for the docs, having them in the source means that they always apply to the 
same version.
I agree that maintaining two copies work that we don't really have the 
throughput for.

Maybe we could just link to the github README.md pages ?


> Prepare for for the first Phoenix Connectors release
> ----------------------------------------------------
>
>                 Key: PHOENIX-6938
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-6938
>             Project: Phoenix
>          Issue Type: Task
>          Components: connectors
>    Affects Versions: connectors-6.0.0
>            Reporter: Istvan Toth
>            Assignee: Istvan Toth
>            Priority: Major
>
> Umbrella ticket for tracking tasks that need to be done before releasing 
> connectors-6.0.0



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to