Re: Phoenix upgrade from 4.7.0(base 1.1.2) to 5.1.2(base 2.3.0) is failing with ColumnNotFoundException

[Arshad, Mohammad]

Thanks a lot Istvan Toth for sharing this usefull information.
I took this PHOENIX-6534 changes applied on  release-5.1.2, built and used 
phoenix-core-5.1.2.jar. It worked. Phoenix clients connected succesfully.

Thanks once again.

On 25/07/22, 12:54 PM, "Istvan Toth" <st...@cloudera.com.INVALID> wrote:

    Yes, this is PHOENIX-6534.
    There is no released Apache version with the fix, you need to manually
    apply the fix to 5.1.2, or use the 5.1 branch head.

    regards
    István

    On Fri, Jul 22, 2022 at 10:35 PM Arshad, Mohammad <mohammad.ars...@visa.com>
    wrote:

    > Hello All,
    >
    >
    >
    > Upgraded HBase from 1.1.2 to 2.3.0. After applying HBASE-25902, hbase
    > upgrade was successful.
    >
    >
    >
    > But phoenix upgrade from version 4.7.0(hbase version 1.1.2) to 5.1.2(hbase
    > version 2.3,0) is failing with following error.
    >
    >
    >
    > 22/07/18 10:53:26 WARN query.ConnectionQueryServicesImpl: Failed upgrading
    > System tables. Snapshots for system tables created so far:
    > {SYSTEM.CATALOG=SNAPSHOT_SYSTEM.CATALOG_4.7.x_TO_5.1.0_20220718105325}
    >
    > Error: ERROR 504 (42703): Undefined column.
    > columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER (state=42703,code=504)
    >
    > org.apache.phoenix.schema.ColumnNotFoundException: ERROR 504 (42703):
    > Undefined column. columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER
    >
    > at
    > 
org.apache.phoenix.schema.PTableImpl.getColumnForColumnName(PTableImpl.java:1175)
    >
    > at
    > 
org.apache.phoenix.compile.FromCompiler$SingleTableColumnResolver.resolveColumn(FromCompiler.java:528)
    >
    >
    >
    > When phoenix clients connect above error is logged.
    >
    >
    >
    > is anyone faced this issue earlier, is there known solution for this 
issue?
    >
    >
    >
    > Thanks & Regards
    >
    > Arshad
    >


    -- 
    *István Tóth* | Staff Software Engineer
    st...@cloudera.com 
<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cloudera.com%2F&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Kg1oRmXrJpv%2FlXKjLCtmRjXnpwemdcoiIOwDM0kYgD8%3D&amp;reserved=0>
    [image: Cloudera] 
<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cloudera.com%2F&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Kg1oRmXrJpv%2FlXKjLCtmRjXnpwemdcoiIOwDM0kYgD8%3D&amp;reserved=0>
    [image: Cloudera on Twitter] 
<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2Fcloudera&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=ZlBmGqavSSpBO84a6CT8ApOcbjlgkWirbFkfkJtlGj4%3D&amp;reserved=0>
 [image:
    Cloudera on Facebook] 
<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.facebook.com%2Fcloudera&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Yg602GfFf5FAdBzDjAylfovowrnLgutsCJ%2FJpekYVa8%3D&amp;reserved=0>
 [image: Cloudera
    on LinkedIn] 
<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fcloudera&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=qrl4ja%2BTsKm5Ns3RfQBrkbpSSF88aniND9Y5HZyJq5U%3D&amp;reserved=0>
    
<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cloudera.com%2F&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Kg1oRmXrJpv%2FlXKjLCtmRjXnpwemdcoiIOwDM0kYgD8%3D&amp;reserved=0>
    ------------------------------