Hi, +1 for the feature. we can save a lot of load time for the SI table.
doubt: 1) how we are going to handle the query for failed segments? need to prune from maintainable directly? Thanks & Regards Mahesh Raju Somalaraju On Fri, Feb 19, 2021 at 3:16 PM Yahui Liu <[email protected]> wrote: > [Problem] > One table has 40K segments, now start to create SI on one column, it took 1 > week and finished 39999 segments, but during creating on the last segment, > application crashed abnormally. Then checking the status of SI table, there > is no success segment. Start again to create SI, it will start from the > beginning(segment id = 0), all those SI segments which already loaded > during > last creation need to reload again, which it is waste of time. > > [Expectation] > SI creation can succeed partitially, next time creation can start from the > point where last creation failed at. > > > > -- > Sent from: > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ >
