Is assigning negative surrogate value (-1) for the dictionary value which is not present in ALL_DICTIONARY_PATH is correct? if not correct then weather the data-load should failed or load action should be decided based on the configuration bad_records_action.
In case of if ALL_DICTIONARY_PATH is passed in load option, the dictionary generation is done using all.dictionary file. When all the dictionary values are not present in the all.dictionary file, then we are assigning negative surrogate value (-1). for example data to be loaded is ----------------------------------------------------- ID,phonetype 1,phone197 2,phone756 3,phone757 ------------------------------------------------------ all.dictionary file content 1,phone756 1,phonetype 1,phone757 --------------------------------------------------------- phone197 is present in the all.dictionary file so while load for phone197 dictionary key -1 is getting assigned. -- View this message in context: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Is-assigning-negative-surrogate-value-1-for-the-dictionary-value-which-is-not-present-in-ALL-DICTION-tp12746.html Sent from the Apache CarbonData Dev Mailing List archive mailing list archive at Nabble.com.
