[ https://issues.apache.org/jira/browse/DRILL-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Parth Chandra updated DRILL-1816: --------------------------------- Fix Version/s: (was: 0.8.0) 0.9.0 > Scan Error with JSON on large no of records with Complex Types > -------------------------------------------------------------- > > Key: DRILL-1816 > URL: https://issues.apache.org/jira/browse/DRILL-1816 > Project: Apache Drill > Issue Type: Bug > Components: Execution - Data Types, Storage - JSON > Reporter: Rahul Challapalli > Assignee: Parth Chandra > Fix For: 0.9.0 > > Attachments: complex.log > > > git.commit.id.abbrev=4a4f54a > Memory Settings > {code} > DRILL_MAX_DIRECT_MEMORY="32G" > DRILL_MAX_HEAP="4G" > {code} > Dataset : > {code} > { > "data" : { > "col1" : { > "one" : [1,2,3,4], > "two" : [{"a":"b"},{"c":"d"}] > } > } > } > {code} > The below query works fine for the above record. However if we copy the same > record 100,000 times, it fails with IOOB exception > {code} > select data from `json_kvgenflatten/kvgen-complex-large.json`; > {code} > Attached the logs. Let me know if you need anything more. -- This message was sent by Atlassian JIRA (v6.3.4#6332)