Xiaoxiang Yu created KYLIN-4384:
-----------------------------------

             Summary: Spark build failed in EMR when KYLIN-4224 introduced
                 Key: KYLIN-4384
                 URL: https://issues.apache.org/jira/browse/KYLIN-4384
             Project: Kylin
          Issue Type: Bug
          Components: Spark Engine
         Environment: AWS EMR 5.28 with Glue support
            Reporter: Xiaoxiang Yu


I built a package using the latest code of master branch to test the Kylin Glue 
integration. 

 

I create a EMR cluster(5.28) with glue enabled. In my test, MR build engine 
works fine.  But spark build engine failed at the first step, and I found the 
code change is introduced in https://issues.apache.org/jira/browse/KYLIN-4224.

 

The new added step change the way that how {color:#de350b}*intermediate 
table*{color} was created. And it is  mandatory, so nobody can disable or skip 
it without rebuild the binary. It is not good in my side. Currently, I can not 
find the root cause. But I suggest we should add a config to make it easy to 
disable that feature.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to