--------------------------------------------------------------------------------
1. Drill in cluster is *working fine *when *customized* drill-module.conf
file is *not present *in dir "apache-drill-1.6.0/conf/drill-module.conf"
--------------------------------------------------------------------------------
2. Custom UDF is not working as describe below :
i have copied my custom UDF into dir "apache-drill-1.6.0/jars/3rdparty" on
all nodes and restarted all drillbits.
udf filename=udfutil-0.0.1-SNAPSHOT.jar
jar *structure* -
/*
META-INF/
META-INF/MANIFEST.MF
com/
com/companyname/
com/companyname/drill/
drill-module.conf
com/companyname/drill/channeltest.class
com/companyname/drill/DateFunc.class
com/companyname/drill/DateExtract.class
com/companyname/drill/DecodeURI.class
com/companyname/drill/ChannelID.class
com/companyname/drill/BrowserFuncNew.class
com/companyname/drill/ToDate.class
META-INF/maven/
META-INF/maven/com.companyname.drill.udf/
META-INF/maven/com.companyname.drill.udf/udfutil/
META-INF/maven/com.companyname.drill.udf/udfutil/pom.xml
META-INF/maven/com.companyname.drill.udf/udfutil/pom.properties
*/
-- And login to drill to check whether function is working or not
/*
0: jdbc:drill:> select DateFunc(1458228298) from (values(1)) ;
*Error: VALIDATION ERROR: From line 1, column 8 to line 1, column 26: No
match found for function signature DateFunc(<NUMERIC>)*
*/
*IT FAILED....*
--------------------------------------------------------------------------------
3. Now as described on website, now i edited file "*drill-module.conf*".
And copied this file to all nodes in cluster and restarted all drillbits.
vi apache-drill-1.6.0/conf/drill-module.conf
/*
drill: {
classpath.scanning: {
packages: [
"com.companyname.drill.*"
]
}
}
*/
*But DRILL GET SHUTDOWN on all nodes.*
*Please help me to resolved this issue. Or suggest any other way to invoke
my custome UDFs. *
On Thu, Mar 17, 2016 at 6:50 PM, Abdel Hakim Deneche <adene...@maprtech.com>
wrote:
> Easiest fix when Drill fails to load a storage plugin is to delete the
> existing configurations. Deleting /tmp/drill/ should resolve this.
>
> I know this may not be practical in some cases, and other developers may
> give you a better solution.
>
> On Thu, Mar 17, 2016 at 2:13 PM, Shankar Mane <shankar.m...@games24x7.com>
> wrote:
>
> > *drillbit.out =>*
> >
> >
> > Exception in thread "main"
> > org.apache.drill.exec.exception.DrillbitStartupException: Failure during
> > initial startup of Drillbit.
> > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:284)
> > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:261)
> > at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:257)
> > Caused by: java.lang.IllegalStateException:
> > com.fasterxml.jackson.databind.JsonMappingException: Could not resolve
> type
> > id 'kudu' into a subtype of [simple type, class
> > org.apache.drill.common.logical.StoragePluginConfig]: known type ids =
> > [InfoSchemaConfig, StoragePluginConfig, SystemTablePluginConfig, file,
> > jdbc, mock, named]
> > at [Source: {
> > "storage":{
> > kudu : {
> > type:"kudu",
> > masterAddresses: "1.2.3.4",
> > enabled: false
> > }
> > }
> > }
> > ; line: 4, column: 12] (through reference chain:
> >
> >
> org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["kudu"])
> > at
> >
> >
> org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:182)
> > at
> >
> >
> org.apache.drill.exec.store.StoragePluginRegistryImpl.init(StoragePluginRegistryImpl.java:126)
> > at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:113)
> > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:281)
> > ... 2 more
> > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not
> > resolve type id 'kudu' into a subtype of [simple type, class
> > org.apache.drill.common.logical.StoragePluginConfig]: known type ids =
> > [InfoSchemaConfig, StoragePluginConfig, SystemTablePluginConfig, file,
> > jdbc, mock, named]
> > at [Source: {
> > "storage":{
> > kudu : {
> > type:"kudu",
> > masterAddresses: "1.2.3.4",
> > enabled: false
> > }
> > }
> > }
> > ; line: 4, column: 12] (through reference chain:
> >
> >
> org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["kudu"])
> > at
> >
> >
> com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:216)
> > at
> >
> >
> com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:983)
> > at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._handleUnknownTypeId(TypeDeserializerBase.java:281)
> > at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:163)
> > at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:106)
> > at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:91)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:142)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:497)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:341)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298)
> > at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133)
> > at
> >
> >
> com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3788)
> > at
> >
> >
> com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2779)
> > at
> >
> >
> org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:144)
> > ... 5 more
> >
> >
> >
> >
> >
> > On Thu, Mar 17, 2016 at 6:38 PM, Shankar Mane <
> shankar.m...@games24x7.com>
> > wrote:
> >
> > > *drillbit.out =>*
> > >
> > >
> > > Exception in thread "main"
> > > org.apache.drill.exec.exception.DrillbitStartupException: Failure
> during
> > > initial startup of Drillbit.
> > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:284)
> > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:261)
> > > at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:257)
> > > Caused by: java.lang.IllegalStateException:
> > > com.fasterxml.jackson.databind.JsonMappingException: Could not resolve
> > type
> > > id 'kudu' into a subtype of [simple type, class
> > > org.apache.drill.common.logical.StoragePluginConfig]: known type ids =
> > > [InfoSchemaConfig, StoragePluginConfig, SystemTablePluginConfig, file,
> > > jdbc, mock, named]
> > > at [Source: {
> > > "storage":{
> > > kudu : {
> > > type:"kudu",
> > > masterAddresses: "1.2.3.4",
> > > enabled: false
> > > }
> > > }
> > > }
> > > ; line: 4, column: 12] (through reference chain:
> > >
> >
> org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["kudu"])
> > > at
> > >
> >
> org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:182)
> > > at
> > >
> >
> org.apache.drill.exec.store.StoragePluginRegistryImpl.init(StoragePluginRegistryImpl.java:126)
> > > at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:113)
> > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:281)
> > > ... 2 more
> > > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could
> not
> > > resolve type id 'kudu' into a subtype of [simple type, class
> > > org.apache.drill.common.logical.StoragePluginConfig]: known type ids =
> > > [InfoSchemaConfig, StoragePluginConfig, SystemTablePluginConfig, file,
> > > jdbc, mock, named]
> > > at [Source: {
> > > "storage":{
> > > kudu : {
> > > type:"kudu",
> > > masterAddresses: "1.2.3.4",
> > > enabled: false
> > > }
> > > }
> > > }
> > > ; line: 4, column: 12] (through reference chain:
> > >
> >
> org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["kudu"])
> > > at
> > >
> >
> com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:216)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:983)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._handleUnknownTypeId(TypeDeserializerBase.java:281)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:163)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:106)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:91)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:142)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:497)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:341)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3788)
> > > at
> > >
> >
> com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2779)
> > > at
> > >
> >
> org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:144)
> > > ... 5 more
> > >
> > >
> > > On Thu, Mar 17, 2016 at 6:21 PM, Shankar Mane <
> > shankar.m...@games24x7.com>
> > > wrote:
> > >
> > >> I am not able to start drill 1.6.0. Please find the attached file for
> > >> more details.
> > >>
> > >>
> > >
> >
>
>
>
> --
>
> Abdelhakim Deneche
>
> Software Engineer
>
> <http://www.mapr.com/>
>
>
> Now Available - Free Hadoop On-Demand Training
> <
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >
>
