Thanks Fazlan. That'll be useful. Only difference I see is primary key comes prior to incrementalParams. I'll try this out.
On Wed, Jan 25, 2017 at 4:44 PM, Fazlan Nazeem <fazl...@wso2.com> wrote: > Hi Shazni, > > Please check [1] for how we use incrementalParams in APIM-Analytics > scripts. > > [1] https://git.io/vMxJq > > On Wed, Jan 25, 2017 at 1:29 PM, Shazni Nazeer <sha...@wso2.com> wrote: > >> Hi, >> >> I have a spark table as shown below. >> >> CREATE TEMPORARY TABLE APIHourlyTrafficSummary using CarbonAnalytics >> options (tableName "org_wso2telco_analytics_hub_s >> tream_traffic_summary_per_hour", >> schema " >> year INT -i, >> month INT -i, >> day INT -i, >> hour INT -i, >> eventTimeStamp STRING -i, >> api STRING -i, >> serviceProvider STRING -i, >> apiPublisher STRING -i, >> applicationName STRING -i, >> operatorId STRING -i, >> isSuccess BOOLEAN -i, >> msisdn STRING -i, >> direction STRING -i, >> totalCount INTEGER -i, >> serviceProviderId STRING -i, >> operatorName STRING -i, >> apiPublisherID STRING -i, >> apiID STRING -i, >> department STRING -i, >> applicationId STRING -i", >> primaryKeys "year,month,day,hour,eventTimeStamp,api,serviceProvider, >> apiPublisher,applicationName,operatorId,isSuccess,msisdn,direction" >> ); >> >> I want to add incrementalParams as mentioned in the following [1]. >> >> [1] https://docs.wso2.com/display/DAS310/Incremental+Processing >> >> Therefore I have added the line as below. >> >> CREATE TEMPORARY TABLE APIHourlyTrafficSummary using >> CarbonAnalytics options (tableName "org_wso2telco_analytics_hub_s >> tream_traffic_summary_per_hour", >> schema " >> year INT -i, >> month INT -i, >> day INT -i, >> hour INT -i, >> eventTimeStamp STRING -i, >> api STRING -i, >> serviceProvider STRING -i, >> apiPublisher STRING -i, >> applicationName STRING -i, >> operatorId STRING -i, >> isSuccess BOOLEAN -i, >> msisdn STRING -i, >> direction STRING -i, >> totalCount INTEGER -i, >> serviceProviderId STRING -i, >> operatorName STRING -i, >> apiPublisherID STRING -i, >> apiID STRING -i, >> department STRING -i, >> applicationId STRING -i", >> * incrementalParams "APIHourlyTrafficSummary, 0",* >> primaryKeys "year,month,day,hour,eventTime >> Stamp,api,serviceProvider,apiPublisher,applicationName, >> operatorId,isSuccess,msisdn,direction" >> ); >> >> But executing the script throws an error. looks like a syntax error. What >> am I doing wrong here? >> >> -- >> Shazni Nazeer >> Associate Technical Lead | WSO2 >> >> Mob : +94 777737331 >> LinkedIn : http://lk.linkedin.com/in/shazninazeer >> Blog : http://shazninazeer.blogspot.com >> >> <http://wso2.com/signature> >> >> _______________________________________________ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Thanks & Regards, > > Fazlan Nazeem > > *Software Engineer* > > *WSO2 Inc* > Mobile : +94772338839 > <%2B94%20%280%29%20773%20451194> > fazl...@wso2.com > -- Shazni Nazeer Associate Technical Lead | WSO2 Mob : +94 777737331 LinkedIn : http://lk.linkedin.com/in/shazninazeer Blog : http://shazninazeer.blogspot.com <http://wso2.com/signature>
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
