There's also a change in the second param of the incrementalParams as DAY, HOUR instead of number of seconds as mentioned in the documentation.
@Documentation - could this page be corrected? On Wed, Jan 25, 2017 at 4:52 PM, Shazni Nazeer <sha...@wso2.com> wrote: > Thanks Fazlan. > > That'll be useful. Only difference I see is primary key comes prior to > incrementalParams. I'll try this out. > > On Wed, Jan 25, 2017 at 4:44 PM, Fazlan Nazeem <fazl...@wso2.com> wrote: > >> Hi Shazni, >> >> Please check [1] for how we use incrementalParams in APIM-Analytics >> scripts. >> >> [1] https://git.io/vMxJq >> >> On Wed, Jan 25, 2017 at 1:29 PM, Shazni Nazeer <sha...@wso2.com> wrote: >> >>> Hi, >>> >>> I have a spark table as shown below. >>> >>> CREATE TEMPORARY TABLE APIHourlyTrafficSummary using CarbonAnalytics >>> options (tableName "org_wso2telco_analytics_hub_s >>> tream_traffic_summary_per_hour", >>> schema " >>> year INT -i, >>> month INT -i, >>> day INT -i, >>> hour INT -i, >>> eventTimeStamp STRING -i, >>> api STRING -i, >>> serviceProvider STRING -i, >>> apiPublisher STRING -i, >>> applicationName STRING -i, >>> operatorId STRING -i, >>> isSuccess BOOLEAN -i, >>> msisdn STRING -i, >>> direction STRING -i, >>> totalCount INTEGER -i, >>> serviceProviderId STRING -i, >>> operatorName STRING -i, >>> apiPublisherID STRING -i, >>> apiID STRING -i, >>> department STRING -i, >>> applicationId STRING -i", >>> primaryKeys "year,month,day,hour,eventTimeStamp,api,serviceProvider,apiP >>> ublisher,applicationName,operatorId,isSuccess,msisdn,direction" >>> ); >>> >>> I want to add incrementalParams as mentioned in the following [1]. >>> >>> [1] https://docs.wso2.com/display/DAS310/Incremental+Processing >>> >>> Therefore I have added the line as below. >>> >>> CREATE TEMPORARY TABLE APIHourlyTrafficSummary using >>> CarbonAnalytics options (tableName "org_wso2telco_analytics_hub_s >>> tream_traffic_summary_per_hour", >>> schema " >>> year INT -i, >>> month INT -i, >>> day INT -i, >>> hour INT -i, >>> eventTimeStamp STRING -i, >>> api STRING -i, >>> serviceProvider STRING -i, >>> apiPublisher STRING -i, >>> applicationName STRING -i, >>> operatorId STRING -i, >>> isSuccess BOOLEAN -i, >>> msisdn STRING -i, >>> direction STRING -i, >>> totalCount INTEGER -i, >>> serviceProviderId STRING -i, >>> operatorName STRING -i, >>> apiPublisherID STRING -i, >>> apiID STRING -i, >>> department STRING -i, >>> applicationId STRING -i", >>> * incrementalParams "APIHourlyTrafficSummary, 0",* >>> primaryKeys "year,month,day,hour,eventTime >>> Stamp,api,serviceProvider,apiPublisher,applicationName,opera >>> torId,isSuccess,msisdn,direction" >>> ); >>> >>> But executing the script throws an error. looks like a syntax error. >>> What am I doing wrong here? >>> >>> -- >>> Shazni Nazeer >>> Associate Technical Lead | WSO2 >>> >>> Mob : +94 777737331 >>> LinkedIn : http://lk.linkedin.com/in/shazninazeer >>> Blog : http://shazninazeer.blogspot.com >>> >>> <http://wso2.com/signature> >>> >>> _______________________________________________ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> Thanks & Regards, >> >> Fazlan Nazeem >> >> *Software Engineer* >> >> *WSO2 Inc* >> Mobile : +94772338839 >> <%2B94%20%280%29%20773%20451194> >> fazl...@wso2.com >> > > > > -- > Shazni Nazeer > Associate Technical Lead | WSO2 > > Mob : +94 777737331 > LinkedIn : http://lk.linkedin.com/in/shazninazeer > Blog : http://shazninazeer.blogspot.com > > <http://wso2.com/signature> > -- Shazni Nazeer Associate Technical Lead | WSO2 Mob : +94 777737331 LinkedIn : http://lk.linkedin.com/in/shazninazeer Blog : http://shazninazeer.blogspot.com <http://wso2.com/signature>
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
