Hi, This[1] is my solution current plain find most popular tweet at a time period. If you have good suggestions based on functionality and the efficiency of logic, please feel free to post them so that it will help me. Use-case: Find the most popular k unique tweets by keeping most rated n tweets (k<n) based on their rank which is depend on current time-stamp [1]
On Thu, Nov 19, 2015 at 9:38 AM, Srinath Perera <srin...@wso2.com> wrote: > We must use d3 or a d3 based one, as that WSO2 platform uses. > > Sample I shared shows how to do it with d3. > > Thanks > Srinath > > On Wed, Nov 18, 2015 at 3:36 PM, Dinali Dabarera <din...@wso2.com> wrote: > >> Hi, >> I have created two tables on DAS which collects fresh data daily(more >> than 1000,000) and run a script which is scheduled hourly to collect data >> into two tables called NodeTable(nose , retweets order by retweets desc) >> and EdgeTable(src,dest,retweets order by retweets desc). >> >> Now I have to create a node graph. Node size give u from NodeTable and >> Width of edge gives u from retweet count in EdgeTable of I have looked up >> lot of java script libraries such as vis.js, arbor.js, D3.js,sigmajs. >> >> I couldn't figured out what is better (as most of them have specific to a >> single node and takes lot of time to study all) then i moved to d3.js as >> many have used and tried for different purposes. Can i get any other good >> suggestions for my graphing? >> >> If you have good suggestions, please feel free to post them so that it >> will help me .. >> >> >> Cheers! >> >> On Tue, Nov 17, 2015 at 3:17 PM, Yasara Dissanayake <yas...@wso2.com> >> wrote: >> >>> @yudhanjaya >>> Ok.Now it's working.Popular tweets are now saved to on database base on >>> that rank from CEP. Wrote custom window for siddi to calculate that rank >>> and sort them. Currently working with design web page using jaggery server. >>> >>> Regards >>> Yasara >>> >>> On Tue, Nov 17, 2015 at 3:11 PM, Yudhanjaya Wijeratne < >>> yudhanj...@wso2.com> wrote: >>> >>>> We'll have to talk to Srinath about that, I'm afraid. Let's get the RT >>>> system rolling first. Whatever we come up with the replies will also have >>>> to be displayed as part of that graph, so let's get the simpler stuff out >>>> of the way. >>>> >>>> On Tue, Nov 17, 2015 at 2:54 PM, Yasara Dissanayake <yas...@wso2.com> >>>> wrote: >>>> >>>>> hi, >>>>> >>>>> @Nipuna, >>>>> Dinali and me both are collecting retweets in same manner which she >>>>> explained earlier. Since I also consider the details original tweets of >>>>> retweets. Thank you for comments and link it would be very useful. And >>>>> about favorite count, isn't it a separate option something like like to >>>>> the >>>>> post which can do even non friends? Here I mean the publicity of tweet. >>>>> that is initially when tweet are published it will be on friends wall. But >>>>> it has not impact as much as retweet and favorite count. >>>>> >>>>> @yudhanjaya >>>>> And what about the replies? if we consider them there can be +1, 0 and >>>>> -1 support for that tweet. do we have to consider them ? if so do we have >>>>> to do some analysis? >>>>> >>>>> regards, >>>>> Yasara >>>>> >>>>> On Tue, Nov 17, 2015 at 2:38 PM, Yudhanjaya Wijeratne < >>>>> yudhanj...@wso2.com> wrote: >>>>> >>>>>> Hi Madhawa, Nipuna, >>>>>> >>>>>> We'll be doing a bit of sentiment analysis later down the line using >>>>>> the stanford NLP implementation, but for now what we're trying to >>>>>> replicate >>>>>> in real-time is to >>>>>> a) rank tweets by freshness and popularity, which can give us some >>>>>> clue as to opinion influence and b) to basically do this >>>>>> https://iwringer.wordpress.com/2015/08/25/analysis-of-retweeting-patterns-in-sri-lankan-general-election/ >>>>>> >>>>>> Best, >>>>>> Yudha >>>>>> >>>>>> On Tue, Nov 17, 2015 at 2:27 PM, Nipuna Chandradasa <nipu...@wso2.com >>>>>> > wrote: >>>>>> >>>>>>> HI Madhawa >>>>>>> >>>>>>> Context analysis in the sense we have to perform Natural language >>>>>>> processing right? I think this require additional libraries ... and >>>>>>> this is >>>>>>> not yet accurate most of the time if we don't get a right model... as we >>>>>>> dealing with natural languages .. >>>>>>> >>>>>>> Regards, >>>>>>> >>>>>>> On Tue, Nov 17, 2015 at 2:23 PM, Madhawa Gunasekara < >>>>>>> madha...@wso2.com> wrote: >>>>>>> >>>>>>>> Hi All, >>>>>>>> >>>>>>>> IMO It's better to do a context analysis on these tweet texts and >>>>>>>> draw separate two graphs, (positive / negative) >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Madhawa >>>>>>>> >>>>>>>> On Tue, Nov 17, 2015 at 2:13 PM, Nipuna Chandradasa < >>>>>>>> nipu...@wso2.com> wrote: >>>>>>>> >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> I suggested above for if you are using tweeter API directly .... i >>>>>>>>> don't know whether these can be done using wso2 twitter connector. >>>>>>>>> ... >>>>>>>>> i'll look in to it .. >>>>>>>>> Sorry for the misdirection if above replies are not helpful. >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> >>>>>>>>> On Tue, Nov 17, 2015 at 2:10 PM, Nipuna Chandradasa < >>>>>>>>> nipu...@wso2.com> wrote: >>>>>>>>> >>>>>>>>>> Hi Yasara, >>>>>>>>>> >>>>>>>>>> yeah you can check the retweets using retweeted_status as >>>>>>>>>> retweets contains slightly different json structure than tweets. But >>>>>>>>>> you >>>>>>>>>> have to keep track of whether your system already analyzed the >>>>>>>>>> original >>>>>>>>>> tweets of this retweets ... Because there can be a scenario where >>>>>>>>>> your >>>>>>>>>> system meet the retweet before the original tweet you are going to >>>>>>>>>> filter >>>>>>>>>> out that tweet and that data is loss.. >>>>>>>>>> >>>>>>>>>> [1] link has some answer to this.... that a way you can edit the >>>>>>>>>> search query to filter out retweets .... >>>>>>>>>> >>>>>>>>>> 1. >>>>>>>>>> http://stackoverflow.com/questions/21748880/exclude-retweets-in-twitter-search-api-1-1 >>>>>>>>>> >>>>>>>>>> But the i don't know whether this solve the above scenario i >>>>>>>>>> mentioned .... But the above mentioned scenario is less likely to >>>>>>>>>> happen >>>>>>>>>> if it is a live stream and there are no waiting periods included.... >>>>>>>>>> >>>>>>>>>> (You both replied while i'm typing the reply so ... following is >>>>>>>>>> the new suggestions .. but please go through above factors. those >>>>>>>>>> will help >>>>>>>>>> you understand how tweeter API's work ) >>>>>>>>>> >>>>>>>>>> @ Dinali ... >>>>>>>>>> >>>>>>>>>> +1 for your idea .. >>>>>>>>>> >>>>>>>>>> @ Yasara .. >>>>>>>>>> >>>>>>>>>> I think the favorites_count is calculated based on followers and >>>>>>>>>> retweets count ... >>>>>>>>>> >>>>>>>>>> https://dev.twitter.com/faq/finding-%26-counting-things >>>>>>>>>> >>>>>>>>>> Check before you do the same thing in your code. >>>>>>>>>> >>>>>>>>>> Regards, >>>>>>>>>> >>>>>>>>>> On Tue, Nov 17, 2015 at 1:04 PM, Yasara Dissanayake < >>>>>>>>>> yas...@wso2.com> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Nipuna, >>>>>>>>>>> For our part we have to analyze tweets real time. For that >>>>>>>>>>> currently we are planed to filter retweets by considering presence >>>>>>>>>>> of >>>>>>>>>>> retweeted_status attribute of a json massage which send by tweet >>>>>>>>>>> object, >>>>>>>>>>> within the CEP. Does it seems to be a proper method? Do you have >>>>>>>>>>> any better >>>>>>>>>>> idea ? >>>>>>>>>>> >>>>>>>>>>> regards, >>>>>>>>>>> Yasara >>>>>>>>>>> >>>>>>>>>>> On Tue, Nov 17, 2015 at 11:12 AM, Nipuna Chandradasa < >>>>>>>>>>> nipu...@wso2.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi, >>>>>>>>>>>> >>>>>>>>>>>> Is this connector the api provided by twitter?... Then there >>>>>>>>>>>> are few things u have to keep in mind... >>>>>>>>>>>> >>>>>>>>>>>> 1. Twitter api gives each app 15 min waiting period once app >>>>>>>>>>>> collect the data from api.... So basically you have to wait 15 min >>>>>>>>>>>> to get >>>>>>>>>>>> data again.... >>>>>>>>>>>> >>>>>>>>>>>> 2. There are no filter system to filter retweets.... What you >>>>>>>>>>>> can do is get data using search query with date periods.... And >>>>>>>>>>>> filter >>>>>>>>>>>> retweets in your app.... >>>>>>>>>>>> >>>>>>>>>>>> Hope you find this helpful.... >>>>>>>>>>>> >>>>>>>>>>>> Regards, >>>>>>>>>>>> On 17 Nov 2015 10:11 a.m., "Dinali Dabarera" <din...@wso2.com> >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi, >>>>>>>>>>>>> >>>>>>>>>>>>> I collected tweets which has hash tag of Trump >>>>>>>>>>>>> #trump,#donaldtrump,#trump2016,#makeamericagreatagain >>>>>>>>>>>>> from ESB through a twitter connector to SPARK SQL tables in >>>>>>>>>>>>> DAS. >>>>>>>>>>>>> >>>>>>>>>>>>> The tweets are seems to be most probably retweets. Is there >>>>>>>>>>>>> any issue with the twitter connector,is it collecting only >>>>>>>>>>>>> retweets? >>>>>>>>>>>>> >>>>>>>>>>>>> Cheers!! >>>>>>>>>>>>> >>>>>>>>>>>>> On Tue, Nov 17, 2015 at 8:49 AM, Yasara Dissanayake < >>>>>>>>>>>>> yas...@wso2.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> Dinali Rosemin >>>>>>>>>>>>> University of Peradeniya (Computer Engineering) >>>>>>>>>>>>> WSO2 Intern >>>>>>>>>>>>> 077-0198933 >>>>>>>>>>>>> >>>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>>> Dev mailing list >>>>>>>>>>>>> Dev@wso2.org >>>>>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Nipuna Marcus >>>>>>>>>> *Software Engineer* >>>>>>>>>> WSO2 Inc. >>>>>>>>>> http://wso2.com/ - "lean . enterprise . middleware" >>>>>>>>>> Mobile : +94 (0) 713 667906 >>>>>>>>>> nipu...@wso2.com >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Nipuna Marcus >>>>>>>>> *Software Engineer* >>>>>>>>> WSO2 Inc. >>>>>>>>> http://wso2.com/ - "lean . enterprise . middleware" >>>>>>>>> Mobile : +94 (0) 713 667906 >>>>>>>>> nipu...@wso2.com >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Dev mailing list >>>>>>>>> Dev@wso2.org >>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> *Madhawa Gunasekara* >>>>>>>> Software Engineer >>>>>>>> WSO2 Inc.; http://wso2.com >>>>>>>> lean.enterprise.middleware >>>>>>>> >>>>>>>> mobile: +94 719411002 <+94+719411002> >>>>>>>> blog: *http://madhawa-gunasekara.blogspot.com >>>>>>>> <http://madhawa-gunasekara.blogspot.com>* >>>>>>>> linkedin: *http://lk.linkedin.com/in/mgunasekara >>>>>>>> <http://lk.linkedin.com/in/mgunasekara>* >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Nipuna Marcus >>>>>>> *Software Engineer* >>>>>>> WSO2 Inc. >>>>>>> http://wso2.com/ - "lean . enterprise . middleware" >>>>>>> Mobile : +94 (0) 713 667906 >>>>>>> nipu...@wso2.com >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Yudhanjaya Wijeratne >>>>>> Marketing Officer, WSO2 Inc <http://www.wso2.com> >>>>>> +94775496911 | @yudhanjaya >>>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Yudhanjaya Wijeratne >>>> Marketing Officer, WSO2 Inc <http://www.wso2.com> >>>> +94775496911 | @yudhanjaya >>>> >>> >>> >>> _______________________________________________ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> Dinali Rosemin >> University of Peradeniya (Computer Engineering) >> WSO2 Intern >> 077-0198933 >> >> _______________________________________________ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > ============================ > Blog: http://srinathsview.blogspot.com twitter:@srinath_perera > Site: http://people.apache.org/~hemapani/ > Photos: http://www.flickr.com/photos/hemapani/ > Phone: 0772360902 >
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
