Re: [HACKERS] To all the pgsql developers..Have a look at the operators proposed by me in my researc
From: [EMAIL PROTECTED] To: pgsql-hackers@postgresql.org Tasneem, The margins to the op2, i.e. m1 and m2, are added dynamically on both the sides, considering the value it contains. To keep this margin big is important for a certain reason discussed later. The NEAR operator is supposed to obtain the values near to the op2, thus the target membership degree(md) is initially set to 0.8. The algorithm compares the op1(column) values row by row to the elements of the set that NEAR defined, i.e. the values from md 1.0 to 0.8, adding matching tuples to the result set. Are we talking about a mathematical calculation on the values, or an algorithm against the population of the result set? I'm presuming the latter or you could just use a function. If so, is NEAR an absolute range or based on something logarithmic like standard deviation? It is based on fuzzy logic.. we take the operand2 (which is a crisp value, given by the end user) as a fuzzy set.. assign membership degree to its elements.. and then get the values between 1.0 to 0.8 as the values NEAR to the operand2, and output those as the result. I have made the initial membership degree constant, i.e 0.8. But that doesn’t mean that the size of the set defined by NEAR (md=0.8) remains constant. The larger the operand2 set, the larger the range of the set defined by NEAR. Beyond that, I would think that this mechanism would need some kind of extra heuristics to be at all performant, otherwise you're querying the entire table (or at least the entire index) every time you run a query. Have you given any thought to this? Yes u are right.. that’s my main concern. Here I have just put forward an idea to incorporate fuzziness in current database systems through the ANSI SQL; but still I have to look into that problem if it is to be functional at all with large amount of data. Tasneem Memon _ Connect to the next generation of MSN Messenger http://imagine-msn.com/messenger/launch80/default.aspx?locale=en-ussource=wlmailtagline
Re: [HACKERS] To all the pgsql developers..Have a look at the operators proposed by me in my researc
From: [EMAIL PROTECTED] To: [EMAIL PROTECTED] CC: pgsql-hackers@postgresql.org Subject: Re: [HACKERS] To all the pgsql developers..Have a look at the operators proposed by me in my researc On Sat, Jun 02, 2007 at 01:37:19PM +, Tasneem Memon wrote: We can make the system ask the user as to what membership degree s/he wants to get the values, but we don?t want to make the system interactive, where a user gives a membership degree value of his/her choice. These operators are supposed to work just like the other operators in SQL.. you just put them in the query and get a result. I have put 0.8 because all the case studies I have made for the NEAR, 0.8 seems to be the best choice.. 0.9 narrows the range.. 0.75 or 0.7 gets those values also that are irrelevant.. However, these values will no more seem to be irrelevant when we haven?t got any values till the md 0.8, so the operator fetches them when they are the NEARest. While having them function just like any other operator is good, it seems like you're making quite a bit of an assumption for the user; namely that you know what their data looks like better than they might. Is it not possible that someone would come along with a dataset that looks different enough from your test cases so that the values you picked wouldn't work? -- Jim Nasby [EMAIL PROTECTED] I believe that for the most cases it will get you the relevant results; because the size of the set depends on how big the value in operand2 is, and so does the set defined by NEAR. I have taken the values as small as 6 and as large as 2147,483,647 and it gives good results. For example: For 6, the range defined by NEAR is: 4 – 8 For 2147,483,647, the range defined by NEAR is: 1717,986,917 – 2576,980,377 But yes, for other cases it may not give good results. We can give the option for the user to specify the membership degree, or one can always use the BETWEEN operator when he knows the thresholds exactly. - Tasneem Memon _ Explore the seven wonders of the world http://search.msn.com/results.aspx?q=7+wonders+worldmkt=en-USform=QBRE
Re: [HACKERS] To all the pgsql developers..Have a look at the operators proposed by me in my researc
CC: pgsql-hackers@postgresql.org From: [EMAIL PROTECTED] Subject: Re: [HACKERS] To all the pgsql developers..Have a look at the operators proposed by me in my research paper. Date: Fri, 1 Jun 2007 19:13:54 -0500 To: [EMAIL PROTECTED] On Jun 1, 2007, at 8:24 AM, Tasneem Memon wrote: NEAR It deals with the NUMBER and DATE datatypes simulating the human behavior and processing the Why just number and date? I have just started working on it for my MS research work.. for the moment I have written algorithms for these two datatypes only, but I intend to implement these operators for the other datatypes also. As for other datatypes, especially those involving strings, its very complicated. information contained in NEAR in the same way as we humans take it. This is a binary operator with the syntax: op1 NEAR op2 Here, the op1 refers to an attribute, whereas op2 is a fixed value, both of the same datatype. Suppose we want a list of all the VGAs, price of which should be somewhere around 30$ .. the query will look like: SELECT * FROM accessories WHERE prod_name = ‘VGA’ AND prod_price NEAR 30 A query for the datatype DATE will look like: SELECT * FROM sales WHERE item = ’printer’ AND s_date NEAR 10-7-06 The algorithm for the NEAR operator works as follows: The margins to the op2, i.e. m1 and m2, are added dynamically on both the sides, considering the value it contains. To keep this margin big is important for a certain reason discussed later. The NEAR operator is supposed to obtain the values near to the op2, thus the target membership degree(md) is initially set to 0.8. The algorithm compares the op1(column) values row by row to the elements of the set that NEAR defined, i.e. the values from md 1.0 to 0.8, adding matching tuples to the result set. How would one change 0.8 to some other value? We can make the system ask the user as to what membership degree s/he wants to get the values, but we don’t want to make the system interactive, where a user gives a membership degree value of his/her choice. These operators are supposed to work just like the other operators in SQL.. you just put them in the query and get a result. I have put 0.8 because all the case studies I have made for the NEAR, 0.8 seems to be the best choice.. 0.9 narrows the range.. 0.75 or 0.7 gets those values also that are irrelevant.. However, these values will no more seem to be irrelevant when we haven’t got any values till the md 0.8, so the operator fetches them when they are the NEARest. I would like to mention another thing here that this looks like defining the range like BETWEEN operator does, but its different in a way that with BETWEEN we define an exact, strict range. Anything outside that range wont be included no matter that value might be of interest of the user querying the system, and if there are no values between that range, the result set is empty. 4. It is very much possible that the result set is empty since no values within the range exist in the column. Thus, the algorithm checks for empty result set, and in that case, decreases the target md by 0.2 and jumps to step 3. This is the reason big margins to the op2 are added. 5. In case there are no values in op1 that are between m1 and m2 (where the membership degree of the values with respect to NEAR becomes 0.1) and the result set is empty, the algorithm fetches the two nearest values (tuples) to op2, one smaller and one larger than the op2, as the result. The algorithm will give an empty result only if the table referred to in the query is empty. 2. NOT NEAR This operator is also a binary operator, dealing with the datatype NUMBER and DATE. It has the syntax: op1 NOT NEAR op2 The op1 refers to an attribute, whereas op2 is a fixed value, both of the same data type. A query containing the operator looks like: SELECT id, name, age, history FROM casualties WHERE cause = ‘heart attack’ AND age NOT NEAR 55 Or suppose we need a list of some event that is not clashing with some commitment of ours: SELECT * FROM events WHERE e_name= ‘concert’ AND date NOT NEAR 8/28/2007 The algorithm for NOT NEAR works like this: First of all it adds the margins to the op2, i.e. m1 and m2, dynamically on both the sides, considering the value op2 contains. op1 values outside the scope of the op2 (m1, m2) are retrieved and added to the result. If the result set is empty, the farthest values within the op2 fuzzy set (those possessing the least membership degree) are retrieved. This is done by continuing the search from values with md=0.1 till the md=0.6, where the md for NOT NEAR reaches 0.4. Why isn't this just the exact opposite set of NEAR? Because we are talking
[HACKERS] To all the pgsql developers..Have a look at the operators proposed by me in my research paper.
Dear All, I am explaining here how i have defined the operators NEAR and NOT NEAR in my research paper. I want critics/comments from all of you on the operators. These operators belong to the category of “Fuzzy Operators” proposed in the paper for ANSI SQL. NEAR It deals with the NUMBER and DATE datatypes simulating the human behavior and processing the information contained in NEAR in the same way as we humans take it. This is a binary operator with the syntax: op1 NEAR op2 Here, the op1 refers to an attribute, whereas op2 is a fixed value, both of the same datatype. Suppose we want a list of all the VGAs, price of which should be somewhere around 30$ .. the query will look like: SELECT* FROM accessories WHEREprod_name = ‘VGA’ ANDprod_price NEAR 30 A query for the datatype DATE will look like: SELECT* FROM sales WHEREitem = ’printer’ ANDs_date NEAR 10-7-06 The algorithm for the NEAR operator works as follows: The margins to the op2, i.e. m1 and m2, are added dynamically on both the sides, considering the value it contains. To keep this margin big is important for a certain reason discussed later. The NEAR operator is supposed to obtain the values near to the op2, thus the target membership degree(md) is initially set to 0.8. The algorithm compares the op1(column) values row by row to the elements of the set that NEAR defined, i.e. the values from md 1.0 to 0.8, adding matching tuples to the result set. 4. It is very much possible that the result set is empty since no values within the range exist in the column. Thus, the algorithm checks for empty result set, and in that case, decreases the target md by 0.2 and jumps to step 3. This is the reason big margins to the op2 are added. 5. In case there are no values in op1 that are between m1 and m2 (where the membership degree of the values with respect to NEAR becomes 0.1) and the result set is empty, the algorithm fetches the two nearest values (tuples) to op2, one smaller and one larger than the op2, as the result. The algorithm will give an empty result only if the table referred to in the query is empty. 2. NOT NEAR This operator is also a binary operator, dealing with the datatype NUMBER and DATE. It has the syntax: op1 NOT NEAR op2 The op1 refers to an attribute, whereas op2 is a fixed value, both of the same data type. A query containing the operator looks like: SELECT id, name, age, history FROMcasualties WHERE cause = ‘heart attack’ AND age NOT NEAR 55 Or suppose we need a list of some event that is not clashing with some commitment of ours: SELECT * FROMevents WHERE e_name= ‘concert’ AND date NOT NEAR 8/28/2007 The algorithm for NOT NEAR works like this: First of all it adds the margins to the op2, i.e. m1 and m2, dynamically on both the sides, considering the value op2 contains. op1 values outside the scope of the op2 (m1, m2) are retrieved and added to the result. If the result set is empty, the farthest values within the op2 fuzzy set (those possessing the least membership degree) are retrieved. This is done by continuing the search from values with md=0.1 till the md=0.6, where the md for NOT NEAR reaches 0.4. Regards, Tasneem Ishaque Memon MS (Computer Science) Institute of Mathmetics and Computer Science University of Sindh, Jamshoro Pakistan http://www.geocities.com/tasneememon/- The process of gaining knowledge is not producing results but clearing away ignorance. _ Discover the new Windows Vista http://search.msn.com/results.aspx?q=windows+vistamkt=en-USform=QBRE
[HACKERS] Help Required regarding implementing operators in postgreSQL
Dear Developers, Hi, I am Tasneem Memon doing MS Computer Science. I am working on my thesis these days, for which I have defined some operators theoritically as well as their algorithms, and intend to implement them in PostgreSQL. These operators(NEAR, NOT NEAR) are binary and work with NUMBER and DATE data types. Now I need to implement support for them in the parser. But I haven't worked on the optimization of the operators. And also I am new to database systems programming, I am quite confused about what to do now and if I am going the right direction!Please Guide me what should I do next.With best regards, Tasneem Ishaque Memon MS (Computer Science) Institute of Mathmetics and Computer Science University of Sindh, Jamshoro Pakistan http://www.geocities.com/tasneememon/- The process of gaining knowledge is not producing results but clearing away ignorance. _ News, entertainment and everything you care about at Live.com. Get it now! http://www.live.com/getstarted.aspx
