Re: Spam:*******, Re: RETS - Real Estate Standards Organization - XML feed - anyone have any experience

2011-08-12 Thread Wayne Gregor 

Hi Wil,

Thanks for the note.. A couple of questions

When you mention "use phRets" you're suggesting using a php 
server to accomplish the data retrieval tasks?

With regard to the amount of data that is retrieved each 
time we connect to the RETS server... currently I pull 
information via an FTP feed.  I connect to the their FTP 
site and look for the latest ftp zip file.  These zip files 
allow me to add and delete properties from my aggregate 
database.  Is there some sort of query language with RETS 
that allows me to do the same incremental update throughout 
the day?

Finally, I run my own CF server... allow I'm no expert on 
incorporating a JAVA API into CF I know that it is 
possible.  Have you looked at "RETS IQ Java RETS Library"?

http://wiki.rets.org/wiki/RETS_IQ_Java_RETS_Library

What do you think about using such a library?

Thanks again!

Wayne




On 8/6/2011 12:50 PM, Wil Genovese wrote:
> Wayne,
>
> I spent over 5 years working with Real Estate data and the RETS servers.  The 
> misfortunate part of RETS is that there is NOT a standard.  Every MLS market 
> implements RETS differently.  I've written a RETS client in ColdFusion once.  
> It's market specific and the client owns the code. The best I can suggest is 
> to look at phRets and decided if you want to use that or rewrite that to 
> ColdFusion.
>
> The thing to remember it that it's all XML.  NExt you have to make http calls 
> to get the meta data, then parse that out then do another http call to get 
> the next level meta data and parse that out. You keep doing this until you 
> have all the meta data that describes the entire data structure. Then create 
> the structure in your DB. Then you start doing http calls to get the data.  
> If the market is a large MLS market, you may have problems with memory limits 
> in the JVM. I've had to run upwards of 4Gb or more in the heap and setup 
> fairly aggressive garbage collections.  Your server side needs to be fast. 
> The process of RETS means the code will be running for maybe an hour or more 
> (depending on the data set) and could be making hundreds of HTTP calls.
>
> Getting images is almost as fun. But I found I could get them with ColdFusion 
> via RETS and save them to a drive rather quickly. The data is in binary 
> format and may not seem obvious at first when you make the first RETS object 
> call. But ColdFusion will process the data and you can save the image.
>
> I just looked in my "junk" code folder where I keep all sorts of test code 
> snippets.  I found some RETS test code that may help you.  I'll send it 
> privately.
>
>
> Good Luck!
>
>
> Wil Genovese
> Sr. Web Application Developer/
> Systems Administrator
> CF Webtools
> www.cfwebtools.com
>
> wilg...@trunkful.com
> www.trunkful.com
>
> On Aug 6, 2011, at 2:36 PM, Wayne Gregor wrote:
>
>> I need to convert over a couple of real estate website that
>> are currently receiving MLS data via an hourly FTP feed.
>> The new system handed down by the National Association of
>> Realtors is RETS.
>>
>> Do any of you know if there are any CFC functions out there
>> that would make it easier for me to interface with this new
>> system?
>>
>>
>> -- 
>> *Wayne Gregori*
>> Office: 510-895-1066
>> Cell: 510-219-3887
>> w...@sfnet.com
>>
>>
>>
> 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:346721
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm

Re: RETS - Real Estate Standards Organization - XML feed - anyone have any experience

2011-08-06 Thread Wil Genovese 

Wayne,

I spent over 5 years working with Real Estate data and the RETS servers.  The 
misfortunate part of RETS is that there is NOT a standard.  Every MLS market 
implements RETS differently.  I've written a RETS client in ColdFusion once.  
It's market specific and the client owns the code. The best I can suggest is to 
look at phRets and decided if you want to use that or rewrite that to 
ColdFusion.

The thing to remember it that it's all XML.  NExt you have to make http calls 
to get the meta data, then parse that out then do another http call to get the 
next level meta data and parse that out. You keep doing this until you have all 
the meta data that describes the entire data structure. Then create the 
structure in your DB. Then you start doing http calls to get the data.  If the 
market is a large MLS market, you may have problems with memory limits in the 
JVM. I've had to run upwards of 4Gb or more in the heap and setup fairly 
aggressive garbage collections.  Your server side needs to be fast. The process 
of RETS means the code will be running for maybe an hour or more (depending on 
the data set) and could be making hundreds of HTTP calls. 

Getting images is almost as fun. But I found I could get them with ColdFusion 
via RETS and save them to a drive rather quickly. The data is in binary format 
and may not seem obvious at first when you make the first RETS object call. But 
ColdFusion will process the data and you can save the image.

I just looked in my "junk" code folder where I keep all sorts of test code 
snippets.  I found some RETS test code that may help you.  I'll send it 
privately.


Good Luck!


Wil Genovese
Sr. Web Application Developer/
Systems Administrator
CF Webtools
www.cfwebtools.com

wilg...@trunkful.com
www.trunkful.com

On Aug 6, 2011, at 2:36 PM, Wayne Gregor wrote:

> 
> I need to convert over a couple of real estate website that 
> are currently receiving MLS data via an hourly FTP feed.  
> The new system handed down by the National Association of 
> Realtors is RETS .
> 
> Do any of you know if there are any CFC functions out there 
> that would make it easier for me to interface with this new 
> system?
> 
> 
> -- 
> *Wayne Gregori*
> Office: 510-895-1066
> Cell: 510-219-3887
> w...@sfnet.com
> 
> 
> 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:346561
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm

RETS - Real Estate Standards Organization - XML feed - anyone have any experience

2011-08-06 Thread Wayne Gregor 

I need to convert over a couple of real estate website that 
are currently receiving MLS data via an hourly FTP feed.  
The new system handed down by the National Association of 
Realtors is RETS .

Do any of you know if there are any CFC functions out there 
that would make it easier for me to interface with this new 
system?


-- 
*Wayne Gregori*
Office: 510-895-1066
Cell: 510-219-3887
w...@sfnet.com


~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:346559
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm