Re: Avro in PHP

2009-11-16 Thread Jeff Hammerbacher
Hey Ryan, You're not the first to ask. Check out http://www.mail-archive.com/avro-dev@hadoop.apache.org/msg01230.html. If you can bring some PHP hackers to the Avro Hackathon on Thursday ( http://avrohackathon.eventbrite.com), it would be great to get something started on this front. Later, Jeff

Avro in PHP

2009-11-16 Thread Ryan Rawson
Hi all, Has anyone else been thinking about this? Right now thrift's strength over the competitors is it has a PHP implementation. Protobuf does not. Avro probably should have one. The first obvious "C extension" comes to mind, but making the whole thing seamless as well as being "PHP-like" I do

[jira] Commented: (AVRO-196) Add encoding for sparse records

2009-11-16 Thread Justin SB (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778676#action_12778676 ] Justin SB commented on AVRO-196: You're probably right that this is too big a change for avro

[jira] Updated: (AVRO-204) change the way symbolic references are tracked

2009-11-16 Thread Scott Banachowski (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Banachowski updated AVRO-204: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed revision 881076.

[jira] Updated: (AVRO-204) change the way symbolic references are tracked

2009-11-16 Thread Scott Banachowski (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Banachowski updated AVRO-204: --- Status: Patch Available (was: Open) > change the way symbolic references are tracked > ---

[jira] Updated: (AVRO-204) change the way symbolic references are tracked

2009-11-16 Thread Scott Banachowski (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Banachowski updated AVRO-204: --- Attachment: AVRO-204.patch > change the way symbolic references are tracked > -

[jira] Created: (AVRO-204) change the way symbolic references are tracked

2009-11-16 Thread Scott Banachowski (JIRA)
change the way symbolic references are tracked -- Key: AVRO-204 URL: https://issues.apache.org/jira/browse/AVRO-204 Project: Avro Issue Type: Improvement Components: c++ Repor

[jira] Resolved: (AVRO-200) Let Utf8 implement java.io.Serializable

2009-11-16 Thread Eelco Hillenius (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eelco Hillenius resolved AVRO-200. -- Resolution: Won't Fix AVRO-80 will fix this as a side effect. > Let Utf8 implement java.io.Seria

[jira] Commented: (AVRO-200) Let Utf8 implement java.io.Serializable

2009-11-16 Thread Eelco Hillenius (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778561#action_12778561 ] Eelco Hillenius commented on AVRO-200: -- Ah. I missed AVRO-80. Very sorry about that. Thi

[jira] Commented: (AVRO-200) Let Utf8 implement java.io.Serializable

2009-11-16 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778550#action_12778550 ] Doug Cutting commented on AVRO-200: --- Have you been following AVRO-80? My intent is to chan

[jira] Commented: (AVRO-200) Let Utf8 implement java.io.Serializable

2009-11-16 Thread Eelco Hillenius (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778545#action_12778545 ] Eelco Hillenius commented on AVRO-200: -- I'm using the introspection based API, and for t

[jira] Updated: (AVRO-153) Naming conventions for avro schemas, records and protocols

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher updated AVRO-153: --- Summary: Naming conventions for avro schemas, records and protocols (was: Naming conventions f

[jira] Commented: (AVRO-153) Naming conventions for avro records and protocols

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778511#action_12778511 ] Jeff Hammerbacher commented on AVRO-153: Pulling in some comments from Doug on the de

Re: Why do named schemas have namespaces?

2009-11-16 Thread Patrick Hunt
Same problem for enums btw. If you use symbols:["long", "null"] etc... the java will fail to compile (fine for python though on both these issues). Patrick Doug Cutting wrote: Patrick Hunt wrote: Re 153 - last night I noticed that if you spec a record/enum/etc... with a name that starts with

Re: Why do named schemas have namespaces?

2009-11-16 Thread Doug Cutting
Patrick Hunt wrote: Re 153 - last night I noticed that if you spec a record/enum/etc... with a name that starts with lower case it fails to compile in Java: * start with [A-Za-z_] Add this to 153 or a new JIRA? Do we want to enforce naming conventions or just leave them conventions? If the

Re: Why do named schemas have namespaces?

2009-11-16 Thread Patrick Hunt
Re 153 - last night I noticed that if you spec a record/enum/etc... with a name that starts with lower case it fails to compile in Java: * start with [A-Za-z_] Add this to 153 or a new JIRA? Patrick Doug Cutting wrote: Jeff Hammerbacher wrote: In the Avro spec, namespaces are defined for pr

Re: clarification on schema resolution

2009-11-16 Thread Jeff Hammerbacher
> What do folks think is best here? Should we require all values that don't > have a default values to be present, i.e., record fields with a default > value are optional, all others are mandatory? > Thrift allows entries in a struct to be marked "optional", which may be an option to make explici

Re: Why do named schemas have namespaces?

2009-11-16 Thread Doug Cutting
I think AVRO-153 is fine for this. Thanks! Doug Jeff Hammerbacher wrote: Hey Doug, Great, would you like to do the work on the spec under the aegis of 153 or shall I open another ticket for adding namespaces to the schema portion of the spec? Thanks, Jeff On Mon, Nov 16, 2009 at 11:36 AM, D

[jira] Commented: (AVRO-198) "protocol declaration" of spec lists a "name" attribute rather than "protocol"

2009-11-16 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778480#action_12778480 ] Doug Cutting commented on AVRO-198: --- Good catch. Java's protocol parser currently only req

Re: Why do named schemas have namespaces?

2009-11-16 Thread Jeff Hammerbacher
Hey Doug, Great, would you like to do the work on the spec under the aegis of 153 or shall I open another ticket for adding namespaces to the schema portion of the spec? Thanks, Jeff On Mon, Nov 16, 2009 at 11:36 AM, Doug Cutting wrote: > Jeff Hammerbacher wrote: > >> In the Avro spec, namespa

[jira] Commented: (AVRO-200) Let Utf8 implement java.io.Serializable

2009-11-16 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778479#action_12778479 ] Doug Cutting commented on AVRO-200: --- Wouldn't all Avro data-representation classes need to

Re: Why do named schemas have namespaces?

2009-11-16 Thread Doug Cutting
Jeff Hammerbacher wrote: In the Avro spec, namespaces are defined for protocols, but not for named schemas. Yet in both the Java and Python codebases, it appears that schemas can have a namespace. Should the code be removed, or the spec be updated? The spec should be updated. Schemas can speci

Re: What is the purpose of the "seen" argument to __eq__ and __hash__ in Schema.py?

2009-11-16 Thread Doug Cutting
I think it's like the "seen" tables used in Java: it contains the set of schemas that are on the stack. Schemas can be circular, so this is required to prevent infinite loops. Doug Jeff Hammerbacher wrote: I think I know, but I want to hear it articulated. A docstring with this information w

Re: clarification on schema resolution

2009-11-16 Thread Doug Cutting
Scott Banachowski wrote: Regarding union resolution, the spec says to take the first match when comparing them. What if the first match is "promotable"? I would expect preference for the first "exact" match, if both an exact and promotable match existed. Good question. I agree, and that's wh

[jira] Updated: (AVRO-197) Add mapping of name to index for records and enums

2009-11-16 Thread Scott Banachowski (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Banachowski updated AVRO-197: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed revision 880888.

[jira] Commented: (AVRO-52) Need a usage/lifecycle test to explain the python API

2009-11-16 Thread Philip Zeyliger (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778344#action_12778344 ] Philip Zeyliger commented on AVRO-52: - Sure. Would be great for the quickstart(s) to be p

[jira] Assigned: (AVRO-203) Add single space between "#" and text in license headers for Python files

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher reassigned AVRO-203: -- Assignee: Jeff Hammerbacher > Add single space between "#" and text in license headers fo

[jira] Updated: (AVRO-203) Add single space between "#" and text in license headers for Python files

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher updated AVRO-203: --- Attachment: AVRO-203.patch > Add single space between "#" and text in license headers for Pytho

[jira] Created: (AVRO-203) Add single space between "#" and text in license headers for Python files

2009-11-16 Thread Jeff Hammerbacher (JIRA)
Add single space between "#" and text in license headers for Python files - Key: AVRO-203 URL: https://issues.apache.org/jira/browse/AVRO-203 Project: Avro Issue Type: T

[jira] Assigned: (AVRO-202) Add __all__ listing to avro module

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher reassigned AVRO-202: -- Assignee: Jeff Hammerbacher > Add __all__ listing to avro module > --

[jira] Created: (AVRO-202) Add __all__ listing to avro module

2009-11-16 Thread Jeff Hammerbacher (JIRA)
Add __all__ listing to avro module -- Key: AVRO-202 URL: https://issues.apache.org/jira/browse/AVRO-202 Project: Avro Issue Type: Task Components: python Reporter: Jeff Hammerbacher

[jira] Updated: (AVRO-202) Add __all__ listing to avro module

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher updated AVRO-202: --- Attachment: AVRO-202.patch > Add __all__ listing to avro module > -

[jira] Assigned: (AVRO-199) Clean up schemas in testio.py

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher reassigned AVRO-199: -- Assignee: Jeff Hammerbacher > Clean up schemas in testio.py > ---

[jira] Assigned: (AVRO-201) Move DataFile[Reader|Writer] from io.py into datafile.py

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher reassigned AVRO-201: -- Assignee: Jeff Hammerbacher > Move DataFile[Reader|Writer] from io.py into datafile.py >

[jira] Assigned: (AVRO-169) Typo in the specification

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher reassigned AVRO-169: -- Assignee: Jeff Hammerbacher > Typo in the specification > - > >

[jira] Commented: (AVRO-161) Add test to Python bindings for opening a non-empty file object container and successfully adding new elements

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778293#action_12778293 ] Jeff Hammerbacher commented on AVRO-161: bq. I think we would have to move DataFileWr

[jira] Assigned: (AVRO-161) Add test to Python bindings for opening a non-empty file object container and successfully adding new elements

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher reassigned AVRO-161: -- Assignee: Jeff Hammerbacher > Add test to Python bindings for opening a non-empty file ob

[jira] Created: (AVRO-201) Move DataFile[Reader|Writer] from io.py into datafile.py

2009-11-16 Thread Jeff Hammerbacher (JIRA)
Move DataFile[Reader|Writer] from io.py into datafile.py - Key: AVRO-201 URL: https://issues.apache.org/jira/browse/AVRO-201 Project: Avro Issue Type: Task Components: python

[jira] Updated: (AVRO-201) Move DataFile[Reader|Writer] from io.py into datafile.py

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher updated AVRO-201: --- Attachment: AVRO-201.patch Patch implements this separation. > Move DataFile[Reader|Writer] fr

[jira] Commented: (AVRO-136) add support for building/releasing python eggs

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778283#action_12778283 ] Jeff Hammerbacher commented on AVRO-136: Hey Patrick, Are you still planning to work

[jira] Commented: (AVRO-52) Need a usage/lifecycle test to explain the python API

2009-11-16 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778282#action_12778282 ] Jeff Hammerbacher commented on AVRO-52: --- Does Patrick Hunt's Avro RPC Quickstart on Gith

Why do named schemas have namespaces?

2009-11-16 Thread Jeff Hammerbacher
Hey, In the Avro spec, namespaces are defined for protocols, but not for named schemas. Yet in both the Java and Python codebases, it appears that schemas can have a namespace. Should the code be removed, or the spec be updated? Thanks, Jeff