[jira] [Updated] (AVRO-2192) Remove paranamer dependency from Avro

2018-12-05 Thread Nandor Kollar (JIRA)


 [ 
https://issues.apache.org/jira/browse/AVRO-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandor Kollar updated AVRO-2192:

Hadoop Flags: Incompatible change

> Remove paranamer dependency from Avro
> -
>
> Key: AVRO-2192
> URL: https://issues.apache.org/jira/browse/AVRO-2192
> Project: Apache Avro
>  Issue Type: Improvement
>  Components: java
>Affects Versions: 1.8.2
>Reporter: RAJKUMAR NATARAJAN
>Assignee: Ismaël Mejía
>Priority: Minor
> Fix For: 1.9.0
>
>
> Hi,
>  
> Avro seems to be depend upon the com.thoughtworks.paranamer. Avro 1.7.7 
> depends upon 2.7 and 1.8. depends on 2.8 paranamer versions.
>  
> Please remove this dependency in the future versions.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (AVRO-2155) Generate documentation for C# classes and enums

2018-12-05 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710147#comment-16710147
 ] 

ASF subversion and git services commented on AVRO-2155:
---

Commit 915cb4541fa0e7d3d96646947f449cbb4b75589a in avro's branch 
refs/heads/master from [~blachniet]
[ https://gitbox.apache.org/repos/asf?p=avro.git;h=915cb45 ]

AVRO-2155: Include documentation for named schemas in generated code (#296)

* AVRO-2155: Add `Documentation` property to `NamedSchema`

* AVRO-2155: Add documentation to generated code


> Generate documentation for C# classes and enums
> ---
>
> Key: AVRO-2155
> URL: https://issues.apache.org/jira/browse/AVRO-2155
> Project: Apache Avro
>  Issue Type: New Feature
>  Components: csharp
>Affects Versions: 1.8.2
>Reporter: Brian Lachniet
>Priority: Minor
>
> Update the C# "avrogen" code generation to populate documentation for code 
> entities (classes and enums) that are generated from named schemas (record, 
> enum and fixed). At this time, it only generates documentation for Avro 
> fields (C# fields and properties).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (AVRO-2155) Generate documentation for C# classes and enums

2018-12-05 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710148#comment-16710148
 ] 

ASF subversion and git services commented on AVRO-2155:
---

Commit 915cb4541fa0e7d3d96646947f449cbb4b75589a in avro's branch 
refs/heads/master from [~blachniet]
[ https://gitbox.apache.org/repos/asf?p=avro.git;h=915cb45 ]

AVRO-2155: Include documentation for named schemas in generated code (#296)

* AVRO-2155: Add `Documentation` property to `NamedSchema`

* AVRO-2155: Add documentation to generated code


> Generate documentation for C# classes and enums
> ---
>
> Key: AVRO-2155
> URL: https://issues.apache.org/jira/browse/AVRO-2155
> Project: Apache Avro
>  Issue Type: New Feature
>  Components: csharp
>Affects Versions: 1.8.2
>Reporter: Brian Lachniet
>Priority: Minor
>
> Update the C# "avrogen" code generation to populate documentation for code 
> entities (classes and enums) that are generated from named schemas (record, 
> enum and fixed). At this time, it only generates documentation for Avro 
> fields (C# fields and properties).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (AVRO-2155) Generate documentation for C# classes and enums

2018-12-05 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710146#comment-16710146
 ] 

ASF GitHub Bot commented on AVRO-2155:
--

dkulp closed pull request #296: AVRO-2155: Include documentation for named 
schemas in generated code
URL: https://github.com/apache/avro/pull/296
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/lang/csharp/src/apache/main/CodeGen/CodeGen.cs 
b/lang/csharp/src/apache/main/CodeGen/CodeGen.cs
index 7e70a02d5..2bcebabd9 100644
--- a/lang/csharp/src/apache/main/CodeGen/CodeGen.cs
+++ b/lang/csharp/src/apache/main/CodeGen/CodeGen.cs
@@ -260,6 +260,11 @@ protected virtual void processFixed(Schema schema)
 ctd.Attributes = MemberAttributes.Public;
 ctd.BaseTypes.Add("SpecificFixed");
 
+if (fixedSchema.Documentation != null)
+{
+ctd.Comments.Add(createDocComment(fixedSchema.Documentation));
+}
+
 // create static schema field
 createSchemaField(schema, ctd, true);
 
@@ -306,6 +311,11 @@ protected virtual void processEnum(Schema schema)
 ctd.IsEnum = true;
 ctd.Attributes = MemberAttributes.Public;
 
+if (enumschema.Documentation != null)
+{
+ctd.Comments.Add(createDocComment(enumschema.Documentation));
+}
+
 foreach (string symbol in enumschema.Symbols)
 {
 if (CodeGenUtil.Instance.ReservedKeywords.Contains(symbol))
@@ -526,6 +536,11 @@ protected virtual CodeTypeDeclaration processRecord(Schema 
schema)
 ctd.IsClass = true;
 ctd.IsPartial = true;
 
+if (recordSchema.Documentation != null)
+{
+ctd.Comments.Add(createDocComment(recordSchema.Documentation));
+}
+
 createSchemaField(schema, ctd, isError);
 
 // declare Get() to be used by the Writer classes
diff --git a/lang/csharp/src/apache/main/Schema/EnumSchema.cs 
b/lang/csharp/src/apache/main/Schema/EnumSchema.cs
index fc21d14b7..93c36c7ef 100644
--- a/lang/csharp/src/apache/main/Schema/EnumSchema.cs
+++ b/lang/csharp/src/apache/main/Schema/EnumSchema.cs
@@ -70,7 +70,8 @@ internal static EnumSchema NewInstance(JToken jtok, 
PropertyMap props, SchemaNam
 symbolMap[s] = i++;
 symbols.Add(s);
 }
-return new EnumSchema(name, aliases, symbols, symbolMap, props, 
names);
+return new EnumSchema(name, aliases, symbols, symbolMap, props, 
names,
+JsonHelper.GetOptionalString(jtok, "doc"));
 }
 
 /// 
@@ -80,10 +81,13 @@ internal static EnumSchema NewInstance(JToken jtok, 
PropertyMap props, SchemaNam
 /// list of aliases for the name
 /// list of enum symbols
 /// map of enum symbols and value
+/// custom properties on this schema
 /// list of named schema already read
+/// documentation for this named schema
 private EnumSchema(SchemaName name, IList aliases, 
List symbols,
-IDictionary symbolMap, PropertyMap 
props, SchemaNames names)
-: base(Type.Enumeration, name, aliases, props, 
names)
+IDictionary symbolMap, PropertyMap 
props, SchemaNames names,
+string doc)
+: base(Type.Enumeration, name, aliases, props, 
names, doc)
 {
 if (null == name.Name) throw new SchemaParseException("name cannot 
be null for enum schema.");
 this.Symbols = symbols;
diff --git a/lang/csharp/src/apache/main/Schema/FixedSchema.cs 
b/lang/csharp/src/apache/main/Schema/FixedSchema.cs
index 67c843d9a..873992116 100644
--- a/lang/csharp/src/apache/main/Schema/FixedSchema.cs
+++ b/lang/csharp/src/apache/main/Schema/FixedSchema.cs
@@ -44,7 +44,8 @@ internal static FixedSchema NewInstance(JToken jtok, 
PropertyMap props, SchemaNa
 SchemaName name = NamedSchema.GetName(jtok, encspace);
 var aliases = NamedSchema.GetAliases(jtok, name.Space, 
name.EncSpace);
 
-return new FixedSchema(name, aliases, 
JsonHelper.GetRequiredInteger(jtok, "size"), props, names);
+return new FixedSchema(name, aliases, 
JsonHelper.GetRequiredInteger(jtok, "size"), props, names,
+JsonHelper.GetOptionalString(jtok, "doc"));
 }
 
 /// 
@@ -53,9 +54,12 @@ internal static FixedSchema NewInstance(JToken jtok, 
PropertyMap props, SchemaNa
 /// name of the fixed schema
 /// list of aliases for the name
 /// f

[jira] [Commented] (AVRO-2144) 404 - Not found - Invalid Url for CSharp documentation

2018-12-05 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710151#comment-16710151
 ] 

ASF GitHub Bot commented on AVRO-2144:
--

dkulp closed pull request #286: AVRO-2144: Fix for CSharp documentation Url
URL: https://github.com/apache/avro/pull/286
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/doc/src/content/xdocs/site.xml b/doc/src/content/xdocs/site.xml
index 30d0b4870..5aec50ca9 100644
--- a/doc/src/content/xdocs/site.xml
+++ b/doc/src/content/xdocs/site.xml
@@ -77,7 +77,7 @@ See http://forrest.apache.org/docs/linking.html for more info

   
   
-   
+   
   
   



 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> 404 - Not found - Invalid Url for CSharp documentation
> --
>
> Key: AVRO-2144
> URL: https://issues.apache.org/jira/browse/AVRO-2144
> Project: Apache Avro
>  Issue Type: Bug
>  Components: doc
>Affects Versions: 1.8.2
>Reporter: Selva Chinnasamy
>Assignee: Selva Chinnasamy
>Priority: Minor
>
> Invalid Url for C# Api documentation
> Selecting the below link
> [C# API|http://avro.apache.org/docs/current/api/csharp/index.html]
> leads to 404. Below is the current result:
> h1. Not Found
> The requested URL /docs/current/api/csharp/index.html was not found on this 
> server.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (AVRO-2156) Allow custom namespace for C# generated code

2018-12-05 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710155#comment-16710155
 ] 

ASF subversion and git services commented on AVRO-2156:
---

Commit 602a2c5b5258d5e1f0f60f71506b16801cbdf156 in avro's branch 
refs/heads/master from [~blachniet]
[ https://gitbox.apache.org/repos/asf?p=avro.git;h=602a2c5 ]

AVRO-2156: Map Avro namespace to C# namespaces during code generation


> Allow custom namespace for C# generated code
> 
>
> Key: AVRO-2156
> URL: https://issues.apache.org/jira/browse/AVRO-2156
> Project: Apache Avro
>  Issue Type: New Feature
>  Components: csharp
>Affects Versions: 1.8.2
>Reporter: Brian Lachniet
>Priority: Major
>
> The namespace used in Avro schemas/protocols does not always map nicely to a 
> standard C# namespace. Avrogen (the C# code generator) currently uses the 
> Avro namespace as the C# namespace. I propose that we update the avrogen 
> utility to allow the user to override the namespace used in the generated 
> code via a command line parameter.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (AVRO-2156) Allow custom namespace for C# generated code

2018-12-05 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710154#comment-16710154
 ] 

ASF GitHub Bot commented on AVRO-2156:
--

dkulp closed pull request #297: AVRO-2156: Map Avro namespace to C# namespaces 
during code generation
URL: https://github.com/apache/avro/pull/297
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/lang/csharp/src/apache/codegen/AvroGen.cs 
b/lang/csharp/src/apache/codegen/AvroGen.cs
index 033b8404b..465857f60 100644
--- a/lang/csharp/src/apache/codegen/AvroGen.cs
+++ b/lang/csharp/src/apache/codegen/AvroGen.cs
@@ -25,25 +25,111 @@ class AvroGen
 {
 static void Main(string[] args)
 {
-if (args.Length != 3)
+// Print usage if no arguments provided or help requested
+if (args.Length == 0 || args[0] == "-h" || args[0] == "--help")
 {
 Usage();
 return;
 }
-if (args[0] == "-p")
-GenProtocol(args[1], args[2]);
-else if (args[0] == "-s")
-GenSchema(args[1], args[2]);
-else
+
+// Parse command line arguments
+bool? isProtocol = null;
+string inputFile = null;
+string outputDir = null;
+var namespaceMapping = new Dictionary();
+for (int i = 0; i < args.Length; ++i)
+{
+if (args[i] == "-p")
+{
+if (i + 1 >= args.Length)
+{
+Console.WriteLine("Missing path to protocol file");
+Usage();
+return;
+}
+
+isProtocol = true;
+inputFile = args[++i];
+}
+else if (args[i] == "-s")
+{
+if (i + 1 >= args.Length)
+{
+Console.WriteLine("Missing path to schema file");
+Usage();
+return;
+}
+
+isProtocol = false;
+inputFile = args[++i];
+}
+else if (args[i] == "--namespace")
+{
+if (i + 1 >= args.Length)
+{
+Console.WriteLine("Missing namespace mapping");
+Usage();
+return;
+}
+
+var parts = args[++i].Split(new char[] { ':' }, 
StringSplitOptions.RemoveEmptyEntries);
+if (parts.Length != 2)
+{
+Console.WriteLine("Malformed namespace mapping. 
Required format is \"avro.namespace:csharp.namespace\"");
+Usage();
+return;
+}
+
+namespaceMapping[parts[0]] = parts[1];
+}
+else if (outputDir == null)
+{
+outputDir = args[i];
+}
+else
+{
+Console.WriteLine("Unexpected command line argument: {0}", 
args[i]);
+Usage();
+}
+}
+
+// Ensure we got all the command line arguments we need
+bool isValid = true;
+if (!isProtocol.HasValue || inputFile == null)
+{
+Console.WriteLine("Must provide either '-p ' or 
'-s '");
+isValid = false;
+}
+else if (outputDir == null)
+{
+Console.WriteLine("Must provide 'outputdir'");
+isValid = false;
+}
+
+if (!isValid)
 Usage();
+else if (isProtocol.Value)
+GenProtocol(inputFile, outputDir, namespaceMapping);
+else
+GenSchema(inputFile, outputDir, namespaceMapping);
 }
 
 static void Usage()
 {
-Console.WriteLine("Usage:\navrogen -p  
\navrogen -s  ");
+Console.WriteLine("{0}\n\n" +
+"Usage:\n" +
+"  avrogen -p   [--namespace 
]\n" +
+"  avrogen -s   [--namespace 
]\n\n" +
+"Options:\n" +
+"  -h --help   Show this screen.\n" +
+"  --namespace Map an Avro schema/protocol namespace to a C# 
namespace.\n" +
+"  The format is 
\"my.avro.namespace:my.csharp.namespace\".\n" +
+"  May be specified 

[jira] [Commented] (AVRO-2155) Generate documentation for C# classes and enums

2018-12-05 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710149#comment-16710149
 ] 

ASF subversion and git services commented on AVRO-2155:
---

Commit 915cb4541fa0e7d3d96646947f449cbb4b75589a in avro's branch 
refs/heads/master from [~blachniet]
[ https://gitbox.apache.org/repos/asf?p=avro.git;h=915cb45 ]

AVRO-2155: Include documentation for named schemas in generated code (#296)

* AVRO-2155: Add `Documentation` property to `NamedSchema`

* AVRO-2155: Add documentation to generated code


> Generate documentation for C# classes and enums
> ---
>
> Key: AVRO-2155
> URL: https://issues.apache.org/jira/browse/AVRO-2155
> Project: Apache Avro
>  Issue Type: New Feature
>  Components: csharp
>Affects Versions: 1.8.2
>Reporter: Brian Lachniet
>Priority: Minor
>
> Update the C# "avrogen" code generation to populate documentation for code 
> entities (classes and enums) that are generated from named schemas (record, 
> enum and fixed). At this time, it only generates documentation for Avro 
> fields (C# fields and properties).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (AVRO-2144) 404 - Not found - Invalid Url for CSharp documentation

2018-12-05 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710152#comment-16710152
 ] 

ASF subversion and git services commented on AVRO-2144:
---

Commit eaa7cca922b916ab7ad0fac6e109330197f8c75f in avro's branch 
refs/heads/master from [~vishelma]
[ https://gitbox.apache.org/repos/asf?p=avro.git;h=eaa7cca ]

AVRO-2144: Fix for CSharp documentation Url


> 404 - Not found - Invalid Url for CSharp documentation
> --
>
> Key: AVRO-2144
> URL: https://issues.apache.org/jira/browse/AVRO-2144
> Project: Apache Avro
>  Issue Type: Bug
>  Components: doc
>Affects Versions: 1.8.2
>Reporter: Selva Chinnasamy
>Assignee: Selva Chinnasamy
>Priority: Minor
>
> Invalid Url for C# Api documentation
> Selecting the below link
> [C# API|http://avro.apache.org/docs/current/api/csharp/index.html]
> leads to 404. Below is the current result:
> h1. Not Found
> The requested URL /docs/current/api/csharp/index.html was not found on this 
> server.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (AVRO-1363) C# UnionSchema fails to parse the the unions with same type names with different namespaces

2018-12-05 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710271#comment-16710271
 ] 

ASF GitHub Bot commented on AVRO-1363:
--

dkulp closed pull request #156: AVRO-1363 Fix the C# parsing of a union schema 
URL: https://github.com/apache/avro/pull/156
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/lang/csharp/src/apache/main/Schema/NamedSchema.cs 
b/lang/csharp/src/apache/main/Schema/NamedSchema.cs
index 02beb7984..b75483f84 100644
--- a/lang/csharp/src/apache/main/Schema/NamedSchema.cs
+++ b/lang/csharp/src/apache/main/Schema/NamedSchema.cs
@@ -52,7 +52,7 @@ public string Namespace
 /// 
 /// Namespace.Name of the schema
 /// 
-public string Fullname
+public override string Fullname
 {
 get { return SchemaName.Fullname; }
 }
diff --git a/lang/csharp/src/apache/main/Schema/Schema.cs 
b/lang/csharp/src/apache/main/Schema/Schema.cs
index fc0e23792..d2d2f079c 100644
--- a/lang/csharp/src/apache/main/Schema/Schema.cs
+++ b/lang/csharp/src/apache/main/Schema/Schema.cs
@@ -70,12 +70,20 @@ protected Schema(Type type, PropertyMap props)
 this.Props = props;
 }
 
+/// 
+/// If this is a record, enum or fixed, returns its name, otherwise 
the name the primitive type. 
+/// 
+public abstract string Name { get; }
+
 /// 
 /// The name of this schema. If this is a named schema such as an 
enum, it returns the fully qualified
 /// name for the schema. For other schemas, it returns the type of the 
schema.
 /// 
-public abstract string Name { get; }
-
+public virtual string Fullname 
+{
+get { return Name; }
+}
+
 /// 
 /// Static class to return new instance of schema object
 /// 
diff --git a/lang/csharp/src/apache/main/Schema/UnionSchema.cs 
b/lang/csharp/src/apache/main/Schema/UnionSchema.cs
index df2c37fce..bc2ab5b9b 100644
--- a/lang/csharp/src/apache/main/Schema/UnionSchema.cs
+++ b/lang/csharp/src/apache/main/Schema/UnionSchema.cs
@@ -56,7 +56,7 @@ internal static UnionSchema NewInstance(JArray jarr, 
PropertyMap props, SchemaNa
 if (null == unionType)
 throw new SchemaParseException("Invalid JSON in union" + 
jvalue.ToString());
 
-string name = unionType.Name;
+string name = unionType.Fullname;
 if (uniqueSchemas.ContainsKey(name))
 throw new SchemaParseException("Duplicate type in union: " 
+ name);
 
diff --git a/lang/csharp/src/apache/test/Schema/SchemaTests.cs 
b/lang/csharp/src/apache/test/Schema/SchemaTests.cs
index b12483187..885b5a40b 100644
--- a/lang/csharp/src/apache/test/Schema/SchemaTests.cs
+++ b/lang/csharp/src/apache/test/Schema/SchemaTests.cs
@@ -69,7 +69,8 @@ public class SchemaTests
 Description = "No fields", ExpectedException = 
typeof(SchemaParseException))]
 [TestCase("{\"type\":\"record\",\"name\":\"LongList\", \"fields\": 
\"hi\"}",
 Description = "Fields not an array", ExpectedException = 
typeof(SchemaParseException))]
-
+[TestCase("[{\"type\": \"record\",\"name\": 
\"Test\",\"namespace\":\"ns1\",\"fields\": [{\"name\": \"f\",\"type\": 
\"long\"}]}," + 
+   "{\"type\": \"record\",\"name\": 
\"Test\",\"namespace\":\"ns2\",\"fields\": [{\"name\": \"f\",\"type\": 
\"long\"}]}]")]
 // Enum
 [TestCase("{\"type\": \"enum\", \"name\": \"Test\", \"symbols\": 
[\"A\", \"B\"]}")]
 [TestCase("{\"type\": \"enum\", \"name\": \"Status\", \"symbols\": 
\"Normal Caution Critical\"}",


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> C# UnionSchema fails to parse the the unions with same type names with 
> different namespaces
> ---
>
> Key: AVRO-1363
> URL: https://issues.apache.org/jira/browse/AVRO-1363
> Project: Apache Avro
>  Issue Type: Bug
>  Components: csharp
>Affects Versions: 1.7.4
>Reporter: Ramana Suvarapu
>Priority: Major
> Attachments: reader.avpr
>
>
> C# Union schema is unable to handle same type names with different 
> namespaces. It's throwing "SchemaParseExc

[jira] [Resolved] (AVRO-2193) Migrate to velocity 2.x

2018-12-05 Thread JIRA


 [ 
https://issues.apache.org/jira/browse/AVRO-2193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ismaël Mejía resolved AVRO-2193.

Resolution: Duplicate

> Migrate to velocity 2.x
> ---
>
> Key: AVRO-2193
> URL: https://issues.apache.org/jira/browse/AVRO-2193
> Project: Apache Avro
>  Issue Type: Improvement
>  Components: java
>Reporter: Peter Janssen
>Priority: Minor
>
> The latest 1.x release from velocity is from 2010. It contains some security 
> findings which should not be present in version 2.x (for example 
> [#VELOCITY-853]).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AVRO-2156) Allow custom namespace for C# generated code

2018-12-05 Thread Daniel Kulp (JIRA)


 [ 
https://issues.apache.org/jira/browse/AVRO-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Kulp updated AVRO-2156:
--
   Resolution: Fixed
 Assignee: Daniel Kulp
Fix Version/s: 1.9.0
   Status: Resolved  (was: Patch Available)

> Allow custom namespace for C# generated code
> 
>
> Key: AVRO-2156
> URL: https://issues.apache.org/jira/browse/AVRO-2156
> Project: Apache Avro
>  Issue Type: New Feature
>  Components: csharp
>Affects Versions: 1.8.2
>Reporter: Brian Lachniet
>Assignee: Daniel Kulp
>Priority: Major
> Fix For: 1.9.0
>
>
> The namespace used in Avro schemas/protocols does not always map nicely to a 
> standard C# namespace. Avrogen (the C# code generator) currently uses the 
> Avro namespace as the C# namespace. I propose that we update the avrogen 
> utility to allow the user to override the namespace used in the generated 
> code via a command line parameter.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AVRO-2155) Generate documentation for C# classes and enums

2018-12-05 Thread Daniel Kulp (JIRA)


 [ 
https://issues.apache.org/jira/browse/AVRO-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Kulp updated AVRO-2155:
--
   Resolution: Fixed
 Assignee: Daniel Kulp
Fix Version/s: 1.9.0
   Status: Resolved  (was: Patch Available)

> Generate documentation for C# classes and enums
> ---
>
> Key: AVRO-2155
> URL: https://issues.apache.org/jira/browse/AVRO-2155
> Project: Apache Avro
>  Issue Type: New Feature
>  Components: csharp
>Affects Versions: 1.8.2
>Reporter: Brian Lachniet
>Assignee: Daniel Kulp
>Priority: Minor
> Fix For: 1.9.0
>
>
> Update the C# "avrogen" code generation to populate documentation for code 
> entities (classes and enums) that are generated from named schemas (record, 
> enum and fixed). At this time, it only generates documentation for Avro 
> fields (C# fields and properties).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (AVRO-1363) C# UnionSchema fails to parse the the unions with same type names with different namespaces

2018-12-05 Thread Daniel Kulp (JIRA)


 [ 
https://issues.apache.org/jira/browse/AVRO-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Kulp resolved AVRO-1363.
---
   Resolution: Fixed
 Assignee: Daniel Kulp
Fix Version/s: 1.9.0

> C# UnionSchema fails to parse the the unions with same type names with 
> different namespaces
> ---
>
> Key: AVRO-1363
> URL: https://issues.apache.org/jira/browse/AVRO-1363
> Project: Apache Avro
>  Issue Type: Bug
>  Components: csharp
>Affects Versions: 1.7.4
>Reporter: Ramana Suvarapu
>Assignee: Daniel Kulp
>Priority: Major
> Fix For: 1.9.0
>
> Attachments: reader.avpr
>
>
> C# Union schema is unable to handle same type names with different 
> namespaces. It's throwing "SchemaParseException("Duplicate type in union: 
> "...) exception.
> In the below code, key of uniqueSchemas should be FullName of the type which 
> is similar to Java implementation. 
> internal static UnionSchema NewInstance(JArray jarr, PropertyMap props, 
> SchemaNames names, string encspace)
> {
> List schemas = new List();
> IDictionary uniqueSchemas = new 
> Dictionary();
> foreach (JToken jvalue in jarr)
> {
> Schema unionType = Schema.ParseJson(jvalue, names, encspace);
> if (null == unionType)
> throw new SchemaParseException("Invalid JSON in union" + 
> jvalue.ToString());
> string name = unionType.Name;
> if (uniqueSchemas.ContainsKey(name))
> throw new SchemaParseException("Duplicate type in union: 
> " + name);
> uniqueSchemas.Add(name, name);
> schemas.Add(unionType);
> }
> return new UnionSchema(schemas, props);
> }
> See the attachement to recreate the issue



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (AVRO-2162) Add Zstandard compression to avro file format

2018-12-05 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710363#comment-16710363
 ] 

ASF GitHub Bot commented on AVRO-2162:
--

iemejia commented on issue #303: AVRO-2162 Adds Zstandard compression to the 
Avro File Format (Java)
URL: https://github.com/apache/avro/pull/303#issuecomment-444567917
 
 
   Is there something considerable being missing to get this one merged? I 
think it would be great to have it for the 1.9.0 release. Backporting this 
looks like a lot of extra work, and can be done if someone really really 
needs/want to, otherwise we should encourage moving upwards.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Add Zstandard compression to avro file format
> -
>
> Key: AVRO-2162
> URL: https://issues.apache.org/jira/browse/AVRO-2162
> Project: Apache Avro
>  Issue Type: Improvement
>  Components: java
>Reporter: Scott Carey
>Priority: Major
>
> I'd like to add Zstandard compression for Avro. 
> At compression level 1 It is almost as fast as Snappy at compression, with 
> compression ratios more like gzip.  At higher levels of compression, it is 
> more compact than gzip -9 with much lower CPU when compressing and roughly 3x 
> faster decompression.
>  
> Adding it to Java is fairly easy.  We'll need to say something about it in 
> the spec however, as an 'optinal' codec.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Tagging PRs in github

2018-12-05 Thread Ismaël Mejía
Good idea Michael, it seems we can automate this via
https://github.com/probot/autolabeler
I created a ticket in INFRA, let's hope it can be easily setup.
https://issues.apache.org/jira/browse/INFRA-17367
I will keep you updated when ready.

On Tue, Dec 4, 2018 at 10:12 PM Driesprong, Fokko  wrote:
>
> Definitely, thanks a lot Ismaël!
>
> Op za 1 dec. 2018 om 00:21 schreef Michael A. Smith :
>
> > Thanks for doing that. It was very needed.
> >
> > Can we automate doing this somehow.
> >
> > On Thu, Nov 29, 2018 at 17:52 Ismaël Mejía  wrote:
> >
> > > Hello,
> > >
> > > I tagged all open PRs in github using the Label feature and the
> > > respective languages as part of the effort to get more reviews done.
> > > Hopefully people and committers can filter quickly their favorite
> > > language and this encourages them to help review.
> > >
> > > Sorry for taking this initiative without contacting dev@ first and for
> > > the additional email spam that some of you guys involved in the
> > > reviews probably received.
> > >
> > > I hope other committers agree with this idea so we can keep this
> > > tagging in the future (of course as well as the equivalent
> > > "Components"  tag in Jira too.
> > >
> > > Regards,
> > > Ismaël
> > >
> >


[jira] [Commented] (AVRO-2162) Add Zstandard compression to avro file format

2018-12-05 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/AVRO-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710433#comment-16710433
 ] 

ASF GitHub Bot commented on AVRO-2162:
--

nandorKollar commented on issue #303: AVRO-2162 Adds Zstandard compression to 
the Avro File Format (Java)
URL: https://github.com/apache/avro/pull/303#issuecomment-444584524
 
 
   I believe a Zstandard codec was already merged: 
https://github.com/apache/avro/commit/cf2f30336efe0ecc3debc7bede86fde6d23f7c79
   
   I think this is a duplicate.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Add Zstandard compression to avro file format
> -
>
> Key: AVRO-2162
> URL: https://issues.apache.org/jira/browse/AVRO-2162
> Project: Apache Avro
>  Issue Type: Improvement
>  Components: java
>Reporter: Scott Carey
>Priority: Major
>
> I'd like to add Zstandard compression for Avro. 
> At compression level 1 It is almost as fast as Snappy at compression, with 
> compression ratios more like gzip.  At higher levels of compression, it is 
> more compact than gzip -9 with much lower CPU when compressing and roughly 3x 
> faster decompression.
>  
> Adding it to Java is fairly easy.  We'll need to say something about it in 
> the spec however, as an 'optinal' codec.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)