[jira] [Commented] (MESOS-8248) Expose information about GPU assigned to a task

[ https://issues.apache.org/jira/browse/MESOS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798214#comment-16798214 ] Jorge Machado commented on MESOS-8248: -- [~klueska] I saw you userid in the comments for the gpu

[jira] [Commented] (MESOS-8248) Expose information about GPU assigned to a task

[ https://issues.apache.org/jira/browse/MESOS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798012#comment-16798012 ] Jorge Machado commented on MESOS-8248: -- [~bmahler] so we have a use case that one mesos tasks

[jira] [Commented] (MESOS-8248) Expose information about GPU assigned to a task

[ https://issues.apache.org/jira/browse/MESOS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797966#comment-16797966 ] Jorge Machado commented on MESOS-8248: -- will this work  with docker as containerizer type

[jira] [Commented] (MESOS-5255) Add GPUs to container resource consumption metrics.

[ https://issues.apache.org/jira/browse/MESOS-5255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797965#comment-16797965 ] Jorge Machado commented on MESOS-5255: -- will this work  with docker as containerizer type?  >

[jira] [Commented] (SPARK-27208) RestSubmissionClient only supports http

[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796871#comment-16796871 ] Jorge Machado commented on SPARK-27208: --- Furthermore I'm getting the next error:  ./bin/spark

[jira] [Commented] (SPARK-27208) RestSubmissionClient only supports http

[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796860#comment-16796860 ] Jorge Machado commented on SPARK-27208: --- I would like to take this. > RestSubmissionClient o

[jira] [Updated] (SPARK-27208) RestSubmissionClient only supports http

[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-27208: -- Shepherd: Sean Owen > RestSubmissionClient only supports h

[jira] [Created] (SPARK-27208) RestSubmissionClient only supports http

Jorge Machado created SPARK-27208: - Summary: RestSubmissionClient only supports http Key: SPARK-27208 URL: https://issues.apache.org/jira/browse/SPARK-27208 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-27208) RestSubmissionClient only supports http

[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796544#comment-16796544 ] Jorge Machado commented on SPARK-27208: --- relates to this as the follow up error

Expecting 'type' to be present

Hi everyone, does anyone know what does it mean the error: Expecting 'type' to be present when using spark on mesos ? ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master mesos://host:5050/api --deploy-mode cluster --conf spark.master.rest.enabled=true

Spark on Mesos broken on 2.4 ?

Hello Everyone, I’m just trying out the spark-shell on mesos and I don’t get any executors. To debug it I started the vagrant box from aurora and try it out there and I can the same issue as I’m getting on my cluster. On Mesos the only active framework is the spark-shel, it is running 1.6.1

[jira] [Commented] (SPARK-26324) Spark submit does not work with messos over ssl [Missing docs]

[ https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723761#comment-16723761 ] Jorge Machado commented on SPARK-26324: --- [~hyukjin.kwon] I created a PR for this docs > Sp

Re: My new Accumulo 2 install can't find hdfs

Check your configs, I would say you did not specify in the accumulo site .xml the correct hadoop location like hdfs:///hadoop... Jorge Machado jo...@jmachado.me > Am 13.12.2018 um 17:13 schrieb Mike Walch : > > Hi Jeffrey, > > It's strange that you were able to get the

[jira] [Updated] (SPARK-26324) Spark submit does not work with messos over ssl [Missing docs]

[ https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-26324: -- Summary: Spark submit does not work with messos over ssl [Missing docs] (was: Spark submit

[jira] [Updated] (SPARK-26324) Spark submit does not work with messos over ssl [Missing docs]

[ https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-26324: -- Description: Hi guys,  I was trying to run the examples on a mesos cluster that uses https

[jira] [Updated] (SPARK-26324) Spark submit does not work with messos over ssl

[ https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-26324: -- Description: Hi guys,  I was trying to run the examples on a mesos cluster that uses https

[jira] [Updated] (SPARK-26324) Spark submit does not work with messos over ssl

[ https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-26324: -- Description: Hi guys,  I was trying to run the examples on a mesos cluster that uses https

[jira] [Created] (SPARK-26324) Spark submit does not work with messos over ssl

Jorge Machado created SPARK-26324: - Summary: Spark submit does not work with messos over ssl Key: SPARK-26324 URL: https://issues.apache.org/jira/browse/SPARK-26324 Project: Spark Issue Type

[jira] [Commented] (SPARK-19320) Allow guaranteed amount of GPU to be used when launching jobs

[ https://issues.apache.org/jira/browse/SPARK-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714697#comment-16714697 ] Jorge Machado commented on SPARK-19320: --- Is this still active ?  The question arises what about

Upgrade of Rya to RDF4j

Hi guys, I saw on https://github.com/apache/incubator-rya/pull/291that we migrated from OpenRDF Sesame 2.7.6 to RDF4J 2.3.1 but I don’t see a release for it. Any tipps how should I do it ? Regards Jorge Machado www.jmachado.me

[jira] [Commented] (SPARK-20055) Documentation for CSV datasets in SQL programming guide

[ https://issues.apache.org/jira/browse/SPARK-20055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659253#comment-16659253 ] Jorge Machado commented on SPARK-20055: --- This was taken on another ticket. This Can be closed

[jira] [Commented] (ZOOKEEPER-1029) C client bug in zookeeper_init (if bad hostname is given)

[ https://issues.apache.org/jira/browse/ZOOKEEPER-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642943#comment-16642943 ] Jorge Machado commented on ZOOKEEPER-1029: -- Hi [~cnauroth] I think there is a bug here

[jira] [Commented] (MESOS-9299) Mesos Agent does not start if Zookeeper host does not exist

[ https://issues.apache.org/jira/browse/MESOS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642856#comment-16642856 ] Jorge Machado commented on MESOS-9299: -- Well the title matches, but you are right I have look

[jira] [Comment Edited] (MESOS-9299) Mesos Agent does not start if Zookeeper host does not exist

[ https://issues.apache.org/jira/browse/MESOS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642832#comment-16642832 ] Jorge Machado edited comment on MESOS-9299 at 10/9/18 5:51 AM: --- Should we

[jira] [Issue Comment Deleted] (MESOS-2186) Mesos crashes if any configured zookeeper does not resolve.

[ https://issues.apache.org/jira/browse/MESOS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated MESOS-2186: - Comment: was deleted (was: Hi [~neilc],  I think this needs to be re-opened. I have

[jira] [Commented] (MESOS-9299) Mesos Agent does not start if Zookeeper host does not exist

[ https://issues.apache.org/jira/browse/MESOS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642832#comment-16642832 ] Jorge Machado commented on MESOS-9299: -- Should we build a workaround it ? > Mesos Agent d

[jira] [Commented] (MESOS-9299) Mesos Agent does not start if Zookeeper host does not exist

[ https://issues.apache.org/jira/browse/MESOS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641715#comment-16641715 ] Jorge Machado commented on MESOS-9299: -- [~bmahler] Any tipp ? > Mesos Agent does not st

[jira] [Created] (MESOS-9299) Mesos Agent does not start if Zookeeper host does not exist

Jorge Machado created MESOS-9299: Summary: Mesos Agent does not start if Zookeeper host does not exist Key: MESOS-9299 URL: https://issues.apache.org/jira/browse/MESOS-9299 Project: Mesos

[jira] [Comment Edited] (MESOS-2186) Mesos crashes if any configured zookeeper does not resolve.

[ https://issues.apache.org/jira/browse/MESOS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641468#comment-16641468 ] Jorge Machado edited comment on MESOS-2186 at 10/8/18 7:37 AM: --- Hi [~neilc

[jira] [Commented] (MESOS-2186) Mesos crashes if any configured zookeeper does not resolve.

[ https://issues.apache.org/jira/browse/MESOS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641468#comment-16641468 ] Jorge Machado commented on MESOS-2186: -- Hi Guys,  I think this needs to be re-opened. I have

[jira] [Created] (AURORA-1996) NullPointerException when starting aurora 0.23

Jorge Machado created AURORA-1996: - Summary: NullPointerException when starting aurora 0.23 Key: AURORA-1996 URL: https://issues.apache.org/jira/browse/AURORA-1996 Project: Aurora Issue Type

[jira] [Commented] (MESOS-3484) Master failed to shutdown: failed on fd: Transport endpoint is not connected.

[ https://issues.apache.org/jira/browse/MESOS-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631399#comment-16631399 ] Jorge Machado commented on MESOS-3484: -- [~neilc] I have a very similar issue when starting apache

Re: [ANNOUNCE] New Apache NiFi Committer Sivaprasanna Sethuraman

Congrats ! Jorge > On 6 Jun 2018, at 18:44, Otto Fowler wrote: > > Congratulations! > > > On June 5, 2018 at 10:09:28, Tony Kurc (tk...@apache.org) wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Sivaprasanna has accepted the PMC's invitation to become

Re: KerberosProperties.validatePrincipalAndKeytab Error ?

Ok that makes sinn. It was really confusing because all other processors when they say Supports language expression it works on the incoming flow files. Thanks for the heads up. Jorge Machado > On 4 Jun 2018, at 14:34, Mark Payne wrote: > > Jorge, > > These properties do sup

Re: KerberosProperties.validatePrincipalAndKeytab Error ?

Sivaprasanna, Yes I have that property set, the Unit test is failing IMHO it should not. Jorge Machado Best Regards > On 4 Jun 2018, at 12:09, Sivaprasanna wrote: > > Jorge, > > Both 'Kerberos Principal' abd 'Kerberos Keytab' support NiFi expression > language so ${princ

Re: [Spark SQL] error in performing dataset union with complex data type (struct, list)

Have you tryed to narrow down the problem so that we can be 100% sure that it lies on the array types ? Just exclude them for sake of testing. If we know 100% that it is on this array stuff try to explode that columns into simple types. Jorge Machado > On 4 Jun 2018, at 11:09, Pra

Re: [Spark SQL] error in performing dataset union with complex data type (struct, list)

Try the same union with a dataframe without the arrays types. Could be something strange there like ordering or so. Jorge Machado > On 4 Jun 2018, at 10:17, Pranav Agrawal wrote: > > schema is exactly the same, not sure why it is failing though. > > root > |-- b

Re: Disable all Remote Processors

missing something? > > Pierre > > 2018-05-15 9:23 GMT+02:00 Jorge Machado : > >> hi all, >> >> it should be possible to disable all remote processors groups inside a >> Processor group right ? >> should we start with a PR for the API ? >> >> Jorge Machado >> >> >> >> >> >> >>

[jira] [Updated] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-24401: -- Attachment: (was: testDF.parquet) > Aggreate on Decimal Types does not w

[jira] [Resolved] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado resolved SPARK-24401. --- Resolution: Fixed Was already Fixed on 2.3.0 > Aggreate on Decimal Types does not w

[jira] [Updated] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-24401: -- Affects Version/s: (was: 2.3.0) Fix Version/s: 2.3.0 > Aggreate on Decimal Ty

[jira] [Commented] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493118#comment-16493118 ] Jorge Machado commented on SPARK-24401: --- Yes, I just tried my code and it works on spark 2.3.0

[jira] [Updated] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-24401: -- Description: Hi,  I think I found a really ugly bug in spark when performing aggregations

[jira] [Updated] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-24401: -- Description: Hi,  I think I found a really ugly bug in spark when performing aggregations

[jira] [Updated] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-24401: -- Description: Hi,  I think I found a really ugly bug in spark when performing aggregations

[jira] [Updated] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-24401: -- Description: Hi,  I think I found a really ugly bug in spark when performing aggregations

[jira] [Updated] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-24401: -- Attachment: testDF.parquet > Aggreate on Decimal Types does not w

[jira] [Updated] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-24401: -- Attachment: (was: testDF.parquet) > Aggreate on Decimal Types does not w

[jira] [Commented] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492326#comment-16492326 ] Jorge Machado commented on SPARK-24401: --- Probably is worth to mention that my dataset is coming

[jira] [Created] (SPARK-24401) Aggreate on Decimal Types does not work

Jorge Machado created SPARK-24401: - Summary: Aggreate on Decimal Types does not work Key: SPARK-24401 URL: https://issues.apache.org/jira/browse/SPARK-24401 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-24401: -- Attachment: testDF.parquet > Aggreate on Decimal Types does not w

[jira] [Issue Comment Deleted] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-17592: -- Comment: was deleted (was: I'm hitting the same issue I'm afraid but in slightly another way

[jira] [Comment Edited] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489185#comment-16489185 ] Jorge Machado edited comment on SPARK-17592 at 5/24/18 3:11 PM: I'm

[jira] [Updated] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated SPARK-17592: -- Attachment: image-2018-05-24-17-10-24-515.png > SQL: CAST string as INT inconsistent with H

[jira] [Commented] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489185#comment-16489185 ] Jorge Machado commented on SPARK-17592: --- I'm hitting the same issue I'm afraid but in slightly

Disable all Remote Processors

hi all, it should be possible to disable all remote processors groups inside a Processor group right ? should we start with a PR for the API ? Jorge Machado

[jira] [Resolved] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

[ https://issues.apache.org/jira/browse/NIFI-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado resolved NIFI-5119. - Resolution: Won't Fix not a bug > Pulling changes from Registry does not respect sensit

[jira] [Commented] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

[ https://issues.apache.org/jira/browse/NIFI-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452886#comment-16452886 ] Jorge Machado commented on NIFI-5119: - [~markap14] So that was really the issue. I was testing

[jira] [Comment Edited] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

[ https://issues.apache.org/jira/browse/NIFI-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452347#comment-16452347 ] Jorge Machado edited comment on NIFI-5119 at 4/25/18 2:36 PM: -- We are using

[jira] [Commented] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

[ https://issues.apache.org/jira/browse/NIFI-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452347#comment-16452347 ] Jorge Machado commented on NIFI-5119: - We are using Kerberos and we have 3 nodes on each of the Nifi

[jira] [Comment Edited] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

[ https://issues.apache.org/jira/browse/NIFI-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452248#comment-16452248 ] Jorge Machado edited comment on NIFI-5119 at 4/25/18 1:29 PM: -- Yes, and when

[jira] [Commented] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

[ https://issues.apache.org/jira/browse/NIFI-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452248#comment-16452248 ] Jorge Machado commented on NIFI-5119: - Yes. and when you pull from B if there is sensitive values set

[jira] [Commented] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

[ https://issues.apache.org/jira/browse/NIFI-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452227#comment-16452227 ] Jorge Machado commented on NIFI-5119: - If you follow the 5 steps that I described on the Ticket you

[jira] [Commented] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

[ https://issues.apache.org/jira/browse/NIFI-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452190#comment-16452190 ] Jorge Machado commented on NIFI-5119: - Hi [~joewitt], yes I know we are not there yet. I think we

[jira] [Commented] (NIFI-5028) CLI - Add a command to list sensitive properties to set

[ https://issues.apache.org/jira/browse/NIFI-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452163#comment-16452163 ] Jorge Machado commented on NIFI-5028: - [~joewitt] I Have a fix for it, but no Unit test yet. Yes let's

[jira] [Created] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

Jorge Machado created NIFI-5119: --- Summary: Pulling changes from Registry does not respect sensitive Informations on Destination Key: NIFI-5119 URL: https://issues.apache.org/jira/browse/NIFI-5119

[jira] [Updated] (NIFI-5119) Pulling changes from Registry does not respect sensitive Informations on Destination

[ https://issues.apache.org/jira/browse/NIFI-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Machado updated NIFI-5119: Issue Type: Bug (was: Improvement) > Pulling changes from Registry does not respect sensit

[jira] [Commented] (NIFI-5028) CLI - Add a command to list sensitive properties to set

[ https://issues.apache.org/jira/browse/NIFI-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451978#comment-16451978 ] Jorge Machado commented on NIFI-5028: - Actually it would be nice that we could detect if a sensitive

Pushing flows to Registry with Sensitive Information

Hi Guys, so I was playing with the registry and If I pushed a Processor that has sensitive information like a password it will be discarded when pulling it from the Registry, which is fine. Now comes the but. But if I put a variable there IMHO I think it should save it on the registry. What

Nifi UI improvement

Hi guys, Is there any effort to improve the UI ? One nice feature to have would be: Have the possibility to limit searches on a canvas. Let’s say we are inside a processor group and we only want to search from there on. Regards Jorge Machado

Re: Failed build from master

Machado > On 11 Apr 2018, at 11:16, Jorge Machado <jom...@me.com> wrote: > > Hi Jeff again, > > so the build has finished but from the docs it should exist a > rya.mapreduce-*-SNAPSHOT-shaded.jar which I cannot found. > Any Tipps ? > > > Jorge M

Re: Failed build from master

DE depends on. The command > "mvn clean install -Drat.skip" is the more lightweight workaround. > > -Jeff > > On Tue, Apr 10, 2018 at 10:05 AM, Jorge Machado <jom...@me.com> wrote: > >> Hi Guys, >> >> I was trying to compile Rya from master

Re: NiFi 1.6

Voting is taking now place from RC3. Probably in the next two weeks. Jorge > On 5 Apr 2018, at 22:46, dan young wrote: > > any updates on when 1.6 is going to drop? > > dano >

Re: FlattenJson

to Flowfile. Would be the Changed accepted ? I would create a PR for it. Jorge Machado > On 20 Mar 2018, at 22:35, Otto Fowler <ottobackwa...@gmail.com> wrote: > > We could start with routeOnJsonPath and do the record path as the need > arises? > > > On March

Re: Spark and Accumulo Delegation tokens

Thanks ! Should we contribute something like that ? Jorge Machado jo...@jmachado.me > Am 23.03.2018 um 12:24 schrieb Saisai Shao <sai.sai.s...@gmail.com>: > > It is in yarn module. > "org.apache.spark.deploy.yarn.security.ServiceCredentialProvider". > >

Re: Spark and Accumulo Delegation tokens

.toMap } If you could give me a tipp there would be great. Thanks Jorge Machado > On 23 Mar 2018, at 07:38, Saisai Shao <sai.sai.s...@gmail.com> wrote: > > I think you can build your own Accumulo credential provider as similar to > HadoopDelegationTokenProvider out of Spark

Spark and Accumulo Delegation tokens

of HadoopDelegationTokenProvider for Accumulo be accepted ? Jorge Machado

Re: Spark and Accumulo Delegation tokens

.toMap } If you could give me a tipp there would be great. Thanks Jorge Machado > On 23 Mar 2018, at 07:38, Saisai Shao <sai.sai.s...@gmail.com> wrote: > > I think you can build your own Accumulo credential provider as similar to > HadoopDelegationTokenProvider out of Spark

Spark and Accumulo Delegation tokens

of HadoopDelegationTokenProvider for Accumulo be accepted ? Jorge Machado

Re: Is there a mutable dataframe spark structured streaming 2.3.0?

DataFrames are not mutable. Jorge Machado > On 22 Mar 2018, at 10:07, Aakash Basu <aakash.spark@gmail.com> wrote: > > Hey, > > I faced the same issue a couple of days back, kindly go through the mail > chain with "Multiple Kafka Spark Streaming Dataframe

Re: Stackoverflow question: Moving data from one RDB to another through NiFi

That would be probably the fastest way. Jorge Machado www.jmachado.me > On 22 Mar 2018, at 08:38, Brett Ryan <brett.r...@gmail.com> wrote: > > Hmmm, now I’m doubting myself. It’s possible we sqoop to hdfs then sqoop > out, will have to look, sorry if I am wrong. >

Re: Spark Druid Ingestion

Seems to me permissions problems ! Can you check your user / folder permissions ? Jorge Machado > On 22 Mar 2018, at 08:21, nayan sharma <nayansharm...@gmail.com> wrote: > > Hi All, > As druid uses Hadoop MapReduce to ingest batch data but I am trying spark for

Re: Stackoverflow question: Moving data from one RDB to another through NiFi

you copy the files into the server and on the server then use some import bulk….. Jorge Machado > On 22 Mar 2018, at 08:13, Brett Ryan <brett.r...@gmail.com> wrote: > > Could Sqoop [1] be an option? > > [1]: http://sqoop.apache.org/ > >> On 22 Ma

HadoopDelegationTokenProvider

Hey spark group, I want to create a Delegation Token Provider for Accumulo I have One Question: How can I get the token that I added to the credentials from the Executor side ? the SecurityManager class is private… Thanks Jorge Machado

Re: FlattenJson

So that is what we actually are doing EvaluateJsonPath the problem with that is, that is hard to build something generic if we need to specify each property by his name, that’s why this idea. Should I make a PR for this or is this to business specific ? Jorge Machado > On 20 Mar 2

Re: FlattenJson

From there on we use a lot of routeOnAttritutes and use that values on sql queries to other tables like select * from someTable where id=${myExtractedAttribute} To be honest I tryed JoltTransformJSON but I could not get it working :) Jorge Machado > On 20 Mar 2018, at 15:12, Matt Burg

Re: FlattenJson

;){ attrs[k] = v.toString() } } } as InputStreamCallback) flowFile = session.putAllAttributes(flowFile, attrs) session.transfer(flowFile, REL_SUCCESS) some code removed Jorge Machado > On 20 Mar 2018, at 15:03, Bryan Bende <bbe...@gmail.com> wrote: > > Ok it is still

Re: FlattenJson

to use this standard processor and instead of writing this to a flow content write it to attributes. Jorge Machado > On 20 Mar 2018, at 14:47, Bryan Bende <bbe...@gmail.com> wrote: > > What would be the main use case for wanting all the flattened values > in attributes?

Re: FlattenJson

Hi Pierre, I’m aware of that. So This means the change would not be accepted correct ? Regards Jorge Machado > On 20 Mar 2018, at 09:54, Pierre Villard <pierre.villard...@gmail.com> wrote: > > Hi Jorge, > > I think this should be carefully docum

FlattenJson

Hey guys, I would like to change the FlattenJson Procerssor to be possible to Flatten to the attributes instead of Only to content. Is this a good Idea ? would the PR be accepted ? Cheers Jorge Machado

Re: How to know the processors last running time?

her option other than logAttribute? > > On Mon, Mar 19, 2018 at 3:50 PM, Jorge Machado <jom...@me.com > <mailto:jom...@me.com>> wrote: > you could end your flow with a logAttribute Processor for example. Would that > resolve your issues ? > > Jorge Machado > >

Re: How to know the processors last running time?

you could end your flow with a logAttribute Processor for example. Would that resolve your issues ? Jorge Machado > On 19 Mar 2018, at 07:57, prabhu Mahendran <prabhuu161...@gmail.com> wrote: > > i'm having group of processors to perform some functionalities. >

Next Release

Hi Guys, When is a new Release planed ? Is there any page where we can see a roadmap ? Thanks Jorge Machado

Re: InvokeHttp -- StandardSSLContextService Validator Exception

Any trace for us ? Working Example: Jorge Machado > On 13 Mar 2018, at 13:11, Jones, Patrick L. <p...@mitre.org> wrote: > > Howdy, > > I’m using a StandardSSLContextService with InvokeHttp and I get a > ValidatorException ‘unable to find valid certification pat

Re: Multiple versions of .... exist.

Yes, I opened a PR: https://github.com/apache/nifi/pull/2531/files <https://github.com/apache/nifi/pull/2531/files> Jorge Machado > On 12 Mar 2018, at 09:46, Ed B <bdes...@gmail.com> wrote: > > Looks like a bug. The code should be: > > dto.set

[jira] [Created] (NIFI-4960) Multiple Custom Processors don't work as espected.

Jorge Machado created NIFI-4960: --- Summary: Multiple Custom Processors don't work as espected. Key: NIFI-4960 URL: https://issues.apache.org/jira/browse/NIFI-4960 Project: Apache NiFi Issue

Re: Multiple versions of .... exist.

After some time of debugging I found this here: How is this possible ??? Group is still null after being set.. the same happens for version. Jorge Machado > On 12 Mar 2018, at 08:46, Jorge Machado <jom...@me.com> wrote: > > Hello everyone, > > I we setting up the

Multiple versions of .... exist.

Hello everyone, I we setting up the Nifi registry are we are getting this error when trying to import a flow from Registry into Nifi: Multiple versions of …. exist. No exact match for default:...:unversioned. To note that we have multiple versions of the same processor in the lib folder

[jira] [Commented] (NIFI-3380) Multiple Versions of the Same Component

[ https://issues.apache.org/jira/browse/NIFI-3380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383776#comment-16383776 ] Jorge Machado commented on NIFI-3380: - I guys, I saw this and I have multiple version of the same

Re: HBase connector does not read ZK configuration from Spark session

Can it be that you are missing the HBASE_HOME var ? Jorge Machado > On 23 Feb 2018, at 04:55, Dharmin Siddesh J <siddeshjdhar...@gmail.com> wrote: > > I am trying to write a Spark program that reads data from HBase and store it > in DataFrame. > > I am

<    1   2   3   4   >