Re: who is having problems installing?

[Ronirose Caryll De Castro]

I agree that a video tutorial on the setup of Metron is helpful. Is support
applicable on Metron?

*Thank you!*
*Caryll*


*Ronirose Caryll G. De Castro*
*Technical Security Group*
Email: ronirose.decas...@pointwest.com.ph
Website: www.pointwest.com.ph



9F Rockwell Business Ctr.Tower 3., Brgy. Ugong Ortigas Ave. Pasig City.

CONFIDENTIALITY NOTICE: This email may contain confidential and privileged
material for the sole use of the intended recipient(s). Any review, use,
distribution or disclosure by others is strictly prohibited. If you have
received this communication in error, please notify the sender immediately
by e-mail and delete the message and any file attachments from your
computer. There is no warranty that this email is error, virus or defect
free. If this is a private communication it does not represent the views of
Pointwest Technologies Corporation or their related entities.

On Sat, Oct 7, 2017 at 4:44 AM, zeo...@gmail.com  wrote:

> First would be to migrate docs from the wiki into the site-book so we have
> a more concise place to point people to regarding documentation, because
> there is some good stuff in the wiki, and some good things in the
> site-books, but attempts to link them together is currently broken all over
> the place (perfect example - this
> 
> is
> the architecture page on the wiki).  I am thinking about some more concise
> areas.  An example would cover things like "an intro to the environment"
> (Maybe an architecture sub-bullet?) and goes through Storm, Kafka, HDFS,
> etc. and covers "How its used" in a more succinct way.  Ignoring that, I
> was thinking about things like:
>
> https://cwiki.apache.org/confluence/display/METRON/Data+Loads
> https://cwiki.apache.org/confluence/display/METRON/UI
> https://cwiki.apache.org/confluence/display/METRON/Deployment+Scripts
>
> Like I said before, some of this is covered in one location
>  metron-alerts/index.html>,
> but not another ,
> which is extremely confusing.  If I found a place where documentation said
> it was coming soon, I wouldn't necessarily keep digging to find
> documentation for that item.
>
> Another thing I noticed via my recent perusal was that
> https://cwiki.apache.org/confluence/display/METRON/Streaming is not
> accurate.  Missing indexing, errors, etc.  I'm sure there are plenty more
> examples as well, and I don't think it's reasonable to point people to the
> wiki almost at all any longer (the squid walk-through is a good example of
> something still very valuable) because doing so is overly confusing/nuanced
> - we really need to get it migrated to the site-book.
>
> Jon
>
> On Fri, Oct 6, 2017 at 2:22 PM James Sirota  wrote:
>
> > Can you give an example?  My personal view is that our docs explain
> Metron
> > fundamentals pretty well.  If this is not the case, then would be willing
> > to take a look and see how we can make them more consumable.  The problem
> > with videos is that they become out of date very quickly and it's a lot
> of
> > effort to re-record them.
> >
> > Thanks,
> > James
> >
> > 06.10.2017, 11:05, "zeo...@gmail.com" :
> > > To generalize a bit, I think it would be helpful to have a single or
> > series
> > > of recordings, write-ups, or even just pointers to some good high-level
> > > docs to introduce people to each component used in Metron, and then a
> > > description of how it's used in the Metron environment. I know I spend
> a
> > > lot of time talking with people hitting the fundamentals, which is to
> be
> > > expected for a growing project like ours. That helps provide a super
> > > high-level context for what is happening in the cluster and where to
> look
> > > if you're seeing certain types of issues.
> > >
> > > Jon
> > >
> > > On Fri, Oct 6, 2017 at 1:56 PM James Sirota 
> wrote:
> > >
> > >>  Hi Guys,
> > >>
> > >>  How about a meeting at 11 AM PST on this? Can everyone who needs to
> > make
> > >>  the meeting? If you could come with a Hadoop cluster (including
> Kafka,
> > >>  storm, HDFS, Hbase) pre-installed I can walk you through the steps
> > required
> > >>  to install Metron. Does that seem reasonable?
> > >>
> > >>  Thanks,
> > >>  James
> > >>
> > >>  04.10.2017, 23:01, "Ronirose Caryll De Castro" <
> > >>  ronirose.decas...@pointwest.com.ph>:
> > >>  > That's wonderful and very generous of the team.
> > >>  >
> > >>  > Here's on my end:
> > >>  >
> > >>  > ​- What environment are you installing on (a single VM, multiple
> VMs,
> > >>  bare
> > >>  > metal, AWS, etc)
> > >>  > == Single VM, but I'm trying to install on multiple VMs
> > >>  > - What OS are you using
> > >>  > ​ ==​ Ubuntu Xenial and Zesty, but trying to use CentOS
> > >>  > - How many sensors are you going to be consuming
> > >> 

Re: Need suggestion on how to configure HCP Big Data for Development and Testing

[Ashikin Abdullah]

Alright thanks a lot for the links. :-)

On Sat, Oct 7, 2017 at 2:12 AM, James Sirota  wrote:

> As I mentioned in my previous response, https://community.hortonworks.
> com/topics/Metron.html
> is where you want to go for help with Hortonworks products
>
> 06.10.2017, 05:34, "Dima Kovalyov" :
> > Hello Ashikin,
> >
> > HCP is Hortonworks product and they have installation document here:
> > https://docs.hortonworks.com/HDPDocuments/HCP1/HCP-1.2.0/
> bk_installation/content/getting_started.html
> > Chapter that you are looking for is below:
> > https://docs.hortonworks.com/HDPDocuments/HCP1/HCP-1.3.0/
> bk_installation/content/installing_configuring_deploying_hdp_cluster.html
> >
> > Dell specific wording: Dell PowerEdge VRTX, M630 and HDD 6006 does not
> > tell me much about hardware you have. But if I have two guess, I would
> > suggest to have:
> > 1 node for Ambari and hdfs, hbase, zookeeper, metrics, zeppelin, spark,
> > hive, tez and yarn masters.
> > 1 node for Metron and storm, kafka, metron, es, kibana
> > 2 nodes + 1 node (ambari one) for all the slaves and masters that
> > require replication (hdfs datanode, zookeeper, kafka broker, es slaves).
> >
> > I have not tried HCP myself, but if I would, I would rather post all my
> > HCP related questions to HortonWorks forums
> > (https://community.hortonworks.com/index.html, they have really good
> > support there) rather then to Apache Metron devs as they are not related
> > (HortonWorks uses Apache Metron (open-source software) in their HDP
> > framework).
> >
> > - Dima
> >
> > On 10/05/2017 04:59 PM, Ashikin Abdullah wrote:
> >>  Hi, can anyone help me to suggest appropriate deployment for
> Hortonworks
> >>  Cybersecurity Package within this environment. We have Dell PowerEdge
> VRTX
> >>  with 4 nodes, M630 x 4 and HDD 6006 x 25 (shared storage).
> >>
> >>  Therefore, how to manage all this resources to properly configured HCP?
> >>
> >>  Thanks in advance.
>
> ---
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>

Re: Metron 0.4.2 release date

[Ali Nazemian]

Hi Jon,

For the Elasticsearch, I am looking for the support from the client side
rather than a full Metron mpack that includes ES 5.x. As long as Metron
Alert-UI and indexing can support ES 5, I am fine. Is that the scope of
Metron-939?

Cheers,
Ali

On Mon, Oct 9, 2017 at 11:04 AM, zeo...@gmail.com  wrote:

> As of right now I'm not aware of any discussions regarding a next release,
> and I believe the METRON-777 features are at least a few months out from
> being reviewed and merged in (There is a fair amount of work in chunking it
> up to be reviewed, then work to review and merge it in).  ES 5.x is also in
> progress but not even open as a PR yet, let alone in master and ready to be
> included in a release.  I'm really looking forward to those
> changes/improvements as well, but I wouldn't be expecting them in the next
> few months, and trying to look further into the future than that at this
> point would be difficult.
>
> That said, if anybody else has a more detailed timeline in mind, I would
> love to hear more.
>
> Jon
>
> On Sun, Oct 8, 2017, 09:05 Ali Nazemian  wrote:
>
> > Hi all,
> >
> > I was wondering when Metron 0.4.2 will be released and whether it
> includes
> > Metron-777 and Elasticsearch 5.x or not?
> >
> > Cheers,
> > Ali
> >
> --
>
> Jon
>



-- 
A.Nazemian

Re: Metron 0.4.2 release date

[zeo...@gmail.com]

As of right now I'm not aware of any discussions regarding a next release,
and I believe the METRON-777 features are at least a few months out from
being reviewed and merged in (There is a fair amount of work in chunking it
up to be reviewed, then work to review and merge it in).  ES 5.x is also in
progress but not even open as a PR yet, let alone in master and ready to be
included in a release.  I'm really looking forward to those
changes/improvements as well, but I wouldn't be expecting them in the next
few months, and trying to look further into the future than that at this
point would be difficult.

That said, if anybody else has a more detailed timeline in mind, I would
love to hear more.

Jon

On Sun, Oct 8, 2017, 09:05 Ali Nazemian  wrote:

> Hi all,
>
> I was wondering when Metron 0.4.2 will be released and whether it includes
> Metron-777 and Elasticsearch 5.x or not?
>
> Cheers,
> Ali
>
-- 

Jon

[GitHub] metron issue #774: METRON-1212 The bundle system and maven plugin

[ottobackwards]

Github user ottobackwards commented on the issue:

https://github.com/apache/metron/pull/774
  
# Testing the bundle plugin

I have created a sample project that can be examined for testing the plugin:

[test-bundles-plugin](https://github.com/ottobackwards/test-bundles-plugin)




---

[GitHub] metron issue #774: METRON-1212 The bundle system and maven plugin

[ottobackwards]

Github user ottobackwards commented on the issue:

https://github.com/apache/metron/pull/774
  
yes you can


---

[GitHub] metron issue #774: METRON-1212 The bundle system and maven plugin

[nickwallen]

Github user nickwallen commented on the issue:

https://github.com/apache/metron/pull/774
  
> This review is code review and test code review and running only

I have just started into this, but seems like I can create a bundle using 
the Maven plugin with this PR, right?


---

[GitHub] metron issue #774: METRON-1212 The bundle system and maven plugin

[ottobackwards]

Github user ottobackwards commented on the issue:

https://github.com/apache/metron/pull/774
  
From a quick check of other PR travis failures, it looks like my build was 
the only one to have that problem ( which as an expected 1000 got 908 issue )


---

[GitHub] metron issue #774: METRON-1212 The bundle system and maven plugin

[ottobackwards]

Github user ottobackwards commented on the issue:

https://github.com/apache/metron/pull/774
  
On that day the Flat File test failed.  Since it worked after open/close I 
wrote it off to a load / timing issue.  

https://travis-ci.org/apache/metron/builds/280393026




---

[GitHub] metron issue #774: METRON-1212 The bundle system and maven plugin

[nickwallen]

Github user nickwallen commented on the issue:

https://github.com/apache/metron/pull/774
  
@ottobackwards Are we have intermittent test failures again?


---

Metron 0.4.2 release date

[Ali Nazemian]

Hi all,

I was wondering when Metron 0.4.2 will be released and whether it includes
Metron-777 and Elasticsearch 5.x or not?

Cheers,
Ali