RE: fixing/checking corrupted metadata?

2016-02-02 Thread Sean Broeder 
You might want to try sqlci initialize trafodion, drop; initialize
trafodion;







*From:* Eric Owhadi [mailto:eric.owh...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 2:36 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* fixing/checking corrupted metadata?



I have been playing on my dev environment with this DDL:

create table Customer

(

c_customer_sk   int not null,

c_customer_id   char(16) CHARACTER SET UTF8 not null,

c_current_cdemo_sk  int,

c_current_hdemo_sk  int,

c_current_addr_sk   int,

c_first_shipto_date_sk  int,

c_first_sales_date_sk   int,

c_salutationchar(10) CHARACTER SET UTF8,

c_first_namechar(20) CHARACTER SET UTF8,

c_last_name char(30) CHARACTER SET UTF8,

c_preferred_cust_flag   char(1),

c_birth_day integer,

c_birth_month   integer,

c_birth_yearinteger,

c_birth_country varchar(20) CHARACTER SET UTF8,

c_login char(13) CHARACTER SET UTF8,

c_email_address char(50) CHARACTER SET UTF8,

c_last_review_date_sk   int,

primary key (c_customer_sk)

)SALT USING 2 PARTITIONS

  HBASE_OPTIONS

  (

DATA_BLOCK_ENCODING = 'FAST_DIFF',

   COMPRESSION = 'SNAPPY'

  );



After a long time and supposedly 35 retries, it complained about the lack
of SNAPPY compression support in local_hadoop.



That’s fine, so I decided to retry with:

create table Customer

(

c_customer_sk   int not null,

c_customer_id   char(16) CHARACTER SET UTF8 not null,

c_current_cdemo_sk  int,

c_current_hdemo_sk  int,

c_current_addr_sk   int,

c_first_shipto_date_sk  int,

c_first_sales_date_sk   int,

c_salutationchar(10) CHARACTER SET UTF8,

c_first_namechar(20) CHARACTER SET UTF8,

c_last_name char(30) CHARACTER SET UTF8,

c_preferred_cust_flag   char(1),

c_birth_day integer,

c_birth_month   integer,

c_birth_yearinteger,

c_birth_country varchar(20) CHARACTER SET UTF8,

c_login char(13) CHARACTER SET UTF8,

c_email_address char(50) CHARACTER SET UTF8,

c_last_review_date_sk   int,

primary key (c_customer_sk)

)SALT USING 2 PARTITIONS

  HBASE_OPTIONS

  (

DATA_BLOCK_ENCODING = 'FAST_DIFF'

-- not available in local_hadoop   COMPRESSION = 'SNAPPY'

  );



And this time it takes forever and never complete (waited 20 minute, then
killed it).



I am assuming that the second attempt might be the consequence of the first
failure that must have left things half done.



I know that I can do a full uninstall/re-install local Hadoop, but I was
wondering if there is a metadata clean up utility that I could try before
applying the bazooka?



Thanks in advance for the help,
Eric

RE: fixing/checking corrupted metadata?

2016-02-02 Thread Sean Broeder 
Right.  I mentioned this only because reinstalling local_hadoop was
mentioned.  Reinitializing Trafodion would be quicker, but just as fatal
for existing data.



*From:* Dave Birdsall [mailto:dave.birds...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 2:43 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* RE: fixing/checking corrupted metadata?



Only do that if you’re willing to get rid of your entire database.



*From:* Sean Broeder [mailto:sean.broe...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 2:41 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* RE: fixing/checking corrupted metadata?



You might want to try sqlci initialize trafodion, drop; initialize
trafodion;







*From:* Eric Owhadi [mailto:eric.owh...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 2:36 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* fixing/checking corrupted metadata?



I have been playing on my dev environment with this DDL:

create table Customer

(

c_customer_sk   int not null,

c_customer_id   char(16) CHARACTER SET UTF8 not null,

c_current_cdemo_sk  int,

c_current_hdemo_sk  int,

c_current_addr_sk   int,

c_first_shipto_date_sk  int,

c_first_sales_date_sk   int,

c_salutationchar(10) CHARACTER SET UTF8,

c_first_namechar(20) CHARACTER SET UTF8,

c_last_name char(30) CHARACTER SET UTF8,

c_preferred_cust_flag   char(1),

c_birth_day integer,

c_birth_month   integer,

c_birth_yearinteger,

c_birth_country varchar(20) CHARACTER SET UTF8,

c_login char(13) CHARACTER SET UTF8,

c_email_address char(50) CHARACTER SET UTF8,

c_last_review_date_sk   int,

primary key (c_customer_sk)

)SALT USING 2 PARTITIONS

  HBASE_OPTIONS

  (

DATA_BLOCK_ENCODING = 'FAST_DIFF',

   COMPRESSION = 'SNAPPY'

  );



After a long time and supposedly 35 retries, it complained about the lack
of SNAPPY compression support in local_hadoop.



That’s fine, so I decided to retry with:

create table Customer

(

c_customer_sk   int not null,

c_customer_id   char(16) CHARACTER SET UTF8 not null,

c_current_cdemo_sk  int,

c_current_hdemo_sk  int,

c_current_addr_sk   int,

c_first_shipto_date_sk  int,

c_first_sales_date_sk   int,

c_salutationchar(10) CHARACTER SET UTF8,

c_first_namechar(20) CHARACTER SET UTF8,

c_last_name char(30) CHARACTER SET UTF8,

c_preferred_cust_flag   char(1),

c_birth_day integer,

c_birth_month   integer,

c_birth_yearinteger,

c_birth_country varchar(20) CHARACTER SET UTF8,

c_login char(13) CHARACTER SET UTF8,

c_email_address char(50) CHARACTER SET UTF8,

c_last_review_date_sk   int,

primary key (c_customer_sk)

)SALT USING 2 PARTITIONS

  HBASE_OPTIONS

  (

DATA_BLOCK_ENCODING = 'FAST_DIFF'

-- not available in local_hadoop   COMPRESSION = 'SNAPPY'

  );



And this time it takes forever and never complete (waited 20 minute, then
killed it).



I am assuming that the second attempt might be the consequence of the first
failure that must have left things half done.



I know that I can do a full uninstall/re-install local Hadoop, but I was
wondering if there is a metadata clean up utility that I could try before
applying the bazooka?



Thanks in advance for the help,
Eric

RE: fixing/checking corrupted metadata?

2016-02-02 Thread Sean Broeder 
+1



*From:* Roberta Marton [mailto:roberta.mar...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 4:06 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* RE: fixing/checking corrupted metadata?



May want to add this to our knowledgeware as an FAQ.



   Roberta



*From:* Eric Owhadi [mailto:eric.owh...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 4:00 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* RE: fixing/checking corrupted metadata?



Awesome, bookmarked J. And yes it solved the problem.

Thanks all for the precious help,
Eric



*From:* Suresh Subbiah [mailto:suresh.subbia...@gmail.com]
*Sent:* Tuesday, February 2, 2016 5:09 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* Re: fixing/checking corrupted metadata?



Here is the syntax for cleanup.

https://cwiki.apache.org/confluence/display/TRAFODION/Metadata+Cleanup



We need to add this to the manual that Gunnar created. I will file a JIRA
to raise an error an exit early if requested compression type is not
available.



Thanks

Suresh



On Tue, Feb 2, 2016 at 5:05 PM, Eric Owhadi  wrote:

Great thanks for the info, very helpful.

You mention Trafodion documentation, in what DOC is it described? I looked
for it in Trafodion Command Interface Guide and Trafodion SQL Reference
Manual with no luck? The other doc titles did not look promising?

Eric





*From:* Anoop Sharma [mailto:anoop.sha...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 4:54 PM


*To:* user@trafodion.incubator.apache.org
*Subject:* RE: fixing/checking corrupted metadata?



Dave mentioned ‘cleanup table customer’. You can use that if you know which
table is messed up in metadata.



Or one can use:

  cleanup metadata, check, return details; to find out all entries
which may be corrupt.

and then:

  cleanup metadata, return details;



Cleanup command is also documented in trafodion documentation which is a
good place to check.



anoop



*From:* Sean Broeder [mailto:sean.broe...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 2:49 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* RE: fixing/checking corrupted metadata?



Right.  I mentioned this only because reinstalling local_hadoop was
mentioned.  Reinitializing Trafodion would be quicker, but just as fatal
for existing data.



*From:* Dave Birdsall [mailto:dave.birds...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 2:43 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* RE: fixing/checking corrupted metadata?



Only do that if you’re willing to get rid of your entire database.



*From:* Sean Broeder [mailto:sean.broe...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 2:41 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* RE: fixing/checking corrupted metadata?



You might want to try sqlci initialize trafodion, drop; initialize
trafodion;







*From:* Eric Owhadi [mailto:eric.owh...@esgyn.com]
*Sent:* Tuesday, February 2, 2016 2:36 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* fixing/checking corrupted metadata?



I have been playing on my dev environment with this DDL:

create table Customer

(

c_customer_sk   int not null,

c_customer_id   char(16) CHARACTER SET UTF8 not null,

c_current_cdemo_sk  int,

c_current_hdemo_sk  int,

c_current_addr_sk   int,

c_first_shipto_date_sk  int,

c_first_sales_date_sk   int,

c_salutationchar(10) CHARACTER SET UTF8,

c_first_namechar(20) CHARACTER SET UTF8,

c_last_name char(30) CHARACTER SET UTF8,

c_preferred_cust_flag   char(1),

c_birth_day integer,

c_birth_month   integer,

c_birth_yearinteger,

c_birth_country varchar(20) CHARACTER SET UTF8,

c_login char(13) CHARACTER SET UTF8,

c_email_address char(50) CHARACTER SET UTF8,

c_last_review_date_sk   int,

primary key (c_customer_sk)

)SALT USING 2 PARTITIONS

  HBASE_OPTIONS

  (

DATA_BLOCK_ENCODING = 'FAST_DIFF',

   COMPRESSION = 'SNAPPY'

  );



After a long time and supposedly 35 retries, it complained about the lack
of SNAPPY compression support in local_hadoop.



That’s fine, so I decided to retry with:

create table Customer

(

c_customer_sk   int not null,

c_customer_id   char(16) CHARACTER SET UTF8 not null,

c_current_cdemo_sk  int,

c_current_hdemo_sk  int,

c_current_addr_sk   int,

c_first_shipto_date_sk  int,

c_first_sales_date_sk   int,

c_salutationchar(10) CHARACTER SET UTF8,

c_first_namechar(20) CHARACTER SET UTF8,

c_last_name char(30) CHARACTER SET UTF8,

c_preferred_cust_flag   char(1),

c_birth_day integer,

c_birth_month   integer,

c_birth_yearinteger,

c_birth_country varchar(20) CHARACTER SET UTF8,

c_login char(13

RE: Logo Proposal

2016-02-11 Thread Sean Broeder 
+1 for option 4



*From:* Amanda Moran [mailto:amanda.mo...@esgyn.com]
*Sent:* Thursday, February 11, 2016 2:53 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* Re: Logo Proposal



Love option 4



+ <3



Nice work!



On Thu, Feb 11, 2016 at 2:51 PM, Ken Holt  wrote:

Seems like the dragon logo itself is a winner - most everyone liked that.

But the combined logo and name was definitely not popular.



Here are a couple of new suggestions for the combined logo and name.



Option 4

https://drive.google.com/file/d/0B9c1EkzsNnw4T3o3YVBDakNtQkU/view?usp=sharing



Option 6

https://drive.google.com/file/d/0B9c1EkzsNnw4Y082OHhNNXBwazA/view?usp=sharing



Don't ask for options 1-3, & 5 - they didn't make it passed my limited
field testing!

Comments on 4 & 6?



Cheers, Ken



On Tue, Feb 9, 2016 at 4:03 PM, Sandhya Sundaresan <
sandhya.sundare...@esgyn.com> wrote:

I’d say there is enough “curliness” going on with the dragon. So  we could
try with a simple bold font  . Perhaps with an outline of a different color
like Hadoop’s/Mahouts is and tie it in with the dragon’s colors as well.



*From:* Hans Zeller [mailto:hans.zel...@esgyn.com]
*Sent:* Tuesday, February 9, 2016 3:46 PM


*To:* user@trafodion.incubator.apache.org
*Subject:* Re: Logo Proposal



+1 for the dragon as well. We used to have an informal logo with another
somewhat cursive font, it shows in one of the carousel pictures on the
trafodion.apache.org site. That might be better (although still not my
favorite).


Hans



On Tue, Feb 9, 2016 at 11:52 AM, Ken Holt  wrote:

By the way, the size of the example logo is arbitrary.  The original is a
vector graphics file that will scale up or down with no loss of quality,
which I will make available when the debate has settled on something.



I'll make a stab at changing the font and size relative to the dragon and
post another version of that.



Agree that separating the dragon from the name/font makes sense.

Cheers, Ken





On Tue, Feb 9, 2016 at 11:49 AM, Stack  wrote:

+1 on dragon.



On Tue, Feb 9, 2016 at 11:19 AM, Carol Pearson 
wrote:

+1 on the Dragon!!!  Looks great!



On the writing, cursive is hard to read, so I'm up for replacing it
separately.  Maybe we vote on each separately (as Sandhya and Amanda did)?





Voting separately is a good idea. Having engineers vote on 'designs' is
always a tough one. Sounds like folks like the dragon but not the
cursive... so suggest splitting out what we vote on so at least the dragon
carries.



St.Ack







-Carol P.


---

Email:carol.pearson...@gmail.com

Twitter:  @CarolP222

---



On Tue, Feb 9, 2016 at 10:15 AM, Sandhya Sundaresan <
sandhya.sundare...@esgyn.com> wrote:

+1 for Dragon.

The Trafodion cursive writing and color  -1. IMHO we need to rework the
writing for sure and try various colors. It’s looking cluttered and
complicated with the cursive.





*From:* Amanda Moran [mailto:amanda.mo...@esgyn.com]
*Sent:* Tuesday, February 9, 2016 10:13 AM
*To:* user@trafodion.incubator.apache.org
*Subject:* Re: Logo Proposal



+10 for dragon! Very cute!



Not a huge fan of the cursive writing myself... but if everyone else
likes... I give it a +0



On Tue, Feb 9, 2016 at 10:00 AM, Christophe LeRouzo  wrote:

Thanks Ken, the standalone dragon looks really good. It complements really
well the yellow elephant!



Regards,

-clr





*From:* Dave Birdsall [mailto:dave.birds...@esgyn.com]
*Sent:* Tuesday, February 9, 2016 9:53 AM
*To:* user@trafodion.incubator.apache.org
*Subject:* RE: Logo Proposal



Hi,



I like both. I do agree that the font for “Trafodion” makes a’s and o’s too
much alike. Would be nice to switch to another font that doesn’t have that
issue.



Dave



*From:* Ken Holt [mailto:knhknhknh...@gmail.com]
*Sent:* Tuesday, February 9, 2016 9:48 AM
*To:* user@trafodion.incubator.apache.org
*Subject:* Logo Proposal



Hi All,



Apache Trafodion needs a logo.



I believe there was some discussion about a logo for Trafodion quite some
time ago, but we never really resolved it.  In the very early days of
Trafodion, before becoming an Apache project (incubating) I devised a logo
that leveraged the Welsh connection of the project name, and that was a
simple cute dragon.



I now have a much improved version of that original logo and propose that
we use this as the official Trafodion logo going forward.



Dragon standalone -
https://drive.google.com/file/d/0B9c1EkzsNnw4QmttYnBzZDdFSTQ/view?usp=sharing

Trafodion name & dragon -
https://drive.google.com/file/d/0B9c1EkzsNnw4Y3RRdVQwb0owSFU/view?usp=sharing



I’m not thrilled with the font choice for “Trafodion” – the o’s and a’s
look too similar.



Thoughts?  Should we vote on this?



Cheers, Ken







-- 

Thanks,



Amanda Moran















-- 

Thanks,



Amanda Moran

RE: Logo Proposal

2016-02-12 Thread Sean Broeder 
I know there has been some talk of using lower case in Trafodion, but do we
want to extend that to Apache?  I’ve done some non-exhaustive searches and
can’t find any instance where the leading ‘A’ is not capitalized.  I think
we should follow that pattern.



Regards,

Sean



*From:* Gunnar Tapper [mailto:tapper.gun...@gmail.com]
*Sent:* Friday, February 12, 2016 12:31 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* Re: Logo Proposal



Hi,



Based on the input from several people in this thread, I'd like to propose
the following draft as a candidate:
https://drive.google.com/open?id=0BxlwNhWxn8iTQV85eDlyc0RxWGc



I'm hoping that Ken, Sandhya, or someone else can make a real version for
consideration rather than my PowerPoint hack. It needs a bit of work on the
gray hue (s;lightly darker IMO), size of dragon, and alignment but that's
better done in a real designer program. The font was downloaded from Google
Fonts: Telex Regular.



As mentioned, the draft fits into the overall website well:
https://drive.google.com/open?id=0BxlwNhWxn8iTczNMLTRjYUVXSkE and I'm sure
it'll meet the other criteria, too.



Thanks,



Gunnar











On Fri, Feb 12, 2016 at 12:39 PM, Carol Pearson 
wrote:

We also need our logo to look good on our customers' and users' and
ecosystem denizens' websites so they're eager to show off that Trafodion
fits into the puzzle ;-) .



I don't think we're quite converged and ready for a real vote, and to be
honest, I hate to call for a 3 day vote on this over a long weekend in the
US and at the end of a holiday week in China since that's where most of our
traffic comes from.



Further discussion over the weekend and final vote on Tuesday?



-Carol P.


---

Email:carol.pearson...@gmail.com

Twitter:  @CarolP222

---



On Fri, Feb 12, 2016 at 9:34 AM, Venkat Muthuswamy <
venkat.muthusw...@esgyn.com> wrote:

Having Apache in our logo, brings a lot of credibility and shows we are
serious.

Let’s also keep in mind that the logo/text should look good on the website,
presentation slides and any brochures if you will.

Certainly we need multiple colors to bring attention to the product name.



Venkat



*From:* Christophe LeRouzo [mailto:c...@esgyn.com]
*Sent:* Friday, February 12, 2016 7:59 AM
*To:* user@trafodion.incubator.apache.org
*Cc:* Rohit Jain ; Gunnar Tapper <
tapper.gun...@gmail.com>
*Subject:* RE: Logo Proposal



It seems we might need multiple votes:

-  One color or multiple colors?

-  Thin font or thick font?

-  One font or two fonts?

-  Apache or not…



What was Selva saying about engineers and votes? J

-clr





*From:* Amanda Moran [mailto:amanda.mo...@esgyn.com]
*Sent:* Friday, February 12, 2016 7:21 AM
*To:* user@trafodion.incubator.apache.org
*Cc:* Rohit ; Gunnar Tapper 
*Subject:* Re: Logo Proposal



-1 all same color.



I still like option 4 the way it was/is but I can understand wanting to
remove Apache  But I still like it the way it is



Sent from my iPhone


On Feb 12, 2016, at 7:15 AM, Qifan Chen  wrote:

But is it obvious that Trafodion is an Apache project, if one starts to
read about it?



On Fri, Feb 12, 2016 at 8:48 AM, Rohit  wrote:

It depends on how much value you think Apache adds to Trafodion, as
compared to those other logos that perhaps already have some cachet.  I
feel that it adds quite a bit of value to Trafodion.



Rohit



 Original message 
From: Qifan Chen 
Date: 02/12/2016 8:34 AM (GMT-06:00)
To: user@trafodion.incubator.apache.org

Cc: Gunnar Tapper 
Subject: Re: Logo Proposal

I wonder if we could also consider a mod to option 4 where only the dragon
and the word trafodion are present. See the two images attached.



I sampled a couple apache project logs and found they do not have the word
APACHE in their logos (e.g., HIVE, MONGODB, AVRO, SPARK).



With this approach, it is possible to put the Trafodion logo into the
"power by Apache" logo, see URL here
, without the duplication of
"Apache".



It also simplifies the design and allows a good focus.



Thanks --Qifan



On Fri, Feb 12, 2016 at 7:19 AM, Rohit  wrote:

-1



Check out the other logos I sent to the internal dlist.



Rohit



 Original message 
From: Gunnar Tapper 
Date: 02/12/2016 12:50 AM (GMT-06:00)
To: user@trafodion.incubator.apache.org
Subject: Re: Logo Proposal

Hi,



I suggest that we limit the number of colors used.



A simple change:
https://drive.google.com/open?id=0BxlwNhWxn8iTT3NNMTZ0dmhqQm8



Thanks,



Gunnar



On Thu, Feb 11, 2016 at 8:52 PM, Trina Krug  wrote:

Option 4!!



Trina


On Feb 11, 2016, at 7:05 PM, Carol Pearson 
wrote:

Slightly late to the party, but +1 on option 4 as well.  Though I would
prefer a slightly less formal font, the one in option 6 is too spaced out
and I'm not fond of it o

RE: 答复: 答复: Logo Proposal

2016-02-14 Thread Sean Broeder 
I think my preferences lean toward the more traditional.  I like options 13
and 4g.  I don’t really care for the all lower case print, despite it
seeming to have support from others.  It seems too informal or
unprofessional to me.



Nice effort getting these together.



Thanks,
Sean



*From:* Ken Holt [mailto:knhknhknh...@gmail.com]
*Sent:* Saturday, February 13, 2016 4:50 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* Re: 答复: 答复: Logo Proposal



Hi All,



A new set of Trafodion logo options are attached, taking account of much of
the input that I received.



One of these is a clear winner for me personally, but I submit them for
your consideration and hope we can zero in on one of them. (Or perhaps two
for a run-off.)



By the way, all logos use Google fonts, including the earlier front runner
option 4 where I found a comparable google font to use, now named option
4g.



Cheers, Ken





On Fri, Feb 12, 2016 at 6:34 PM, Liu, Ming (Ming)  wrote:

Thanks Gunnar,



I can see it now. I like dragon very much, but hope it is not too popular.

I think we also think about whale before?



The meaning behind whale is: it is the biggest animal on the earth , and
real J



And Hadoop projects seem to use cute animals (Hive, Hadoop). Maybe we can
draw a baby dragon?



And most people like sky blue? I used to have black or golden dragon as my
favorite J



My 2 cents.



Overall, I like this logo, it is already good enough for me. It shows to me
how powerful Trafodion is. I know it is hard to get consensus for this kind
of design.



Thanks,

Ming



*发件人**:* Gunnar Tapper [mailto:tapper.gun...@gmail.com]
*发送时间**:* 2016年2月13日 9:43
*收件人**:* user@trafodion.incubator.apache.org
*主**题**:* Re: 答复: Logo Proposal



Trying an attachment...



On Fri, Feb 12, 2016 at 6:26 PM, Liu, Ming (Ming)  wrote:

Hi, Gunnar,



Is it possible to put the logo as attachment? If they are not too big. I
saw QiFan once has an attachment of a logo in one of his post. Some people
cannot access Google drive .



Thanks,

Ming



*发件人**:* Gunnar Tapper [mailto:tapper.gun...@gmail.com]
*发送时间**:* 2016年2月13日 4:31
*收件人**:* user@trafodion.incubator.apache.org
*主**题**:* Re: Logo Proposal



Hi,



Based on the input from several people in this thread, I'd like to propose
the following draft as a candidate:
https://drive.google.com/open?id=0BxlwNhWxn8iTQV85eDlyc0RxWGc



I'm hoping that Ken, Sandhya, or someone else can make a real version for
consideration rather than my PowerPoint hack. It needs a bit of work on the
gray hue (s;lightly darker IMO), size of dragon, and alignment but that's
better done in a real designer program. The font was downloaded from Google
Fonts: Telex Regular.



As mentioned, the draft fits into the overall website well:
https://drive.google.com/open?id=0BxlwNhWxn8iTczNMLTRjYUVXSkE and I'm sure
it'll meet the other criteria, too.



Thanks,



Gunnar











On Fri, Feb 12, 2016 at 12:39 PM, Carol Pearson 
wrote:

We also need our logo to look good on our customers' and users' and
ecosystem denizens' websites so they're eager to show off that Trafodion
fits into the puzzle ;-) .



I don't think we're quite converged and ready for a real vote, and to be
honest, I hate to call for a 3 day vote on this over a long weekend in the
US and at the end of a holiday week in China since that's where most of our
traffic comes from.



Further discussion over the weekend and final vote on Tuesday?



-Carol P.


---

Email:carol.pearson...@gmail.com

Twitter:  @CarolP222

---



On Fri, Feb 12, 2016 at 9:34 AM, Venkat Muthuswamy <
venkat.muthusw...@esgyn.com> wrote:

Having Apache in our logo, brings a lot of credibility and shows we are
serious.

Let’s also keep in mind that the logo/text should look good on the website,
presentation slides and any brochures if you will.

Certainly we need multiple colors to bring attention to the product name.



Venkat



*From:* Christophe LeRouzo [mailto:c...@esgyn.com]
*Sent:* Friday, February 12, 2016 7:59 AM
*To:* user@trafodion.incubator.apache.org
*Cc:* Rohit Jain ; Gunnar Tapper <
tapper.gun...@gmail.com>
*Subject:* RE: Logo Proposal



It seems we might need multiple votes:

-  One color or multiple colors?

-  Thin font or thick font?

-  One font or two fonts?

-  Apache or not…



What was Selva saying about engineers and votes? J

-clr





*From:* Amanda Moran [mailto:amanda.mo...@esgyn.com]
*Sent:* Friday, February 12, 2016 7:21 AM
*To:* user@trafodion.incubator.apache.org
*Cc:* Rohit ; Gunnar Tapper 
*Subject:* Re: Logo Proposal



-1 all same color.



I still like option 4 the way it was/is but I can understand wanting to
remove Apache  But I still like it the way it is



Sent from my iPhone


On Feb 12, 2016, at 7:15 AM, Qifan Chen  wrote:

But is it obvious that Trafodion is an Apache project, if one s

RE: [VOTE] Apache Trafodion Logo Proposal

2016-02-20 Thread Sean Broeder 
+1 for 13



Sean



*From:* Roberta Marton [mailto:roberta.mar...@esgyn.com]
*Sent:* Thursday, February 18, 2016 6:02 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* [VOTE] Apache Trafodion Logo Proposal



There has been quite a lot of discussion on our user list regarding the
proposed Apache Trafodion logos.

It has now come time for a formal vote on the two most popular logos fondly
known as  4g and 13.

Both have been attached for your reference



Please respond as follows:



[ ] +1-4g approve option 4g

[ ] +1-13 approve option 13

[ ] +0 no opinion

[ ] -1 disapprove (and reason why)



The vote will be open for 72 hours.



   Regards,

   Roberta Marton

RE: 答复: Anyway to start Trafodion without sqstart

2016-03-15 Thread Sean Broeder 
I think the concept of a warm start is a carryover from early SeaQuest
days.  A warm start was proposed to maintain some monitor and TM states,
but it never was fully implemented.



Regards,

Sean



*From:* Liu, Ming (Ming) [mailto:ming@esgyn.cn]
*Sent:* Tuesday, March 15, 2016 10:03 AM
*To:* user@trafodion.incubator.apache.org
*Subject:* 答复: 答复: Anyway to start Trafodion without sqstart



The purpose I guess is to bypass time-consuming database recovery if it is
a warm start. Say, if you have a clean shutdown of Trafodion, you can warm
restart it. If one use ‘ckillall’, or simply loss power, one needs a cold
start. But I think this is just the concept. May not support yet? We
studied the two gomon scripts, seems identical except some minor difference.



And Narendra is correct, I misunderstand the startup code. It is possible.



Thanks,

Ming



*发件人**:* Gunnar Tapper [mailto:tapper.gun...@gmail.com
]
*发送时间:* 2016年3月16日 0:36
*收件人:* user@trafodion.incubator.apache.org
*主题:* Re: 答复: Anyway to start Trafodion without sqstart



BTW, in what cases should gomon.warm or the sqstart warm argument be used?



Thanks,



Gunnar



On Tue, Mar 15, 2016 at 10:30 AM, Narendra Goyal 
wrote:

Yes, one can follow the commands in ‘gomon.cold’ (that sqstart uses (what
Selva mentioned)) to startup without sqstart.



As such, before ‘sqstart’ executes the commands in ‘gomon.cold’, it does
some other checks (like checks for orphan processes), and cleans up IPC
constructs (semaphores, queues, shared memory) via sqipcrm.



Thanks,

-Narendra



*From:* Gunnar Tapper [mailto:tapper.gun...@gmail.com]
*Sent:* Tuesday, March 15, 2016 8:10 AM
*To:* user@trafodion.incubator.apache.org
*Subject:* Re: 答复: Anyway to start Trafodion without sqstart



The use case is how Apache Ambari works: it assume node-by-node management
of services. This is how you achieve rolling upgrades, stopping all
services on a node, etc.



I wonder if it's possible to first start the monitor (using the startup
command) and then start/stop other components per node. Kind of a hybrid
model.



DCS/REST should already support this use case since it's based on the HBase
model where the scripts start daemons on each configured node.



Gunnar



On Tue, Mar 15, 2016 at 8:57 AM, Liu, Ming (Ming)  wrote:

>From my understanding, it is invalid to start trafodion on node by node
mode. Monitor simulate a single image of operating system from a bunch of
nodes. One process can be configured to be a pair: active and standby. So
when start a trafodion process, it will start two processes on two nodes.
It is hard to start a single node.

Is there any use case to do so?



Thanks,

Ming



*发件人**:* Selva Govindarajan [mailto:selva.govindara...@esgyn.com]
*发送时间**:* 2016年3月15日 22:27
*收件人**:* user@trafodion.incubator.apache.org
*主**题**:* RE: Anyway to start Trafodion without sqstart



Yes.  The sqgen command takes in the configuration file for the trafodion
cluster and generates gomon.cold, gomon.warm and other relevant scripts.
These generated scripts are copied to all nodes in the cluster. These
scripts are nothing but the commands to sqshell. sqstart uses either
gomon.cold or gomon.warm to start the Trafodion instance.



Selva



*From:* Gunnar Tapper [mailto:tapper.gun...@gmail.com]
*Sent:* Monday, March 14, 2016 10:03 PM
*To:* user@trafodion.incubator.apache.org
*Subject:* Re: Anyway to start Trafodion without sqstart



DCS and REST follow the HBase model so that should be a simple matter of
invoking the *-daemon.sh scripts.



I think the rest is a matter of using sqshell:



[centos@trafodion incubator-trafodion]$ sqshell

Processing cluster.conf on local host trafodion.novalocal

[SHELL] Shell/shell Version 1.0.1 Apache_Trafodion Release 2.0.0 (Build
debug [centos], date 11Mar16)

[SHELL] %help

[SHELL] usage: shell {[-a|-i] []} | {-c }

[SHELL] - commands:

[SHELL] -- Command line environment variable replacement: ${}

[SHELL] -- ! comment statement

[SHELL] -- cd 

[SHELL] -- delay 

[SHELL] -- down  [, ]

[SHELL] -- dump [{path }]  | 

[SHELL] -- echo []

[SHELL] -- event [{ASE|TSE|DTM|AMP|BO|VR|CS}]  [ [
event-data] ]

[SHELL] -- exec [{[debug][nowait][pri ][name ]

[SHELL]   [nid ][type
{AMP|ASE|BO|CS|DTM|PSD|SMS|SPX|SSMP|TSE|VR}]

[SHELL] --[in |#default][out |#default]}] path
[[]...]

[SHELL] -- exit [!]

[SHELL] -- help

[SHELL] -- kill [{abort}]  | 

[SHELL] -- ldpath [[,]...]

[SHELL] -- ls [{[detail]}] []

[SHELL] -- measure | measure_cpu

[SHELL] -- monstats

[SHELL] -- node [info []]

[SHELL] -- path [[,]...]

[SHELL] -- ps [{ASE|TSE|DTM|AMP|BO|VR|CS}] [|]

[SHELL] -- pwd

[SHELL] -- quit

[SHELL] -- scanbufs

[SHELL] -- set [{[nid ]|[process ]}] key=

[SHELL] -- show [{[nid ]|[process ]}] [key]

[SHELL] -- shutdown [[immediate]|[abrupt]|[!]]

[SHELL] -- startup [trace] []

[SHELL] -- suspend []

[SHELL] -- time 

[SHELL] -- trace 

[SHELL] -- up 

[SHELL] -- wait [ | ]

[SHELL] -- warmstart [trace] []

[SHELL] -- zone [nid |

RE: Instruction about how to become Trafodion contributor

2016-04-13 Thread Sean Broeder 
Can someone please grant write access to confluence ID sbroeder so I can
update the wiki?



The first thing I will update is the link that says to request write access
by posting an email to d...@incubator.trafodion.org rather than
d...@trafodion.incubator.apache.org. J



I copied the user list here in case someone else has attempted to gain
access and received a failed email response from d...@incubator.trafodion.org
.



Regards,

Sean



*From:* Gunnar Tapper [mailto:tapper.gun...@gmail.com]
*Sent:* Wednesday, April 13, 2016 6:11 AM
*To:* user@trafodion.incubator.apache.org
*Subject:* Re: Instruction about how to become Trafodion contributor



The link is provided directly by clicking on "Contribute" on the website.



On Wed, Apr 13, 2016 at 3:38 AM, Pierre Smits 
wrote:

Hi Jian,

First of all: welcome!



https://cwiki.apache.org/confluence/display/TRAFODION/Trafodion+Contributor+Guide
should provide a good starting point.



Best regards,


Pierre Smits


*ORRTIZ.COM *

OFBiz based solutions & services


*OFBiz Extensions Marketplace*

http://oem.ofbizci.net/oci-2/



On Wed, Apr 13, 2016 at 9:50 AM, Jin, Jian (Seth)  wrote:

Hello there,



It is not easy to find instruction How to become Trafodion contributor in
official website or WiKi page.

Did I miss it or we need to add this at proper place?



Best regards,



金剑 (Seth)









-- 

Thanks,



Gunnar

*If you think you can you can, if you think you can't you're right.*

RE: 答复: HDFS/HBase/Zookeeper Settings set by Installer

2016-05-03 Thread Sean Broeder 
Hi Amanda,

hbase.regionserver.region.transactional.tlog  is a setting that was used
prior to Trafodion becoming an open source project.  It is no longer needed.



Thanks,

Sean



*From:* Amanda Moran [mailto:amanda.mo...@esgyn.com]
*Sent:* Tuesday, May 3, 2016 10:02 AM
*To:* user@trafodion.incubator.apache.org
*Subject:* Re: 答复: HDFS/HBase/Zookeeper Settings set by Installer



Thanks a lot for the help Ming (and thanks for the kind words Pierre!).



I will take a look at testing without adding the coprocessor settings (but
I won't remove from the installer for now).



Thanks!



Amanda



On Tue, May 3, 2016 at 12:42 AM, Liu, Ming (Ming)  wrote:

Yes, this is very important topic.



I can confirm to remove two of them :

Name: hbase.bulkload.staging.dir

Value: /hbase-staging

Why:

Still Needed: NO



Name: hbase.regionserver.region.transactional.tlog

Value: true

Why:

Still Needed: NO



We need more test for :



Name: hbase_coprocessor_region_classes

Value:
"org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionObserver,org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionEndpoint,org.apache.hadoop.hbase.coprocessor.AggregateImplementation"

Why: Not fully tested to remove it.

Still needed: Yes



There is already a fix that can get rid of this settings. But we need more
test. That is, remove this from installer and see if any issues. We tested
it briefly and it works well, but never get it full QAed. Trafodion now
should add coprocessor at runtime if installer not doing this.



Another one I have comment:



Name: hbase.hregion.impl

Value:
org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegion

Why: Trafodion coprocessor need to invoke a private API of HBase Region, so
have to overwrite this class now. When Trafodion move to HBase 1.2, it is
possible to get rid of it, since HBase R1.2 public one required method for
us. See https://issues.apache.org/jira/browse/HBASE-15076?filter=-2

Still Needed: Yes.





IMHO, all other settings should not be mandatory, but kind of
performance/stability tunings. However, I am not the author of those
settings, so not very sure. It is better others to comment more.



Yes, thanks Amanda to bring this up, and I hope you can keep pushing this
topic.

I feel some settings there is too old that nobody knows the reason or just
forget, I think testing is a solution: remove it, and test to see if any
issue. But if someone knows that one is MUST-TO-KEEP or DELETE-IT, it is
better to reply.



Thanks,

Ming



*发件人**:* Pierre Smits [mailto:pierre.sm...@gmail.com]
*发送时间**:* 2016年5月3日 15:20
*收件人**:* user@trafodion.incubator.apache.org
*主**题**:* Re: HDFS/HBase/Zookeeper Settings set by Installer



Hi Amanda,



Thanks for bringing this up. Especially the 'why' aspect. This will be good
input for the documentation.



Best regards,


Pierre Smits


*ORRTIZ.COM *

OFBiz based solutions & services


*OFBiz Extensions Marketplace*

http://oem.ofbizci.net/oci-2/



On Mon, May 2, 2016 at 10:54 PM, Amanda Moran 
wrote:

Hi there All-



I have been looking over the HDFS/HBase/Zookeeper settings that get set in
the installer and I am wondering if they are all still needed.



If you have requested a setting in the past, could you please add a
description of why it is needed (and if it is still needed)?



Thanks a bunch!



**Note: I know this would have looked much better in a spreadsheet but
I want to make sure everyone can see... and email is the best for that!



*HDFS Settings*



Name: namenode_java_heapsize

Value: 1GB (or 1073741824 bytes)

Why:

Still needed:



Name: secondary_namenode_java_heapsize

Value: 1 GB (or 1073741824 bytes)

Why:

Still needed:



Name: dfs_namenode_acls_enabled

Value: true

Why:

Still needed:



*HBase Master Settings*



=HBase Master Config Safety Valve=



Name: hbase_master_distributed_log_splitting

Value: false

Why:

Still needed:



Name: hbase_snapshot_master_timeoutMillis

Value: 60

Why:

Still needed:



*HBase Region Server Settings *



Name: hbase_coprocessor_region_classes

Value:
"org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionObserver,org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionEndpoint,org.apache.hadoop.hbase.coprocessor.AggregateImplementation"

Why:

Still needed:



Name: hbase_regionserver_lease_period

Value: 60

Why:

Still Needed:



=HBase RegionServer Config Safety Valve=



Name: hbase.hregion.impl

Value:
org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegion

Why:

Still Needed:



Name: hbase.regionserver.region.split.policy

Value: org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy

Why:

Still Needed:



Name: hbase.snapshot.enabled

Value: true

Why:

Still Needed:



Name: hbase.bulkload.staging.dir

Value: /hbase-staging

Why:

Still Needed:



Name: hbase.regionserver.region.transactional.tlog

Value: true

Why:

Still Needed:



Name: hbase.snapshot.region.timeout

Value: 6000

RE: trafodion get stuck and hbase log shows "followed by a smaller key"

2016-09-13 Thread Sean Broeder 
Resending with a smaller email as the previous one was rejected by the
apache mail daemon for being too large.



Sorry for the inconvenience,

Sean



*From:* Sean Broeder [mailto:sean.broe...@esgyn.com]
*Sent:* Tuesday, September 13, 2016 6:26 AM
*To:* 'user@trafodion.incubator.apache.org' <
user@trafodion.incubator.apache.org>; 'd...@trafodion.incubator.apache.org' <
d...@trafodion.incubator.apache.org>
*Subject:* RE: trafodion get stuck and hbase log shows "followed by a
smaller key"



Hi Qiao,

I am very sorry you ran into this issue.  I’ve never seen this before, but
I don’t typically use hive to load my tables.  I think you should open a
JIRA for this. Do you know if the problem is repeatable?  If so, please put
any details to reproduce into the JIRA.  Also, if you could set
log4j.logger.org.apache.hadoop.hbase.coprocessor.transactional=trace  in
hbase/conf /log4j.properties that would be helpful.



Thanks,

Sean



*From:* 乔彦克 [mailto:qya...@gmail.com ]
*Sent:* Tuesday, September 13, 2016 1:37 AM
*To:* d...@trafodion.incubator.apache.org;
user@trafodion.incubator.apache.org
*Subject:* trafodion get stuck and hbase log shows "followed by a smaller
key"





Hi, all,

I use hive to load some data to do some test. This morning after I
loaded some data I did a sum query which leading to a HBase regionserver
crashed. Then I restart HBase hoping to do some load balace, but just got
these errors in the HBase regionserve log.

The worse is that I have no other choice but to execute "initialize
trafodion, drop" because the trafci can only execute this command.



   some other Trafodion table region has the same problems.

   Do you ever encountered this problems?

   Any replies is appreciated.



  Thanks,

  Qiao

RE: [Question]Does Trafodion support median() function as Oracle?

2017-05-08 Thread Sean Broeder 
There is a getMedian() aggregator function in our endpoint coprocessor 
implementation and also in the TransactionalAggregationClient, so I would think 
we have support for this function.  I haven't tested it personally.

Regards,
Sean

From: Liu, Yuan (Yuan) [mailto:yuan@esgyn.cn]
Sent: Monday, May 8, 2017 3:17 AM
To: user@trafodion.incubator.apache.org
Subject: [Question]Does Trafodion support median() function as Oracle?

Hi trafodioners,

Can anyone please tell me does Trafodion support median function or similar 
window function as Oracle has? If not, do we have another way to realize this?

Select
median(fee_sum_before),
avg(fee_sum_before),max(...),
min(...)
  from ta_user_property;


Best regards,
Yuan
Email: yuan@esgyn.cn
Cellphone: (+86) 13671935540

RE: Initialize trafodion drop will not drop DTM tables

2017-05-25 Thread Sean Broeder 
Hi Yuan,
The reason initialize Trafodion, drop does not drop DTM tables is that the DTM 
is running and still using them.

I'm not practiced in offline restore.  Does it use scripts that don't require 
Trafodion to be running?  Perhaps you can leverage the cleanat script as 
follows.

initialize Trafodion, drop
sqstop
cleanat
offline restore
sqstart

Regards,
Sean

From: Liu, Yuan (Yuan) [mailto:yuan@esgyn.cn]
Sent: Thursday, May 25, 2017 8:28 PM
To: user@trafodion.incubator.apache.org
Subject: Initialize trafodion drop will not drop DTM tables

Hi Trafodioners,

I found that when I did 'initialize trafodion, drop' the DTM related tables 
would not be dropped. Could anyone explain why this happened?

For the feature of 'offline restore',  we need to make sure there is no 
TRAFODION.*  table exist in HBase, otherwise the restore will fail. So I am 
thinking can we have such enhancement that we drop all TRAFODION.* tables when 
'initialize trafodion, drop'?

Does that make sense?

[cid:image001.png@01D2D596.40CC57B0]
[cid:image002.png@01D2D596.40CC57B0]


Best regards,
Yuan
Email: yuan@esgyn.cn
Cellphone: (+86) 13671935540