Re: How to get columnName as `COUNT(*)` , not `EXPR$0`
Hi XING, I appreciate your kindness. :-D Your detailed and prompt replies really helped me a lot. I will review the java doc you mentioned. Best wishes, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/29/2019 13:58，XING JIN wrote： You can check the below doc of SqlValidatorUtil#getAlias for explanation: /** * Derives an alias for a node, and invents a mangled identifier if it * cannot. * * Examples: * * * Alias: "1 + 2 as foo" yields "foo" * Identifier: "foo.bar.baz" yields "baz" * Anything else yields "expr$ordinal" * * * @return An alias, if one can be derived; or a synthetic alias * "expr$ordinal" if ordinal 0; otherwise null */ public static String getAlias(SqlNode node, int ordinal) But from my experience, you'd better not rely on above logic heavily. If you really care about the output name, just give it an alias explicitly. Juan Pan 于2019年9月29日周日 下午1:27写道： That means Calcite can only return real columnName or columnLabel from simple column or alias. And any aggregate function, or calculate expression without alias, parsing expression, i.e, `EXPR$0` will be returned? Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/29/2019 13:16，XING JIN wrote： If no column name given explicitly, e.g. by alias or simple identifier, Calcite will derive one but not from the aggregate function. Juan Pan 于2019年9月29日周日 下午1:12写道： Thank for your reply. It is a indirect way to get columnName. Calcite can not return the real columnName from SQL, is it right? Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/29/2019 12:21，XING JIN wrote： You can try to give an alias for the selected column. Juan Pan 于2019年9月29日周日 上午11:39写道： Hi everyone, I executed SQL `select count(*) from tb1` through Calcite and resultSet.getMetaData().getColumnName(i) in my project. But the result is `EXPR$0` not `COUNT(*)`. Is there any way to get real columnName? Thanks for your attention. Regard, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
Re: How to get columnName as `COUNT(*)` , not `EXPR$0`
That means Calcite can only return real columnName or columnLabel from simple column or alias. And any aggregate function, or calculate expression without alias, parsing expression, i.e, `EXPR$0` will be returned? Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/29/2019 13:16，XING JIN wrote： If no column name given explicitly, e.g. by alias or simple identifier, Calcite will derive one but not from the aggregate function. Juan Pan 于2019年9月29日周日 下午1:12写道： Thank for your reply. It is a indirect way to get columnName. Calcite can not return the real columnName from SQL, is it right? Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/29/2019 12:21，XING JIN wrote： You can try to give an alias for the selected column. Juan Pan 于2019年9月29日周日 上午11:39写道： Hi everyone, I executed SQL `select count(*) from tb1` through Calcite and resultSet.getMetaData().getColumnName(i) in my project. But the result is `EXPR$0` not `COUNT(*)`. Is there any way to get real columnName? Thanks for your attention. Regard, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
Re: How to get columnName as `COUNT(*)` , not `EXPR$0`
Thank for your reply. It is a indirect way to get columnName. Calcite can not return the real columnName from SQL, is it right? Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/29/2019 12:21，XING JIN wrote： You can try to give an alias for the selected column. Juan Pan 于2019年9月29日周日 上午11:39写道： Hi everyone, I executed SQL `select count(*) from tb1` through Calcite and resultSet.getMetaData().getColumnName(i) in my project. But the result is `EXPR$0` not `COUNT(*)`. Is there any way to get real columnName? Thanks for your attention. Regard, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
How to get columnName as `COUNT(*)` , not `EXPR$0`
Hi everyone, I executed SQL `select count(*) from tb1` through Calcite and resultSet.getMetaData().getColumnName(i) in my project. But the result is `EXPR$0` not `COUNT(*)`. Is there any way to get real columnName? Thanks for your attention. Regard, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
Re:Gitbox/github notifications are not threaded
Hi Craig,
It is really troublesome. I hope Infra can take some actions as well.
From my experiences, some Email clients, e.g, foxmail for mac, can aggregate
emails into one thread by topic. Maybe you can have a try if you want.
Currently, i am using a Chinese email client helping me do that.
In addition, creating rules to filter emails is a another solution, but not
very practical i think. :)
Regard,
Trista
Juan Pan
panj...@apache.org
Juan Pan(Trista), Apache ShardingSphere
On 09/26/2019 18:36，Craig Russell wrote：
Hi Infra,
Every message from gitbox to notifications@shardingsphere is sent individually
and clogs my in-box.
I'm wondering if there is some configuration that we can use to automatically
thread messages.
In this case, how can we change the github/gitbox notifications to
Subject: issue #3121: can't use HintManager.getInstance().setMasterRouteOnly()
The notification would apply to all references to this issue: create, modify,
comment, change of status, close. The subject could allow my mail reader to
thread all the messages on the subject issue. As it is, this issue has created
three individual messages sent to notificati...@shardingsphere.apache.org and
one thread that contains three replies, sent to
incubator-shardingsph...@noreply.github.com
I'm hoping that there is a technical solution to allow all of these messages to
be aggregated into one thread.
Thanks,
Craig
Begin forwarded message:
From: GitBox
Subject: [GitHub] [incubator-shardingsphere] maxiaoxian opened a new issue
#3121: can't use HintManager.getInstance().setMasterRouteOnly()
Date: September 26, 2019 at 1:41:06 AM PDT
To: notificati...@shardingsphere.apache.org
Reply-To: dev@shardingsphere.apache.org
maxiaoxian opened a new issue #3121: can't use
HintManager.getInstance().setMasterRouteOnly()
URL: https://github.com/apache/incubator-shardingsphere/issues/3121
## Bug Report
**For English only**, other languages will not accept.
Before report a bug, make sure you have:
- Searched open and closed [GitHub
issues](https://github.com/apache/incubator-shardingsphere/issues).
- Read documentation: [ShardingSphere
Doc](https://shardingsphere.apache.org/document/current/en/overview).
Please pay attention on issues you submitted, because we maybe need more
details.
If no response **more than 7 days** and we cannot reproduce it on current
information, we will **close it**.
Please answer these questions before submitting your issue. Thanks!
### Which version of ShardingSphere did you use?
4.0.0-RC2
### Which project did you use? Sharding-JDBC or Sharding-Proxy?
Sharding-JDBC
### Expected behavior
route to master
### Actual behavior
throw a exception : HintManagerHolder has previous value, please clear first.
### Reason analyze (If you can)
### Steps to reproduce the behavior, such as: SQL to execute, sharding rule
configuration, when exception occur etc.
// 读写分离配置
MasterSlaveRuleConfiguration masterSlaveRuleConfig =
new MasterSlaveRuleConfiguration("ds", "fcWriteDataSource",
Arrays.asList("fcRead1DataSource", "fcRead2DataSource"));
Set masterSlaveRuleConfigurationSet = new
HashSet<>();
masterSlaveRuleConfigurationSet.add(masterSlaveRuleConfig);
ShardingRuleConfiguration shardingRuleConfig = new ShardingRuleConfiguration();
shardingRuleConfig.setMasterSlaveRuleConfigs(masterSlaveRuleConfigurationSet);
...
### Example codes for reproduce this issue (such as a github link).
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
Craig L Russell
c...@apache.org
Re: Why is `datasource-settings.properties` necessary when storage is `MySQL`
Thanks for your rely. I will consider about your `better things`. (^_^) Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/27/2019 19:20, Sheng Wu wrote: datasource-settings.properties file is loaded by codes, through file name only. But the better things for application.yml are two 1. It could be overrided by system env, which is much more friendly than config file change. 2. In our container definition, application yaml file could be change through system env, not just values of config items, but including provider names. You could read skywalking-docker about this. This file should be merged into application.yaml, and it is open to change. Please submit pull request if you want. ShengWu ApacheSkyWalking,ShardingSphere,Zipkin FromWuSheng'sphone. -- Original -- From: Juan Pan
Re: [Discuss] What does ShardingSphere 4.0.0's final API look like?
Making feature independent and use them in mixed mood? It sounds great, but challenging. It will take a lot of time to do, i think... Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/28/2019 18:44, Sheng Wu wrote: Does making this change in 5 make more sense? And we provide v4 unchanged for user convenient. Sheng zhangli...@apache.org 于2019年9月28日 周六下午6:15写道： > The scope of ShardingSphere keep expanding. Sharding is not the unique and > core feature for ShardingSphere anymore. > > So we plan to create pluggable infrastructure for database proxy and JDBC > driver which to let users run it without any additional function, just > transparent transmission. ShardingSphere can add more features into `EMPTY` > infrastructure, such as sharding, master-slave, encrypt, > distributed-transaction, orchestration and so on. > > The API may look like: ShardingDataSource, MasterSlaveDataSource, > EncryDataSource, DistributedTransactionDataSource and > OrchestrationDataSource, the yaml and other configuration methods should > change to this way too. > > Every features are independent and can be work together which using > composited and append-able way. We can provide SSDataSourceFacade to manage > how to use them together. > > This is one of the reason to why we do not release for 4.0.0 stable version > soon, we want more discuss to make decision to change API before 4.0.0 > stable version release. > > Any suggestions? > > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo > -- Sheng Wu SkyWalking, Shardingsphere and Zipkin
Why is `datasource-settings.properties` necessary when storage is `MySQL`
Hi everyone, I am exploring SkyWalking, and i find when storage is`MySQL, `datasource-settings.properties` is needed to set properties, while all the properties of H2 storage can be set through `application.yml`. Why is `datasource-settings.properties` necessary for MySQL storage? Do they have different loading mechanism？ Thanks for your help. :) Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
Re:Support scenarios where multiple database table structures are different??
Hi, Sorry i can not get the point for your question. You can go through the documents on Sharding[1] to learn more. [1] https://shardingsphere.apache.org/document/current/en/features/ Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/27/2019 11:24?? wrote?? hello,Ask the following questions:My two database tables have completely different structures,Can you use it for this scenario?If not??Can I do that by rewriting something? I want to write different data sources using different logic??3Q very much
Re: How to modify data for custom tables through Calcite.
Thanks, Danny I will have a try, but it seems challenging, i thought… Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/26/2019 14:19，Danny Chan wrote： The ElasticsearchTableScan is a good start to show how it transfers the elastic nodes from Convention.NONE to ElasticsearchRel.CONVENTION [1] [1] https://github.com/apache/calcite/blob/c9adf94b0e07f2e9108ef4d1f2ee28c3e42063b3/elasticsearch/src/main/java/org/apache/calcite/adapter/elasticsearch/ElasticsearchTableScan.java#L79 Best, Danny Chan 在 2019年9月26日 +0800 PM12:13，Juan Pan ，写道： @Danny Chan Thanks Danny, is there any document or test for me to learn `specific convention` more? Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/26/2019 12:02，Danny Chan wrote： @Rui Wang, Yes, I wrote the Flink-sql-parser module it did support insert grammar well. @Juan Pan you need the converter rules to convert all the nodes to specific convention you want, also specify the desired convention in the trait set of your planing program. Best, Danny Chan 在 2019年9月26日 +0800 AM6:04，Rui Wang ，写道： Another data point is both BeamSQL and FlinkSQL support DDL by an extensive way (and I believe it works through Avitica as well). BeamSQL: [1] FlinkSQL: [2] Calcite allows add customized DDL in parser and also in implementation schema is accessible. [1]: https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/src/main/codegen/includes/parserImpls.ftl#L149 [2]: https://github.com/apache/flink/blob/master/flink-table/flink-sql-parser/src/main/codegen/data/Parser.tdd#L430 -Rui On Wed, Sep 25, 2019 at 2:54 PM Stamatis Zampetakis wrote: Hi Trista, I think the server module is doing what you are asking for. Have a look in ServerTest [1]. As Gelbana mentioned the implementation is based on implementations of the ModifiableTable interface. Best, Stamatis [1] https://github.com/apache/calcite/blob/master/server/src/test/java/org/apache/calcite/test/ServerTest.java On Wed, Sep 25, 2019 at 11:29 PM Mohamed Mohsen wrote: I haven't done that before but I would start investigating from this interface [1]. Please share your experience if you get this done. [1] org.apache.calcite.schema.ModifiableTable On Wed, Sep 25, 2019 at 2:00 PM Juan Pan wrote: Hi everyone, Thanks for your attention. I want to know the following description is right or not? "Modification has only been worked on for JDBC tables, not for any custom tables currently.” Query SQL on custom table is ok, so i am wondering whether i can execute `update/insert/delete` SQL through Calcite on custom tables. Can anyone give me some ideas? Really thanks for your help. Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
Re: How to modify data for custom tables through Calcite.
@Danny Chan Thanks Danny, is there any document or test for me to learn `specific convention` more? Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/26/2019 12:02，Danny Chan wrote： @Rui Wang, Yes, I wrote the Flink-sql-parser module it did support insert grammar well. @Juan Pan you need the converter rules to convert all the nodes to specific convention you want, also specify the desired convention in the trait set of your planing program. Best, Danny Chan 在 2019年9月26日 +0800 AM6:04，Rui Wang ，写道： Another data point is both BeamSQL and FlinkSQL support DDL by an extensive way (and I believe it works through Avitica as well). BeamSQL: [1] FlinkSQL: [2] Calcite allows add customized DDL in parser and also in implementation schema is accessible. [1]: https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/src/main/codegen/includes/parserImpls.ftl#L149 [2]: https://github.com/apache/flink/blob/master/flink-table/flink-sql-parser/src/main/codegen/data/Parser.tdd#L430 -Rui On Wed, Sep 25, 2019 at 2:54 PM Stamatis Zampetakis wrote: Hi Trista, I think the server module is doing what you are asking for. Have a look in ServerTest [1]. As Gelbana mentioned the implementation is based on implementations of the ModifiableTable interface. Best, Stamatis [1] https://github.com/apache/calcite/blob/master/server/src/test/java/org/apache/calcite/test/ServerTest.java On Wed, Sep 25, 2019 at 11:29 PM Mohamed Mohsen wrote: I haven't done that before but I would start investigating from this interface [1]. Please share your experience if you get this done. [1] org.apache.calcite.schema.ModifiableTable On Wed, Sep 25, 2019 at 2:00 PM Juan Pan wrote: Hi everyone, Thanks for your attention. I want to know the following description is right or not? "Modification has only been worked on for JDBC tables, not for any custom tables currently.” Query SQL on custom table is ok, so i am wondering whether i can execute `update/insert/delete` SQL through Calcite on custom tables. Can anyone give me some ideas? Really thanks for your help. Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
How to modify data for custom tables through Calcite.
Hi everyone, Thanks for your attention. I want to know the following description is right or not? "Modification has only been worked on for JDBC tables, not for any custom tables currently.” Query SQL on custom table is ok, so i am wondering whether i can execute `update/insert/delete` SQL through Calcite on custom tables. Can anyone give me some ideas? Really thanks for your help. Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
??????????????????????????????????????????????????
Hi,
Actually, we need to communicate in English. Otherwise, i can not confirm the
validity of this configuration , for it is presented in plain format in this
email. So my suggestion is to compare it with those configurations in our
example project[1].
[1] https://github.com/apache/incubator-shardingsphere-doc
Regards,
Trista
Juan Pan
panj...@apache.org
Juan Pan(Trista), Apache ShardingSphere
??2019??09??25?? 15:07<710302...@qq.com> ??
??
sharding-jdbc
?? ??2??Postgresql
dsjava??dsc
??java??c
?? 2??
t_staff_male, t_staff_female
---
??
DROP TABLE "public"."t_staff_male";
CREATE TABLE "public"."t_staff_male" (
"staff_id" varchar(10) NOT NULL,
"staff_name" varchar(16) NOT NULL,
"staff_sex" varchar(8) NOT NULL,
"group_code" varchar(8),
"id_number_plain" varchar(32),
"id_number_cipher" varchar(64)
)
WITH (OIDS=FALSE)
;
ALTER TABLE "public"."t_staff_male" ADD PRIMARY KEY ("staff_id");
--
?? ??Springboot2.1.*+Mybatis3.5.* ??application.yml
mybatis:
config-location: classpath:META-INF/mybatis-config.xml
mapper-locations: classpath:com/example/shardingsphere/dao/mappers/*.xml
spring:
shardingsphere:
datasource:
names: dsjava,dsc
dsjava:
type: org.apache.commons.dbcp2.BasicDataSource
driver-class-name: org.postgresql.Driver
url: jdbc:postgresql://127.0.0.1:5444/dsjava
username: fan
password:
dsc:
type: org.apache.commons.dbcp2.BasicDataSource
driver-class-name: org.postgresql.Driver
url: jdbc:postgresql://127.0.0.1:5444/dsc
username: fan
password:
sharding:
default-database-strategy:
inline:
sharding-column: group_code
algorithm-expression: ds$-{group_code}
tables:
t_staff:
actual-data-nodes: ds$-{['java', 'c']}.t_staff_$-{['male', 'female']}
table-strategy:
inline:
sharding-column: staff_sex
algorithm-expression: t_staff_$-{staff_sex}
encrypt:
encryptors:
encryptor_aes:
type: aes
props:
aes.key.value: 123456
tables:
t_staff:
columns:
id_number:
plainColumn: id_number_plain
cipherColumn: id_number_cipher
encryptor: encryptor_aes
props:
sql.show: true
query.with.cipher.comlum: true
??
??StaffMapper.xml
Re:[ANNOUNCE] New committer: Qi Wang
Welcome, Qi :) Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/25/2019 10:45，Chen QingYang wrote： The Podling Project Management Committee (PPMC) for Apache ShardingSphere has invited Qi Wang to become a committer and we are pleased to announce that he has accepted. Qi Wang did a lot of contributions for ShardingSphere community. Please join me to say congratulations to him! -- Chen QingYang Apache ShardingSphere
Re: Suggest to add team page to our website
You're right, Sheng. When a new committer appears, we should tell him or her to add his or her name to this page. Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/21/2019 23:50, Sheng Wu wrote: I think new committer should update their name by themselves, it should be easy PR. Sheng Wu 吴晟 Apache SkyWalking Apache Incubator Apache ShardingSphere, ECharts, DolphinScheduler podlings Zipkin Twitter, wusheng1108 sunbufu 于2019年9月21日周六 下午10:52写道： > Hi, My name is Haisheng Sun(孙海生), My apache id and github id is sunbufu. > > Thank you. > > > On 09/21/2019 22:38, Juan Pan wrote: > Hi Guangyuan and Haisheng, > > Can u provide your name and Apache ID? It will help lzs to add your > information to our team page. > > Thanks. > > Regards, > Trista > > > > > Juan Pan > > > panj...@apache.org > Juan Pan(Trista), Apache ShardingSphere > On 09/21/2019 22:34, Juan Pan wrote: > Thanks for your contribution, now we have ShardingSphere team page, it is > great. But There are Chinese words on this page, so can u modify them? > > > Moreover, two new committers joined in us last week, so i think their > names should be on the committer list on this page as well. > > > Can you add our two new committers to this page? > > > Thinks a lot :) > > > Regards, > Trista > > > Juan Pan > > > panj...@apache.org > Juan Pan(Trista), Apache ShardingSphere > On 09/21/2019 13:45, lzs wrote: > > > We added this team introduce page at > https://shardingsphere.apache.org/community/en/team/ > | | > lzs > | > | > geo...@163.com > | > 签名由网易邮箱大师定制 > On 9/18/2019 14:44，lzs wrote： > We're willing to do this.Thank you for your suggestion. > > > | | > lzs > | > | > geo...@163.com > | > > > On 9/18/2019 14:29，zhangli...@apache.org wrote： > Great, we should add this page > > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo > > > Sheng Wu 于2019年9月18日周三 下午1:55写道： > > Hi ShardingSphere > > As we have invited some new committers to the project, I suddenly noticed, > we don't have a team page, like this. http://skywalking.apache.org/team/ > Listing our PPMC, mentors, committers and all other contributors. > > I think we should add that page. Any thoughts? > > Sheng Wu 吴晟 > > Apache SkyWalking > Apache Incubator > Apache ShardingSphere, ECharts, DolphinScheduler podlings > Zipkin > Twitter, wusheng1108 > >
Re: [NOTICE] Committer vote and set up document being added
It is detailed, i think. Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/21/2019 23:52, Sheng Wu wrote: Hi all committer and contributors I initialized this PR, because the CN blog of new committer setup <http://skywalking.apache.org/zh/blog/2019-09-12-apache-skyWalking-committer-apply-process.html> reminds me, we miss this important guide. The document describes the detail process, duty, right of the committer and PMC member, and how could be one of them. Please review, I will keep this PR open at least 72 hours. https://github.com/apache/skywalking/pull/3496 Sheng Wu 吴晟 Apache SkyWalking Apache Incubator Apache ShardingSphere, ECharts, DolphinScheduler podlings Zipkin Twitter, wusheng1108
Re: Suggest to add team page to our website
Hi Guangyuan and Haisheng, Can u provide your name and Apache ID? It will help lzs to add your information to our team page. Thanks. Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/21/2019 22:34, Juan Pan wrote: Thanks for your contribution, now we have ShardingSphere team page, it is great. But There are Chinese words on this page, so can u modify them? Moreover, two new committers joined in us last week, so i think their names should be on the committer list on this page as well. Can you add our two new committers to this page? Thinks a lot :) Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/21/2019 13:45, lzs wrote: We added this team introduce page at https://shardingsphere.apache.org/community/en/team/ | | lzs | | geo...@163.com | 签名由网易邮箱大师定制 On 9/18/2019 14:44，lzs wrote： We're willing to do this.Thank you for your suggestion. | | lzs | | geo...@163.com | On 9/18/2019 14:29，zhangli...@apache.org wrote： Great, we should add this page -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2019年9月18日周三 下午1:55写道： Hi ShardingSphere As we have invited some new committers to the project, I suddenly noticed, we don't have a team page, like this. http://skywalking.apache.org/team/ Listing our PPMC, mentors, committers and all other contributors. I think we should add that page. Any thoughts? Sheng Wu 吴晟 Apache SkyWalking Apache Incubator Apache ShardingSphere, ECharts, DolphinScheduler podlings Zipkin Twitter, wusheng1108
Re: Suggest to add team page to our website
Thanks for your contribution, now we have ShardingSphere team page, it is great. But There are Chinese words on this page, so can u modify them? Moreover, two new committers joined in us last week, so i think their names should be on the committer list on this page as well. Can you add our two new committers to this page? Thinks a lot :) Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 09/21/2019 13:45, lzs wrote: We added this team introduce page at https://shardingsphere.apache.org/community/en/team/ | | lzs | | geo...@163.com | 签名由网易邮箱大师定制 On 9/18/2019 14:44，lzs wrote： We're willing to do this.Thank you for your suggestion. | | lzs | | geo...@163.com | On 9/18/2019 14:29，zhangli...@apache.org wrote： Great, we should add this page -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2019年9月18日周三 下午1:55写道： Hi ShardingSphere As we have invited some new committers to the project, I suddenly noticed, we don't have a team page, like this. http://skywalking.apache.org/team/ Listing our PPMC, mentors, committers and all other contributors. I think we should add that page. Any thoughts? Sheng Wu 吴晟 Apache SkyWalking Apache Incubator Apache ShardingSphere, ECharts, DolphinScheduler podlings Zipkin Twitter, wusheng1108
[ANNOUNCE] New committer: Guangyuan Wang
TheProjectManagementCommittee(PMC)forApache ShardingSphere hasinvited Guangyuan Wang tobecomeacommitterandwearepleasedtoannouncethathehasaccepted. Guangyuan did a lot of contributions for ShardingSphere community, thanks. Hope you can become more active in future, and enjoy it.:) Best wishes, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
new committer: Haisheng Sun
TheProjectManagementCommittee(PMC)forApache ShardingSphere hasinvited Haisheng Sun tobecomeacommitterandwearepleasedtoannouncethathehasaccepted. Haisheng Sun is active in ShardingSphere community, hope your further interactions with the community! Thanks for your contributions. Best wishes, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
Re: [Event time] Do the two podling have interests to hold an eventtogether?
Hi William and LiDong, Thanks for your detailed schedule. And thanks for clickhouse's rich experience as well. :) We will consider this proposal seriously. How about this co-meetup, everybody of ShardingSphere? Best wishes, Trista | | Juan Pan | | panj...@apache.org Juan Pan(Trista), Apache ShardingSphere | Signature is customized by Netease Mail Master On 09/14/2019 17:57, Guo William wrote: Hi, We’d like to add more information about Dolphin Scheduler meetup for discussion: Dolphin Scheduler Meetup agenda is planed to be formed by 3 part: I Morning Close Door Meeting for core developer and committer: Mainly discuss roadmap, new feature, bugs, and let core team get to know each other face to face… (For this part we can hold 2 separated meeting for both DolphinScheduler and ShardingSphere in two office at the same time) II Afternoon Open Door Meeting Just as Lidong said, we has a roughly plan for Shanghai Meetup, mainly talk to users, encourage them to become contributor and committer. (From this part, two meetup can combine together for more influence) III Evening Salon Gathering Gathered the core developers, the speakers, the volunteers to know each other to activate the community in this city or area. (We can offer supper) This kind of meetup agenda (Part I,Part II, Part III) is validated for clickhouse community's 3-years running experience (According to the core team of CK, key users grew 3-4 times per year in China, till now more than 2000 enterprises is using CK. Core contributors in China was grown from 4 to more than 40). So this is a good form for open source meetup in China for now. We also suggest this agenda for both meetup. :) For now Dolphin Scheduler team has just confirmed the agenda for Shanghai Meetup on 2019，Oct, 26. And we are planning the second meetup on Nov, 10 in Beijing. The meetup time can be re-schedule according to the available time for both team. We are highly appreciated for the co-meetup, and we can offer the place and admin support. Dolphin Scheduler (Incubator) William Guo Wei 原始邮件 发件人: lidong dai 收件人: dev; d...@dolphinscheduler.apache.org 发送时间: 2019年9月14日(周六) 16:49 主题: Re: [Event time] Do the two podling have interests to hold an eventtogether? hi ： we are very willing to organize meetup together, we plan to hold two meetups in Shanghai and Beijing respectively. Here is the original plan meetup content of DolphinScheduler： “ Apache DolphinScheduler(incubator) User Meetup Date: 2019，Oct, 26 （2019年10月26日） Meetup Place: 3R20, No. 1107, Yuyuan Road, Changning District, Shanghai.（上海长宁区愚园路1107号创邑3R20） Agenda(议程): 1、Introduction/overview of DolphinScheduler (William-GuoWei). 2、DolphinScheduler internals, fairly technical: how DolphinScheduler works and so on (Zhanwei Qiao). 3、DolphinScheduler practice (拟定) 4、DolphinScheduler from Zero to One (拟定) 5、DolphinScheduler practice(拟定) 6、Recently released features and Roadmap (Lidong Dai) 7、Free discussion ” Currently, the meetup in Shanghai is recruiting lecturers. Perhaps the shardingsphere can also talk about several topics, which can be arranged together. haha. and We also plan to do a meetup in Beijing ，maybe in November. very glad to hear your opinions! --- Lidong Dai(DolphinScheduler) From: Sheng Wu mailto:wu.sheng.841...@gmail.com>> Sent: Friday, September 13, 2019 23:38 To: dev mailto:dev@shardingsphere.apache.org>>; d...@dolphinscheduler.apache.org<mailto:d...@dolphinscheduler.apache.org> mailto:d...@dolphinscheduler.apache.org>> Subject: [Event time] Do the two podling have interests to hold an event together? Hi DolphinScheduler and ShardingSphere I am being told there is an event of new DolphinScheduler meetup happens soon, 2 months later, I think. Due to these two young communities, do you have interests to host the event together? And set up the talks to attract more potential contributors, which are required at both sides. Pure my personal suggestion, considering I am at both sides. Sheng -- Sheng Wu SkyWalking, Shardingsphere and Zipkin
Re: [Event time] Do the two podling have interests to hold an eventtogether?
Hi William and LiDong, Thanks for your detailed schedule. And thanks for clickhouse's rich experience as well. :) We will consider this proposal seriously. How about this co-meetup, everybody of ShardingSphere? Best wishes, Trista | | Juan Pan | | panj...@apache.org Juan Pan(Trista), Apache ShardingSphere | Signature is customized by Netease Mail Master On 09/14/2019 17:57, Guo William wrote: Hi, We’d like to add more information about Dolphin Scheduler meetup for discussion: Dolphin Scheduler Meetup agenda is planed to be formed by 3 part: I Morning Close Door Meeting for core developer and committer: Mainly discuss roadmap, new feature, bugs, and let core team get to know each other face to face… (For this part we can hold 2 separated meeting for both DolphinScheduler and ShardingSphere in two office at the same time) II Afternoon Open Door Meeting Just as Lidong said, we has a roughly plan for Shanghai Meetup, mainly talk to users, encourage them to become contributor and committer. (From this part, two meetup can combine together for more influence) III Evening Salon Gathering Gathered the core developers, the speakers, the volunteers to know each other to activate the community in this city or area. (We can offer supper) This kind of meetup agenda (Part I,Part II, Part III) is validated for clickhouse community's 3-years running experience (According to the core team of CK, key users grew 3-4 times per year in China, till now more than 2000 enterprises is using CK. Core contributors in China was grown from 4 to more than 40). So this is a good form for open source meetup in China for now. We also suggest this agenda for both meetup. :) For now Dolphin Scheduler team has just confirmed the agenda for Shanghai Meetup on 2019，Oct, 26. And we are planning the second meetup on Nov, 10 in Beijing. The meetup time can be re-schedule according to the available time for both team. We are highly appreciated for the co-meetup, and we can offer the place and admin support. Dolphin Scheduler (Incubator) William Guo Wei 原始邮件 发件人: lidong dai 收件人: dev; dev@dolphinscheduler.apache.org 发送时间: 2019年9月14日(周六) 16:49 主题: Re: [Event time] Do the two podling have interests to hold an eventtogether? hi ： we are very willing to organize meetup together, we plan to hold two meetups in Shanghai and Beijing respectively. Here is the original plan meetup content of DolphinScheduler： “ Apache DolphinScheduler(incubator) User Meetup Date: 2019，Oct, 26 （2019年10月26日） Meetup Place: 3R20, No. 1107, Yuyuan Road, Changning District, Shanghai.（上海长宁区愚园路1107号创邑3R20） Agenda(议程): 1、Introduction/overview of DolphinScheduler (William-GuoWei). 2、DolphinScheduler internals, fairly technical: how DolphinScheduler works and so on (Zhanwei Qiao). 3、DolphinScheduler practice (拟定) 4、DolphinScheduler from Zero to One (拟定) 5、DolphinScheduler practice(拟定) 6、Recently released features and Roadmap (Lidong Dai) 7、Free discussion ” Currently, the meetup in Shanghai is recruiting lecturers. Perhaps the shardingsphere can also talk about several topics, which can be arranged together. haha. and We also plan to do a meetup in Beijing ，maybe in November. very glad to hear your opinions! --- Lidong Dai(DolphinScheduler) From: Sheng Wu mailto:wu.sheng.841...@gmail.com>> Sent: Friday, September 13, 2019 23:38 To: dev mailto:d...@shardingsphere.apache.org>>; dev@dolphinscheduler.apache.org<mailto:dev@dolphinscheduler.apache.org> mailto:dev@dolphinscheduler.apache.org>> Subject: [Event time] Do the two podling have interests to hold an event together? Hi DolphinScheduler and ShardingSphere I am being told there is an event of new DolphinScheduler meetup happens soon, 2 months later, I think. Due to these two young communities, do you have interests to host the event together? And set up the talks to attract more potential contributors, which are required at both sides. Pure my personal suggestion, considering I am at both sides. Sheng -- Sheng Wu SkyWalking, Shardingsphere and Zipkin
Re: [Event time] Do the two podling have interests to hold an event together?
I'd like to attend. See u in Shanghai. | | Juan Pan | | panj...@apache.org Juan Pan(Trista), Apache ShardingSphere | Signature is customized by Netease Mail Master On 09/14/2019 09:08, Willem Jiang wrote: +1 for Apache podling projects working together. I'm quite interesting about these kind of event. BTW, we'd like to hold an Apache committer meetup in Shanghai next saturday (21st, Sep)[1]. Please let me know if you want to attend the meetup next week in Shanghai. [1]https://lists.apache.org/thread.html/5feb266773d655aff9deaf4db8d9dda72ff62a57e91ac97051bd7391@%3Cdev.servicecomb.apache.org%3E Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Fri, Sep 13, 2019 at 11:38 PM Sheng Wu wrote: > > Hi DolphinScheduler and ShardingSphere > > I am being told there is an event of new DolphinScheduler meetup happens > soon, 2 months later, I think. > > Due to these two young communities, do you have interests to host the event > together? And set up the talks to attract more potential contributors, > which are required at both sides. > > Pure my personal suggestion, considering I am at both sides. > > Sheng > -- > Sheng Wu > SkyWalking, Shardingsphere and Zipkin
Fw: [Event time] Do the two podling have interests to hold an event together?
Sorry, + dolphinscheduler community. Hello every one of Dolphin Schedule community:) | | Juan Pan | | panj...@apache.org Juan Pan(Trista), Apache ShardingSphere | Signature is customized by Netease Mail Master - Forwarded Message - From: Juan Pan Date: 09/14/2019 09:19 To: dev Subject: Re: [Event time] Do the two podling have interests to hold an event together? Hi Sheng, +1 from me. Thanks for your suggestion, i think it is great to hold meetup together for two young communities. And i'd like to learn the details more. | | Juan Pan | | panj...@apache.org Juan Pan(Trista), Apache ShardingSphere | Signature is customized by Netease Mail Master On 09/13/2019 23:38, Sheng Wu wrote: Hi DolphinScheduler and ShardingSphere I am being told there is an event of new DolphinScheduler meetup happens soon, 2 months later, I think. Due to these two young communities, do you have interests to host the event together? And set up the talks to attract more potential contributors, which are required at both sides. Pure my personal suggestion, considering I am at both sides. Sheng -- Sheng Wu SkyWalking, Shardingsphere and Zipkin
Re: [Event time] Do the two podling have interests to hold an event together?
Hi Sheng, +1 from me. Thanks for your suggestion, i think it is great to hold meetup together for two young communities. And i'd like to learn the details more. | | Juan Pan | | panj...@apache.org Juan Pan(Trista), Apache ShardingSphere | Signature is customized by Netease Mail Master On 09/13/2019 23:38, Sheng Wu wrote: Hi DolphinScheduler and ShardingSphere I am being told there is an event of new DolphinScheduler meetup happens soon, 2 months later, I think. Due to these two young communities, do you have interests to host the event together? And set up the talks to attract more potential contributors, which are required at both sides. Pure my personal suggestion, considering I am at both sides. Sheng -- Sheng Wu SkyWalking, Shardingsphere and Zipkin
Re:[DISCUSS] Set up new work flow for ShardingSphere
Hi Sheng, Thanks for your suggestions for ShardingSphere community. After scanning your suggestions, some of pains brought up really exist now, i think. Moreover, sorry, i did. After ShardingSphere entering into incubator, it is growing up quickly, but its growth of community can not keep the same pace with its features, for we put more attention on its functions and features. If we want to make ShardingSphere become better and better, the strength of community is essential. We should become more open-minded and give more trust and time to all the contributors and committers. How and why we need to build an active, open and diverse community is always puzzling me, not just as PPMC of ShardingSphere, but a person who has interest and enthusiasm of Apache community. I think those items seriously, and it is time to take a change, i think. I regret not being able to attend ApacheConn, and communicating with some one of you. :( I also want to listen to others’ voice of setting up a new workflow for ShardingSphere. Best wishes, Trista | | Juan Pan | | panj...@apache.org Juan Pan(Trista), Apache ShardingSphere | 签名由网易邮箱大师定制 On 09/13/2019 13:02，Sheng Wu wrote： Hi ShardingSphere With the one whole week at ApacheCon NA, I finally got time to take with Liang Zhang for a long time(several days) about the community and workflow of ShardingSphere community. First of all, due to our discussion for lower the bar, we have more committers and will have more PPMC. This is a good sign for our community growth. But, I also hope we could do much better than now. It is about the open source workflow, I am aware of that, today most features of ShardingSphere still come from the initial committer team inside JD.com. This is not a bad thing, but I want to involve more contributors in, engage with them, encourage them, and make them feel being a part of the core team, rather than following the contribution guidelines, or do outside supports. (For the core team, I mean the ShardingSphere could trust the workflow, a contributor out of jd.com, could do a core feature change with clear path and accepted by the PPMC) For making the community more open, I suggest 1. Make sure all changes must through pull request, no commit(especially for initial committer) lands on master/dev branch directly. 2. All pull request must be reviewed by at least one committer, and get approvement. Also don't get `request change` from the committer 3. Pull request should be goal clear, small enough to be reviewed. Today, too many huge PR with over 40+ files change, even 1k+ lines. Those are impossible to be reviewed. 4. Pull request should be `squash and merge`, rather than today, the commit log is not controlled, it becomes unreadable and unreasonable. 5. All pull request must have a clear description of why do this change and how. If necessary, provide the design document. ShardingSphere hopes to move fast, it totally makes sense to me, but all actions need to follow open source culture. Being open, understandable and trackable. Not just for codes, but for Issue, Pull Request, Design, Proposal, Review. The core goal of all these suggestions is, make new contributors, existing contributors, and committer out of jd.com team, understand what is happening in the community. One of the most talking about issue is, people are keeping waiting for core team to fix or do a new release, then only use it than contributing to the upstream. The root cause is the path of development is unclear from an individual out of the team. Please feedback about what do you feel about this, and do we want to do this. This is my most wanted change to ShardingSphere before the graduation, in order to make it possible to become an active, open, diversity community. You don't need to agree to me, this is just my feeling. I am away from code contributions to ShardingSphere for a long time, even before joining the incubator and open source happens. So, maybe there is some pain I am not aware of, please bring it up, and talk. Sheng Wu 吴晟 Apache SkyWalking Apache Incubator Apache ShardingSphere, ECharts, DolphinScheduler podlings Zipkin Twitter, wusheng1108
Re: Is it possible that unquoted identifiers are not implicitly converted to upper case
Hi Feng,
You’re right, i get the same result with your suggestion, and either of the
following expressions is ok.
1. properties.put(CalciteConnectionProperty.LEX.camelName(), "MYSQL");
2. properties.put("lex", "MYSQL");
You’re familiar with Calcite :), and thanks for your help and kindness! ☺
Actually, we plan to develop a new feature, and i find Calcite is a great
option to meet our demand.
Thanks Calcite community, and hope two communities can build deeper connection.
P.S
Apache ShardingSphere(Incubator) is an open-source ecosystem consisted of a set
of distributed database middleware solutions.
| |
Juan Pan
|
|
panj...@apache.org
Juan Pan(Trista), Apache ShardingSphere
|
On 09/12/2019 17:32，Feng Zhu wrote：
Hi, Juan Pan:
You may find the logic in *UnregisterDriver#connect(String url, Properties
info)*
It just parses the key-value pairs in url's prefix and adds into the copy
of "info".
Therefore, I think the below config
*properties.put(CalciteConnecti**onProperty.LEX, Lex.MYSQL); *
should be aligned with your first usage:
*properties.put("lex", "MYSQL"); *
Juan Pan 于2019年9月12日周四 下午2:23写道：
Hi Feng,
Thanks for your promote reply. :)
Lex is just what i want. But when i tried to use it, i encountered another
problem.
The first usage is ok, but the second one doesn’t work. ThoughLex are used
in different methods, the result will be same, i think. Do i misunderstand?
Or is the second one wrong usage？
The first usage:
CONNECTION_URL = "jdbc:calcite:lex=MYSQL;model="
try (Connection connection = DriverManager.getConnection(CONNECTION_URL);
Statement statement = connection.createStatement()) {
// do some things
}
The second usage:
CONNECTION_URL = "jdbc:calcite:model="
Properties properties = new Properties();
properties.put(CalciteConnectionProperty.LEX, Lex.MYSQL);
try (Connection connection = DriverManager.getConnection(CONNECTION_URL,
properties);
Statement statement = connection.createStatement()) {
// do some things
}
Thanks again for your kindness, and waiting for u. :)
Regards,
Trista
| |
Juan Pan
|
|
panj...@apache.org
Juan Pan(Trista), Apache ShardingSphere
|
On 09/11/2019 20:23，Feng Zhu wrote：
Hi, JuanPan,
You can refer to Lex, which decides how identifiers are quoted, whether
they are converted to upper-case
org.apache.calcite.config.Lex
Regards
Juan Pan 于2019年9月11日周三 下午8:05写道：
Hi, all the committers and contributors,
This email is for your help.
I am now deep in Apache Calcite, and it’s great. Now, i want to know
whether it is possible that unquoted identifiers are not implicitly
converted to upper case?
For example, a SQL is `select name from test`, when it was executed, an
exception is thrown:
org.apache.calcite.sql.validate.SqlValidatorException: Object 'TEST' not
found within 'memory'; did you mean 'test’?
I wonder there is any setting that can make `name` and `test` recognized
correctly by Calcite without double quotes.
Thanks for your help.
Regards,
Trista
-------
Email：panj...@apache.org
Juan Pan(Trista) Apache ShardingSphere
Re: Is it possible that unquoted identifiers are not implicitly converted to upper case
Hi Feng,
Thanks for your promote reply. :)
Lex is just what i want. But when i tried to use it, i encountered another
problem.
The first usage is ok, but the second one doesn’t work. ThoughLex are used in
different methods, the result will be same, i think. Do i misunderstand? Or is
the second one wrong usage？
The first usage:
CONNECTION_URL = "jdbc:calcite:lex=MYSQL;model="
try (Connection connection = DriverManager.getConnection(CONNECTION_URL);
Statement statement = connection.createStatement()) {
// do some things
}
The second usage:
CONNECTION_URL = "jdbc:calcite:model="
Properties properties = new Properties();
properties.put(CalciteConnectionProperty.LEX, Lex.MYSQL);
try (Connection connection = DriverManager.getConnection(CONNECTION_URL,
properties);
Statement statement = connection.createStatement()) {
// do some things
}
Thanks again for your kindness, and waiting for u. :)
Regards,
Trista
| |
Juan Pan
|
|
panj...@apache.org
Juan Pan(Trista), Apache ShardingSphere
|
On 09/11/2019 20:23，Feng Zhu wrote：
Hi, JuanPan,
You can refer to Lex, which decides how identifiers are quoted, whether
they are converted to upper-case
org.apache.calcite.config.Lex
Regards
Juan Pan 于2019年9月11日周三 下午8:05写道：
Hi, all the committers and contributors,
This email is for your help.
I am now deep in Apache Calcite, and it’s great. Now, i want to know
whether it is possible that unquoted identifiers are not implicitly
converted to upper case?
For example, a SQL is `select name from test`, when it was executed, an
exception is thrown:
org.apache.calcite.sql.validate.SqlValidatorException: Object 'TEST' not
found within 'memory'; did you mean 'test’?
I wonder there is any setting that can make `name` and `test` recognized
correctly by Calcite without double quotes.
Thanks for your help.
Regards,
Trista
---
Email：panj...@apache.org
Juan Pan(Trista) Apache ShardingSphere
Re: Exception when build the Apache SkyWalking project.
Hi Sheng, Thanks for your reply, i got the following result with your useful command. [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 25:50 min [INFO] Finished at: 2019-09-12T10:59:14+08:00 [INFO] ——— This is the first step for doing some contributions, you know. :) Thanks again. Regards, Trista --- Email：panj...@apache.org Juan Pan(Trista) Apache ShardingSphere On 09/11/2019 21:18，Sheng Wu wrote： HI Juan Release means doing Apache release. Due ti you aren't SkyWalking committer yet, should not work out, if you really want to release. Also, from the log, it is a different error, you haven't set up gpg keys, which are required in release process, before upload it to apache maven server. I would recommend you to run at the first time ./mvnw clean install -Pall You could find more in our compiling doc, link is in root readme. Sheng Juan Pan 于2019年9月11日 周三上午12:33写道： Hi, all the committers and contributors, Can i get your help? I cloned SkyWalking and opened it in IDEA, and then chose `apache-release` of all the profiles, and installed it. But i got an exception: Failed to execute goal org.apache.maven.plugins:maven-gpg-plugin:1.6:sign (sign-release-artifacts) on project apm: Unable to execute gpg command: Error while executing process. Cannot run program "gpg": error=2, No such file or directory -> [Help 1] I want to confirm two items. 1. It is ok to choose `apache-release` profile for installing, if not, which profile is appropriate? 2. Is there any setting needed to be configured to avoid this exception? Thanks a lot :) Regards, Trista --- Email：panj...@apache.org Juan Pan(Trista) Apache ShardingSphere -- Sheng Wu SkyWalking, Shardingsphere and Zipkin
Is it possible that unquoted identifiers are not implicitly converted to upper case
Hi, all the committers and contributors, This email is for your help. I am now deep in Apache Calcite, and it’s great. Now, i want to know whether it is possible that unquoted identifiers are not implicitly converted to upper case? For example, a SQL is `select name from test`, when it was executed, an exception is thrown: org.apache.calcite.sql.validate.SqlValidatorException: Object 'TEST' not found within 'memory'; did you mean 'test’? I wonder there is any setting that can make `name` and `test` recognized correctly by Calcite without double quotes. Thanks for your help. Regards, Trista --- Email：panj...@apache.org Juan Pan(Trista) Apache ShardingSphere
Exception when build the Apache SkyWalking project.
Hi, all the committers and contributors, Can i get your help? I cloned SkyWalking and opened it in IDEA, and then chose `apache-release` of all the profiles, and installed it. But i got an exception: Failed to execute goal org.apache.maven.plugins:maven-gpg-plugin:1.6:sign (sign-release-artifacts) on project apm: Unable to execute gpg command: Error while executing process. Cannot run program "gpg": error=2, No such file or directory -> [Help 1] I want to confirm two items. 1. It is ok to choose `apache-release` profile for installing, if not, which profile is appropriate? 2. Is there any setting needed to be configured to avoid this exception? Thanks a lot :) Regards, Trista --- Email：panj...@apache.org Juan Pan(Trista) Apache ShardingSphere
Re: Create table returns error cannot find table rule
Yes, you’re right. The sharding rule is prerequisite before you execute any SQL. - Juan Pan (Trista) Apache ShardingSphere Eric 于2019年9月9日周一 上午5:53写道： > Hi Juan, > > Thank you. > > I think that makes sense because rules are need for the routing even though > the table can be created. Which means the rule has to be setup before > creating tables. > > Regards, > Eric Poon >
Re: Contribution interests, was, [Release is coming] Tests required
Got it, thanks for your explanation, i need some time to learn more about skywalking project. Hope discuss more detail with you. :) | | Juan Pan | | Email：panj...@apache.org Juan Pan(Trista) Apache ShardingSphere | On 09/8/2019 11:12，Sheng Wu wrote： Sorry type Tests in most cases would take so much time. SkyWalking would expect anyone, even PMC members to test all. would -> wouldn't, we would not expect time and would not take much time for sure. Sheng Wu 吴晟 Apache SkyWalking, Apache ShardingSphere(Incubating), Zipkin Twitter, wusheng1108 Sheng Wu 于2019年9月7日周六 下午8:10写道： Hi Juan Tests in most cases would take so much time. SkyWalking would expect any one, even PMC members to test all. You could have your own demo codes, and run SkyWalking in different modes/different storages by considering your available time, then provide feedback. Someone may use quick start to do smoke tests only. :) Don't feel pressured. All these are volunteered based, if you have tests then you checked some parts, which is already a good thing for release and community. Sheng Wu 吴晟 Apache SkyWalking, Apache ShardingSphere(Incubating), Zipkin Twitter, wusheng1108 Juan Pan 于2019年9月7日周六 下午8:06写道： I'd be glad to join in skywalking' community. And now it seems that release 6.4.0 is coming, so i am worried that my slow pace on doing tests will postpone this release, for now i am responsible for distributed transaction project. | | | | Juan Pan | | Email：panj...@apache.org Juan Pan(Trista) Apache ShardingSphere | Signature is customized by Netease Mail Master On 09/08/2019 10:34, Sheng Wu wrote: Juan Pan 于2019年9月7日周六 下午7:33写道： Looking forward to SkyWalking release 6.4.0. :) Welcome to test if you want and have time :) Sheng Wu 吴晟 Apache SkyWalking, Apache ShardingSphere(Incubating), Zipkin Twitter, wusheng1108 ----- Juan Pan (Trista) Apache ShardingSphere Sheng Wu 于2019年9月5日周四 上午12:53写道： Hi Committer Team and contributor SkyWalking 6.4.0 milestone is moving fast. Today, all issues and pull requests in 6.4.0 have been resolved. I am stopping the new pull request merge unless it is related to bug hotfix for 6.4.0. Please begin to test the master branch, and feedback the result or send a pull request to fix the issue. I remind several critical issues needs to be verified before release 1. TTL of ElasticSearch storage should be fixed. 2. Pxx metrics should be back to normal, accurate and p99>=p95>=p90>=p75>=p50 3. UI new features, including new trace view, topology. I think we could do release next week if no critical issue shows up. Sheng Wu 吴晟 Apache SkyWalking, Apache ShardingSphere(Incubating), Zipkin Twitter, wusheng1108
Re: [Release is coming] Tests required
I'd be glad to join in skywalking' community. And now it seems that release 6.4.0 is coming, so i am worried that my slow pace on doing tests will postpone this release, for now i am responsible for distributed transaction project. | | | | Juan Pan | | Email：panj...@apache.org Juan Pan(Trista) Apache ShardingSphere | Signature is customized by Netease Mail Master On 09/08/2019 10:34, Sheng Wu wrote: Juan Pan 于2019年9月7日周六 下午7:33写道： > Looking forward to SkyWalking release 6.4.0. :) > Welcome to test if you want and have time :) Sheng Wu 吴晟 Apache SkyWalking, Apache ShardingSphere(Incubating), Zipkin Twitter, wusheng1108 > - > Juan Pan (Trista) > Apache ShardingSphere > > > Sheng Wu 于2019年9月5日周四 上午12:53写道： > > > Hi Committer Team and contributor > > > > SkyWalking 6.4.0 milestone is moving fast. Today, all issues and pull > > requests in 6.4.0 have been resolved. > > I am stopping the new pull request merge unless it is related to bug > hotfix > > for 6.4.0. > > > > Please begin to test the master branch, and feedback the result or send a > > pull request to fix the issue. > > I remind several critical issues needs to be verified before release > > 1. TTL of ElasticSearch storage should be fixed. > > 2. Pxx metrics should be back to normal, accurate and > > p99>=p95>=p90>=p75>=p50 > > 3. UI new features, including new trace view, topology. > > > > I think we could do release next week if no critical issue shows up. > > > > Sheng Wu 吴晟 > > > > Apache SkyWalking, Apache ShardingSphere(Incubating), Zipkin > > Twitter, wusheng1108 > > >
Re: Multiple SQL units scene
Sorry, i can not get your idea. But when Sharding and multiple tables are existed in one database, it is possible that a SQL is executed in multiple tables in one database. - Juan Pan (Trista) Apache ShardingSphere 厉忠 于2019年9月7日周六 下午2:10写道： > Ask, when executing sql, what scenario will a single data source correspond > to multiple SQL units? > Thank you. >
Re: [Release is coming] Tests required
Looking forward to SkyWalking release 6.4.0. :) - Juan Pan (Trista) Apache ShardingSphere Sheng Wu 于2019年9月5日周四 上午12:53写道： > Hi Committer Team and contributor > > SkyWalking 6.4.0 milestone is moving fast. Today, all issues and pull > requests in 6.4.0 have been resolved. > I am stopping the new pull request merge unless it is related to bug hotfix > for 6.4.0. > > Please begin to test the master branch, and feedback the result or send a > pull request to fix the issue. > I remind several critical issues needs to be verified before release > 1. TTL of ElasticSearch storage should be fixed. > 2. Pxx metrics should be back to normal, accurate and > p99>=p95>=p90>=p75>=p50 > 3. UI new features, including new trace view, topology. > > I think we could do release next week if no critical issue shows up. > > Sheng Wu 吴晟 > > Apache SkyWalking, Apache ShardingSphere(Incubating), Zipkin > Twitter, wusheng1108 >
Re: Talk about how to set committer bar
Agree with William and Sheng. Dynamic and not tight rules will attract more participants to contribute. If he or she can show their commitment to community, we can invite them. Actually, after browsing the Issues and Prs currently in community, i think there are some participants who we can invite as commiters. Hope community will be more prosperous. - Juan Pan (Trista) Apache ShardingSphere zhangli...@apache.org 于2019年9月5日周四 下午9:29写道： > Hi ShardingSphere community, > > There are 64 contributors for ShardingSphere, I want discuss about elected > more committers. > > How to set committer bar? The previous rules can find here[1], they are: > > >1. Make contributions consistently during the past 6 months >2. Understand the core technology of ShardingSphere deeply >3. Obey the Code of Conduct >4. Submit high-quality content >5. Enable Google Two-factor authentication > > The committer bar perhaps too high for new committers, can we define some > new rule to elect more committers? > > [1] https://shardingsphere.apache.org/community/en/contribute/committer/ > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo >
Re: Create table returns error cannot find table rule
Hi, Eric. DDL SQL will be routed to all the databases configured in setting file, please notice, not just all the instances. But the first thing is that you need to create a Sharding rule to tell ShardingSphere which databases tables are created. - Juan Pan (Trista) Apache ShardingSphere Eric 于2019年9月8日周日 上午12:42写道： > Hi, > > I tried following statement, it returned an error "Cannot find table rule > and default data source with logic table: 'test1'". I think ShardingSphere > route DDL statement to all database instances by default? > > Please help. > > create table test1 ( > field1 varchar(40)); > > Best Regards, > Eric Poon >
Re: [DISCUSS] Do we have to resolve issue #2884 in 4.0.0-RC2
Ok, so that we can have more time to take care of it, and yesterday one volunteer also showed interest on it. So i think fixing it in our next version is better. - Juan Pan (Trista) Apache ShardingSphere Zhang Yonglun 于2019年8月21日周三 上午10:58写道： > Hi, > > I think this issue ( > https://github.com/apache/incubator-shardingsphere/issues/2884) is not a > serious or block bug. What's your opinion on this? I suggest to resolve > this problem in the next release. > > -- > Zhang Yonglun > Apache ShardingSphere >
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0-RC2 [ROUND 4]
+1 The following checking items have been done. [X] Download links are valid. [X] Checksums and PGP signatures are valid. [X] DISCLAIMER is included. [X] Source code artifacts have correct names matching the current release. [X] LICENSE and NOTICE files are correct for each ShardingSphere repo. [X] All files have license headers if necessary. [X] No compiled archives bundled in source archive. - Juan Pan (Trista) Apache ShardingSphere Zhang Yonglun 于2019年8月17日周六 下午3:44写道： > Hello ShardingSphere Community, > > This is a call for vote to release Apache ShardingSphere (Incubating) > version 4.0.0-RC2 > > Release notes: > > https://github.com/apache/incubator-shardingsphere/blob/dev/RELEASE-NOTES.md > > The release candidates: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0-RC2/ > > Maven 2 staging repository: > > https://repository.apache.org/content/repositories/staging/org/apache/shardingsphere/ > > Git tag for the release: > https://github.com/apache/incubator-shardingsphere/tree/4.0.0-RC2 > > Release Commit ID: > > https://github.com/apache/incubator-shardingsphere/commit/85f2ff877a7aaf122998964a0d03f7c9b2830e36 > > Keys to verify the Release Candidate: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS > GPG username: zhangyonglun > > Look at here for how to verify this release candidate: > https://shardingsphere.apache.org/community/en/contribute/release/ > > The vote will be open for at least 72 hours or until necessary number of > votes are reached. > > Please vote accordingly: > > [ ] +1 approve > > [ ] +0 no opinion > > [ ] -1 disapprove with the reason > > Checklist for reference: > > [ ] Download links are valid. > > [ ] Checksums and PGP signatures are valid. > > [ ] DISCLAIMER is included. > > [ ] Source code artifacts have correct names matching the current release. > > [ ] LICENSE and NOTICE files are correct for each ShardingSphere repo. > > [ ] All files have license headers if necessary. > > [ ] No compiled archives bundled in source archive. > > -- > Zhang Yonglun > Apache ShardingSphere >
Re: Re:Re:[DISCUSS] Apache ShardingSphere (Incubating) 4.0.0-RC2 release [ROUND 4]
The issue[1] mentioned by Sion Yang has been fixed already, please check the Pr[2]. [1] https://github.com/apache/incubator-shardingsphere/issues/2883 [2] https://github.com/apache/incubator-shardingsphere/pull/2886 - Juan Pan (Trista) Apache ShardingSphere Sion Yang 于2019年8月16日周五 下午5:17写道： > These two issues can reproduce in > apache/incubator-shardingsphere-example[1]. > And I also open issue in GitHub[2][3]. > > > [1] https://github.com/apache/incubator-shardingsphere-example > [2] https://github.com/apache/incubator-shardingsphere/issues/2883 > [3] https://github.com/apache/incubator-shardingsphere/issues/2884 > > > -- > > Yi Yang(Sion) > Apache ShardingSphere > > > > At 2019-08-16 17:09:48, "Sion Yang" wrote: > >There are another issue[1] for encrypt in 4.0.0-RC2. > >Encrypt may replace table name with column so that the column in SQL > become `column.column`. > > > > > >[1] https://github.com/apache/incubator-shardingsphere/issues/2883 > > > > > >-- > > > >Yi Yang(Sion) > >Apache ShardingSphere > > > > > > > >At 2019-08-13 18:38:13, "Sion Yang" wrote: > >>I execute all examples. Most of examples execute successfully except > encrypt in JPA with SpringBoot. > >>The bug has marked `TODO` in example, and only affects part of encrypt. > >>So i think we can continue to prepare our version 4.0.0-RC2. > >> > >> > >>-- > >> > >>Yi Yang(Sion) > >>Apache ShardingSphere > >> > >> > >> > >>At 2019-08-09 18:46:33, "Zhang Yonglun" wrote: > >>>Hello ShardingSphere Community, > >>> > >>>This is a call for the 4th round of discussion to release Apache > >>>ShardingSphere (Incubating) version 4.0.0-RC2 > >>> > >>>Release notes: > >>> > https://github.com/apache/incubator-shardingsphere/releases/edit/untagged-08931c6025e028ee428c > >>> > >>>Git branch for the release: > >>>The dev branch of ShardingSphere( > >>>https://github.com/apache/incubator-shardingsphere.git) > >>> > >>>We have fixed all know serious issues found during the integration > test. So > >>>the dev branch is ready for discussion. > >>> > >>>Anyone who is interested can do this acceptance test and discuss whether > >>>this version should be released or not. > >>> > >>>-- > >>>Zhang Yonglun > >>>Apache ShardingSphere >
Re: [DISCUSS] Apache ShardingSphere (Incubating) 4.0.0-RC2 release [ROUND 4]
Today, i ran some tests, and a bug of wrong rewritten SQL for `INSERT` in multiple threads appeared. Now this bug has been fixed already. It is not a big deal, so i think we can continue to prepare our version 4.0.0-RC2. - Juan Pan (Trista) Apache ShardingSphere Zhang Yonglun 于2019年8月9日周五 下午6:46写道： > Hello ShardingSphere Community, > > This is a call for the 4th round of discussion to release Apache > ShardingSphere (Incubating) version 4.0.0-RC2 > > Release notes: > > https://github.com/apache/incubator-shardingsphere/releases/edit/untagged-08931c6025e028ee428c > > Git branch for the release: > The dev branch of ShardingSphere( > https://github.com/apache/incubator-shardingsphere.git) > > We have fixed all know serious issues found during the integration test. So > the dev branch is ready for discussion. > > Anyone who is interested can do this acceptance test and discuss whether > this version should be released or not. > > -- > Zhang Yonglun > Apache ShardingSphere >
Re: [DISCUSS] Apache ShardingSphere (Incubating) 4.0.0-RC2 release [ROUND 3]
Moreover, now i have already finished the modification of new APIs and new features for Encryption module. Considering the modification of APIs, does anyone think it is better to add this modification to our 4.0.0.RC2? - Juan Pan (Trista) Apache ShardingSphere Zhang Yonglun 于2019年7月24日周三 下午5:36写道： > Hello ShardingSphere Community, > > This is a call for the 3rd round of discussion to release Apache > ShardingSphere (Incubating) version 4.0.0-RC2 > > Release notes: > > https://github.com/apache/incubator-shardingsphere/releases/tag/untagged-60c0a6418d73359e801e > > The release candidates: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0-RC2/ > > Maven 2 staging repository: > > https://repository.apache.org/content/repositories/staging/org/apache/shardingsphere/ > > Git tag for the release: > https://github.com/apache/incubator-shardingsphere/tree/4.0.0-RC2 > > Release Commit ID: > > https://github.com/apache/incubator-shardingsphere/commit/1014b760ec22419441fae1c26df36f813cf3026d > > Keys to verify the Release Candidate: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS > GPG username: zhangyonglun > > Checklist: > https://shardingsphere.apache.org/community/en/contribute/release/ > > Anyone who is interested can do this acceptance test and discuss whether > this version should be released or not. > > -- > Zhang Yonglun > Apache ShardingSphere >
Re: 加入dev邮件列表
Please refer to Subscribe Guide, i.e. https://shardingsphere.apache.org/community/en/contribute/subscribe/ - Juan Pan (Trista) Apache ShardingSphere kys sion <1409915...@qq.com> 于2019年7月16日周二 下午4:21写道： > 您好啊 > > 请问我可以加入dev邮件列表吗?大家一起讨论让这个框架变成apache顶级项目:-) > > > >
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0-RC2 [ROUND 2]
+1 approve, the following items are ok: [X] Download links are valid. [X] Checksums and PGP signatures are valid. [X] DISCLAIMER is included. [X] Source code artifacts have correct names matching the current release. [X] LICENSE and NOTICE files are correct for each ShardingSphere repo. [X] All files have license headers if necessary. [X] No compiled archives bundled in source archive. - Juan Pan (Trista) Apache ShardingSphere Zhang Yonglun 于2019年7月15日周一 下午4:11写道： > Hello ShardingSphere Community, > > This is a call for vote to release Apache ShardingSphere (Incubating) > version 4.0.0-RC2 > > Release notes: > > https://github.com/apache/incubator-shardingsphere/releases/tag/untagged-60c0a6418d73359e801e > > The release candidates: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0-RC2/ > > Maven 2 staging repository: > > https://repository.apache.org/content/repositories/staging/org/apache/shardingsphere/ > > Git tag for the release: > https://github.com/apache/incubator-shardingsphere/tree/4.0.0-RC2 > > Release Commit ID: > > https://github.com/apache/incubator-shardingsphere/commit/5b4fa38b9237e8885c823dd92b4b42d1285c4c48 > > Keys to verify the Release Candidate: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS > GPG username: zhangyonglun > > Look at here for how to verify this release candidate: > https://shardingsphere.apache.org/community/en/contribute/release/ > > The vote will be open for at least 72 hours or until necessary number of > votes are reached. > > Please vote accordingly: > > [ ] +1 approve > > [ ] +0 no opinion > > [ ] -1 disapprove with the reason > > Checklist for reference: > > [ ] Download links are valid. > > [ ] Checksums and PGP signatures are valid. > > [ ] DISCLAIMER is included. > > [ ] Source code artifacts have correct names matching the current release. > > [ ] LICENSE and NOTICE files are correct for each ShardingSphere repo. > > [ ] All files have license headers if necessary. > > [ ] No compiled archives bundled in source archive. > > -- > Zhang Yonglun > Apache ShardingSphere >
Re: [DISCUSS] Apache ShardingSphere (Incubating) 4.0.0-RC2 release [ROUND 1]
I give more attention and tests to Sharding-JDBC, and i think main feature tests for this version is ok, so we can continue to do release. - Juan Pan (Trista) Apache ShardingSphere Zhang Yonglun 于2019年6月27日周四 下午3:54写道： > Hello ShardingSphere Community, > > This is a call for the 1th round of discussion to release Apache > ShardingSphere > (Incubating) version 4.0.0-RC2 > > Release notes: > > https://github.com/apache/incubator-shardingsphere/releases/tag/untagged-60c0a6418d73359e801e > > > The release candidates: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0-RC2/ > > Maven 2 staging repository: > > https://repository.apache.org/content/repositories/staging/org/apache/shardingsphere/ > < > https://repository.apache.org/content/repositories/staging/org/apache/shardingsphere/ > > > > Git tag for the release: > https://github.com/apache/incubator-shardingsphere/tree/4.0.0-RC2 > > Release Commit ID: > > https://github.com/apache/incubator-shardingsphere/commit/7befe25afee89ab8408b8c8ed50384f1c94e2a4e > > > Keys to verify the Release Candidate: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS > GPG username: zhangyonglun > > Checklist: > https://shardingsphere.apache.org/community/en/contribute/release/ > > Anyone who is interested can do this acceptance test and discuss whether > this version should be released or not. > > -- > Zhang Yonglun > Apache ShardingSphere >
Re: How the sharding works when no sharding key defined
Hi, Eric. Thanks for your attention. 1) Sharding is also applied on records update, insert, delete, truncate, etc. ShardingSphere will handle records by using the sharding rule. For example, when execute `UPDATE tableName SET...Where id =1`, ShardingSphere will only update the record of id = 1 in odd number database. 2) Firstly, On the condition that sharding rules defined on the primary key (although sharding key and primary key can be different), you can tell ShardingSphere by using settings that you want to have global automatically ID as primary key, then ShardingSphere will generate global ID and put it into INSERT SQL, then this record will be inserted into correct database and table. But for you, when write INSERT SQL, you can ignore to set primary key. Secondly, if you do not configure global automatically ID as primary key in sharding rule and want to use the key automatically generated by database, as you said, ShardingSphere can not know the key beforehand in the SQL, finally all the databases will have those records. 3) Firstly, If a table has not sharding rule defined but all databases have the complete records, we suggest you can configure this table as `broadcastTable` in configuration. As a table is broadcastTable, when `SELECT FROM broadcastTable`, this query will be executed in random one of databases; when `DELETE/UPDATE/INSERT` in broadcastTable, SQLs will be broadcasted and executed in all the databases. Secondly, If a table has not sharding rule defined, and is not a `broadcastTable`, but you configure a `default datasource`, ShardingSphere will send all SQLs of this table to default datasource. Finally, if a table has not sharding rule defined, and is not a `broadcastTable`, and there is no `default datasource`, it will throw a routing exception, for it does not know where this query should be sent. 4) One one hand, you can configure `default datasource` in sharding rule, so it will throw all SQLs to this default datasource, which is called sharding scenario. On the other hand, If you just want to load balance, please configure two or more databases, and tell ShardingSphere which one is master database and slave databases, and it will choose one database randomly to route your SQLs, which is called master-slave scenario. Two of scenarios are supported in ShardingSphere. - Juan Pan (Trista) Apache ShardingSphere Eric 于2019年6月29日周六 上午5:30写道： > Hi, > > I am exploring the Sharding Sphere. I may have misunderstanding on the > concepts. Very appreciated for your help on following questions. > > 1) Is sharding also applied on records update and insert? For example, the > table sharding rules define even and odd numbers records on two different > databases. When updating or inserting records, are these records updated > and inserted on both databases? > > 2) If sharding also applied on records update and insert, if there are > sharding rules defined on the primary key of a table but the key is > automatically generated by database, inserting a new record would not know > the key beforehand in the SQL Would this record inserted in all the > databases or the database defined by the table sharding rule? > > 3) If a table has not sharding rule defined but all databases have the > complete records, which database will execute the query on this table? > > 4) Can we define default rules when there is no sharding rule matched route > the query randomly to a database like simple load balancing? > > Best Regards, > Eric Poon >
Re: [DISCUSS] The scope of Sharding-Sphere 4.0.0-RC2 release
Here are some of important issues i solved, we can consider to add them to RC2 release note. New Feature 1.User can do data masking by using ShardingProxy(#2443). 2.User can use Leaf-segment generator to get distributed ID(#1775). API 1.Delete API and configuration item of sharding logicIndex(#2464). Optimization 1.Renew modified dataSources, not all the datasources to improve performance for configuration orchestration(#1427). Module Refactoring 1.The Refactoring of SQL rewriting module(#2275). Bug Fix 1.Fix wrong SQL rewriting for `Create/Alter/Drop index` with indexName quoted with quoteCharacters(#2312). 2.Fix NullPointerException when append generated-key value for `INSERT` statement(#2252). References: https://github.com/apache/incubator-shardingsphere/issues/2443 https://github.com/apache/incubator-shardingsphere/issues/1775 https://github.com/apache/incubator-shardingsphere/issues/2464 https://github.com/apache/incubator-shardingsphere/issues/1427 https://github.com/apache/incubator-shardingsphere/issues/2275 https://github.com/apache/incubator-shardingsphere/issues/2312 https://github.com/apache/incubator-shardingsphere/issues/2252 - Juan Pan (Trista) Apache ShardingSphere Zhang Yonglun 于2019年6月13日周四 下午12:32写道： > [1] > > https://github.com/apache/incubator-shardingsphere/issues?q=is%3Aissue+is%3Aclosed+milestone%3A4.0.0.M2 > [2] https://github.com/seata/seata > > Zhang Yonglun 于2019年6月13日周四 下午12:30写道： > > > Hi, > > > > I'll be the release manager of Sharding-Sphere 4.0.0-RC2. So many > > issues[1] resolved after 4.0.0-RC1, it's not necessary to include them > all > > in release note. > > > > In my opinion, there are 4 main features which should be appear in the > > release note: > > 1. The parse engine upgrade from the 2nd generation to 3rd. > > 2. Integration of Seata[2] for distributed transaction. > > 3. OpenShardingUI administration console. > > 4. Support Skywalking plugin for application performance management. > > > > For now, the OpenShardingUI haven't been merged into ShardingSphere. I am > > not sure whether we should include it in the new release. Any > suggestions? > > > > -- > > Zhang Yonglun > > Apache ShardingSphere > > > > > -- > Zhang Yonglun > Apache ShardingSphere >
Re: Talk about opportunity to upgrade Java version form 7 to 8 on ShardingSphere
We can enjoy the new feature of JDK 8, and as Sheng Wu said, updating to JDK 8 is not difficult. After we listen to voices of SharingSphere community, i think it is better to upgrade. My +1 to upgrade. - Juan Pan (Trista) Apache ShardingSphere zhangli...@apache.org 于2019年5月30日周四 下午2:48写道： > Hi, > > JDK 7 is deprecated for long time by official, more and more applications > are using JDK 8 as their Java compile environment. > > Some dependencies of ShardingSphere are using JDK 8 also, such as Etcd, > ServiceComb, Seata and new version of Guava, so I plan upgrade to JDK 8 > after 4.0.0 stable version released. > > For ShardingSphere 4.0.0, we are still using JDK7, and switch to JDK 8 for > 4.1.x version of ShardingSphere. > > Any suggestions? > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo >
Re: [VOTE]: Release Apache ShardingSphere (Incubating) 4.0.0-RC1 [ROUND 3]
+1 approve - Juan Pan (Trista) Apache ShardingSphere zhangli...@apache.org 于2019年4月13日周六 上午1:57写道： > Hello ShardingSphere Community, > > This is a call for vote to release Apache ShardingSphere (Incubating) > version 4.0.0-RC1 > > Release notes: > > https://github.com/apache/incubator-shardingsphere/releases/tag/untagged-d5d2dc137c82994bbaac > > The release candidates: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0-RC1/ > > Maven 2 staging repository: > > https://repository.apache.org/content/repositories/staging/org/apache/shardingsphere/ > > Git tag for the release: > https://github.com/apache/incubator-shardingsphere/tree/4.0.0-RC1 > > Release Commit ID: > > https://github.com/apache/incubator-shardingsphere/commit/2c1d23f9569e5cbe74074a578931c77dfa800800 > > Keys to verify the Release Candidate: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS > > Look at here for how to verify this release candidate: > https://shardingsphere.apache.org/community/en/contribute/release/ > > The vote will be open for at least 72 hours or until necessary number of > votes are reached. > > Please vote accordingly: > > [ ] +1 approve > > [ ] +0 no opinion > > [ ] -1 disapprove with the reason > > Checklist for reference: > > [ ] Download links are valid. > > [ ] Checksums and PGP signatures are valid. > > [ ] DISCLAIMER is included. > > [ ] Source code artifacts have correct names matching the current release. > > [ ] LICENSE and NOTICE files are correct for each ShardingSphere repo. > > [ ] All files have license headers if necessary. > > [ ] No compiled archives bundled in source archive. > > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo >
Re: Release votes
Hello, everyone Our release vote template has been updated already, please visit [1] to learn more. Thanks for your attention. - [1] https://shardingsphere.apache.org/community/en/contribute/release/ - Juan Pan (Trista) Apache ShardingSphere zhangli...@apache.org 于2019年4月5日周五 下午6:01写道： > +1 for Craig's suggestion. > > Right now the release guide is in [1], it include release vote template. > We can update our release vote template, and make sure every vote need > finish the checklist. > > [1] https://shardingsphere.apache.org/community/en/contribute/release/ > > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo > > > 吴晟 Sheng Wu 于2019年4月5日周五 上午11:18写道： > > > Hi > > > > > > +1 for Craig's suggestion. > > > > > > ShardingSphere community release vote should follow this way. > > In SkyWalking release vote, I think most PPMC provided their checked > list. > > > > > > -- > > Sheng Wu > > Apache SkyWalking, ShardingSphere, Zipkin > > Twitter, wusheng1108 > > > > > > > > > > > > > > > > -- Original -- > > From: "apache.clr"; > > Date: Fri, Apr 5, 2019 10:56 AM > > To: "dev"; > > > > Subject: Re: Release votes > > > > > > > > Sorry, totally forgot the link > > > > > > > https://lists.apache.org/thread.html/c891eb5543559d8894974ea39b11001e4302c1e3b0f11e47323af929@%3Cdev.openwhisk.apache.org%3E > > > > > > > On Apr 4, 2019, at 4:09 PM, Craig Russell > wrote: > > > > > > Hi, > > > > > > I'd like you to take a look at this release vote by OpenWhisk. In > > particular, the call for a vote has a checklist that the reviewers are > > expected to look at. > > > > > > The reviewers itemize which checklist items that they actually checked. > > > > > > This is a model for release votes in the podling community. Let's see > if > > we can do the same here. > > > > > > I've seen recent podling votes in which most of the votes were simple > > +1. Let's not do that. > > > > > > Craig > > > > > > Craig Russell > > > Member, Apache Incubator PMC > > > apache@gmail.com > > > > > > > > > > > > > Craig Russell > > Member, Apache Incubator PMC > > apache@gmail.com >
Re: [Feature Enhancement] Provide Spring Configuration method to use the feature of Data Masking
Thanks for your reply. I just consider to provide different configuration modes for users to use data masking feature. Here[1] is the difference between Java code and spring configuration. - [1] https://shardingsphere.apache.org/document/current/en/manual/sharding-jdbc/usage/encrypt/ - Juan Pan (Trista) Apache ShardingSphere guangyuan wang 于2019年4月1日周一 下午8:36写道： > It is a good idea to provide another way to configure data masking. Could > you explain more clearly about the difference between Java code and spring > configuration. > Does spring configuration like class with @Configuration? > > juan pan 于2019年4月1日周一 下午7:00写道： > > > Hi, everyone. > > > > This email is to discuss to schedule to provide Spring configuration > method > > for the dataSource of Data masking. > > > > *Current Situation* > > > > * ShardingSphere can provide Java code and Yaml file for users to use the > > feature of data masking. > > * The feature of data masking is in the process of pressure test. > > > > *Plan* > > > > In 4.0.0-RC2-SNAPSHOT, it is necessary to provide Spring configuration > > method to use the feature of Data masking, for a lot of business projects > > start up by Spring framework. > > > > The main Spring frameworks needed to consider: > > > > - [ ] Spring Boot > > - [ ] Spring Namespace > > > > > > Now we are preparing for our first Apache version release which is very > > important for us. Hope everything goes well. > > > > If you have any suggestion, please let us know. > > > > Thanks. > > > > - > > Juan Pan (Trista) > > Apache ShardingSphere > > >
[Feature Enhancement] Provide Spring Configuration method to use the feature of Data Masking
Hi, everyone. This email is to discuss to schedule to provide Spring configuration method for the dataSource of Data masking. *Current Situation* * ShardingSphere can provide Java code and Yaml file for users to use the feature of data masking. * The feature of data masking is in the process of pressure test. *Plan* In 4.0.0-RC2-SNAPSHOT, it is necessary to provide Spring configuration method to use the feature of Data masking, for a lot of business projects start up by Spring framework. The main Spring frameworks needed to consider: - [ ] Spring Boot - [ ] Spring Namespace Now we are preparing for our first Apache version release which is very important for us. Hope everything goes well. If you have any suggestion, please let us know. Thanks. - Juan Pan (Trista) Apache ShardingSphere
Re: [DISCUSS] ShardingSphere 4.0.0-RC1 release [ROUND 2]
After my items-checking, i think it is time for our 4.0.0-RC1 release. Here are my checked items, Feature check 1. DISTINCT SQL syntax available. 2. Data encrypt available. 3. All SQL 100% compatible if route to single data node (MySQL Only). Release check 1. sha512 hash. 2. gpg Signature. 3. Items for source package. 4. Items for binary packages. - Juan Pan (Trista) Apache ShardingSphere zhangli...@apache.org 于2019年3月29日周五 下午2:58写道： > Hello ShardingSphere Community, > > This is a call for 2 round of discuss to release Apache ShardingSphere > (Incubating) version 4.0.0-RC1 > > Release notes: > * > https://github.com/apache/incubator-shardingsphere/releases/tag/untagged-a7276f4b3f5fb99f2c2b > < > https://github.com/apache/incubator-shardingsphere/releases/tag/untagged-a7276f4b3f5fb99f2c2b > >* > > The release candidates: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0-RC1/ > > Maven 2 staging repository: > > https://repository.apache.org/content/repositories/staging/org/apache/shardingsphere/ > > Git tag for the release: > https://github.com/apache/incubator-shardingsphere/tree/4.0.0-RC1 > > Release Commit ID: > * > https://github.com/apache/incubator-shardingsphere/commit/709b5f58793be11e19309b59554ad5f7df19f9e0 > < > https://github.com/apache/incubator-shardingsphere/commit/709b5f58793be11e19309b59554ad5f7df19f9e0 > >* > > Keys to verify the Release Candidate: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS > > Checklist: > https://shardingsphere.apache.org/community/en/contribute/release/ > > Every who inserted can be do acceptance test and discuss this version > should be release or not. > > The first discussion and result is in threads [1] and [2]. > [1] > > https://lists.apache.org/thread.html/953e8d42e7106d4d5dd29f61ece6c10c8210a9c48232c7fb90484851@%3Cdev.shardingsphere.apache.org%3E > [2] https://lists.apache.org/thread.html/2099ff699a427565f978b9f020ffa2 > < > https://lists.apache.org/thread.html/2099ff699a427565f978b9f020ffa289c001acea62642408b95b0203@%3Cdev.shardingsphere.apache.org%3E > > > > > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo >
Re: Re: [Discuss] Acceptance test for ShardingSphere 4.0.0 [RC1] release
+1 I think we can do this version release, hope everything will go well. - Juan Pan (Trista) Apache ShardingSphere zhangli...@apache.org 于2019年3月27日周三 上午11:34写道： > I summarize the issues we received on this thread: > > 1. PR for [1], missing some licenses, already merged. > 2. Sharding-proxy can’t run for lacking of some jars, reason is from OS > file path setting, not ShardingSphere issue. > 3. Navicat premium 12 connect sharding-proxy using MySQL protocol, it > connected but no database. Fixed at PR[2]. > 4. Some DISTINCT SQL loses data, submit a issue[3] and make sure it is not > a blocking issue. > 5. Compile error by guangyuan wang, caused by his environment. Travis can > compile success, FYI[4] > > All blocking issues are resolved and some unblocking issue are recorded, > will fix next version. > So can we do release now? Any suggestion? > > [1] https://github.com/apache/incubator-shardingsphere/pull/2078 > [2] https://github.com/apache/incubator-shardingsphere/pull/2102 > [3] https://github.com/apache/incubator-shardingsphere/issues/2094 > [4]https://travis-ci.org/apache/incubator-shardingsphere > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo > > > > zhangli...@apache.org 于2019年3月27日周三 上午11:24写道： > > > Hi guangyuan wang, > > > > This is caused by your environment. Please check travis : > > https://travis-ci.org/apache/incubator-shardingsphere get more details. > > > > > > -- > > > > Liang Zhang (John) > > Apache ShardingSphere & Dubbo > > > > > > guangyuan wang 于2019年3月27日周三 上午11:19写道： > > > >> After executed "mvn clean install",it shows: > >> [ERROR] Failed to execute goal on project sharding-core-parse-mysql: > Could > >> not resolve dependencies for project > >> org.apache.shardingsphere:sharding-core-parse-mysql:jar:4.0.0-RC1: > Failed > >> to collect dependencies at > >> org.apache.shardingsphere:sharding-core-parse-spi:jar:4.0.0-RC1: Failed > to > >> read artifact descriptor for > >> org.apache.shardingsphere:sharding-core-parse-spi:jar:4.0.0-RC1: Failure > >> to > >> find org.apache.shardingsphere:sharding-core:pom:4.0.0-RC1 in > >> https://repo.maven.apache.org/maven2 was cached in the local > repository, > >> resolution will not be reattempted until the update interval of central > >> has > >> elapsed or updates are forced -> [Help 1] > >> > >> > >> duhongjun 于2019年3月26日周二 下午4:29写道： > >> > >> > use antlr parse SQL statement, Lexer and Parser class are generated by > >> > antlr maven plugin > >> > execute mvn clean install in sharding-core-parse-mysql project or > >> parent > >> > project > >> > after execute command successfully，the source code is generated in > >> > target/generated-sources/antlr4 directory > >> > > >> > > >> > > >> > > >> > > >> > -- > >> > > >> > - > >> > > >> > HongJun Du > >> > Apache ShardingSphere > >> > > >> > > >> > > >> > At 2019-03-26 14:14:07, "guangyuan wang" wrote: > >> > >Please see org.apache.shardingsphere.core.parse.H2ShardingParseEngine > >> > class > >> > >in 4.0.0 RC1 source code. > >> > > > >> > >In IntelliJ IDEA shows : Missing > >> > org.apache.shardingsphere.core.parse.antlr. > >> > >autogen.MySQLStatementLexer. > >> > > > >> > >After checked,I found MySQLStatementLexer.class does not exist in the > >> > >source code. > >> > > > >> > >On 2019/03/25 03:02:16, "z...@apache.org" wrote: > >> > >> Hello ShardingSphere Community,> > >> > >> > >> > >> This is a call for discuss to release Apache ShardingSphere > >> > (Incubating)> > >> > >> version 4.0.0-RC1> > >> > >> > >> > >> Release notes:> > >> > >> > >> > > > >> > > >> > https://github.com/apache/incubator-shardingsphere/releases/edit/untagged-90bdf1e5cbba8422332f > >> > > > >> > > > >> > >> > >> > >> The release candidates:> > >> > >> > >> > > >> > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0-RC1/ > >> > > > >> > > > >> > >> > >> > >> Maven 2 staging repository:> > >> > >> > >> > > > >> > > >> > https://repository.apache.org/content/repositories/staging/org/apache/shardingsphere/ > >> > > > >> > > > >> > >> > >> > >> Git tag for the release:> > >> > >> https://github.com/apache/incubator-shardingsphere/tree/4.0.0-RC1> > >> > >> > >> > >> Release Commit ID:> > >> > >> > >> > > > >> > > >> > https://github.com/apache/incubator-shardingsphere/commit/90a17fd3ac5af99d0fe1bd8018ba1393b1864672 > >> > > > >> > > > >> > >> > >> > >> Keys to verify the Release Candidate:> > >> > >> > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS > >> > > >> > >> > >> > >> Every who inserted can be do acceptance test and discuss this > >> version> > >> > >> should be release or not.> > >> > >> > >> > >> --> > >> > >> > >> > >> Liang Zhang (John)> > >> > >> Apache ShardingSphere & Dubbo> > >> > >> > >> > > >> > > >
Re: [Discuss] Acceptance test for ShardingSphere 4.0.0 [RC1] release
I give more attention to the following items, for i participated in developing those new features. 1. DISTINCT SQL syntax available. 2. Data encrypt available. After testing for those features, i think it is ok for this version release. - Juan Pan (Trista) Apache ShardingSphere zhangli...@apache.org 于2019年3月25日周一 上午11:02写道： > Hello ShardingSphere Community, > > This is a call for discuss to release Apache ShardingSphere (Incubating) > version 4.0.0-RC1 > > Release notes: > > https://github.com/apache/incubator-shardingsphere/releases/edit/untagged-90bdf1e5cbba8422332f > > The release candidates: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0-RC1/ > > Maven 2 staging repository: > > https://repository.apache.org/content/repositories/staging/org/apache/shardingsphere/ > > Git tag for the release: > https://github.com/apache/incubator-shardingsphere/tree/4.0.0-RC1 > > Release Commit ID: > > https://github.com/apache/incubator-shardingsphere/commit/90a17fd3ac5af99d0fe1bd8018ba1393b1864672 > > Keys to verify the Release Candidate: > https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS > > Every who inserted can be do acceptance test and discuss this version > should be release or not. > > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo >
Re: [VOTE] Recommend 'Apache SkyWalking graduation to Top Level Project' resolution to board
+1 no binding Best Regards! - Juan Pan (Trista) Apache ShardingSphere On 2019/03/19 05:21:41, "Mick Semb Wever" wrote: > > > After the latest discussion amongst this dev community on this dev mailing > list[1], presenting Sheng Wu as the PMC Chair and the maturity model[2], and > then the discussion again on the incubator list[3], a vote for Apache > SkyWalking graduating to a top level project was called and has passed[4]. > From the past incubator discussions the PPMC altered the draft graduation > proposal, specifically the proposed PMC list: removing some inactive people > and adding all the podling Committers. > > > > Apache SkyWalking entered the incubator on December of 2017. SkyWalking has > delivered 8 releases so far in total, and now shows a good cadence of > successful releases.> > > During the podling's time in the Apache Incubator there has been> > 3200+ commits on development of the project,> > 378 Issues tagged as question in GitHub created, 373 resolved,> > 850+ Pull request created and resolved,> > 97 different contributors,> > 9 elected new committers, and> > 3 elected new PPMC members.> > > And the dev ML has had 72 participants: > https://lists.apache.org/trends.html?d...@skywalking.apache.org:2019> > > Attached is the draft Resolution for the PPMC and IPMC to vote upon.> > > Please take a minute to vote on whether or not Apache SkyWalking should> > graduate to a Top Level Project by responding with one of the following:> > > [ ] +1 Apache SkyWalking should graduate.> > [ ] +0 No opinion> > [ ] -1 Apache SkyWalking should not graduate (please provide the reason)> > > The VOTE is open for a minimum of 72 hours. As there has been previous > discussions on past versions of this proposal, I have not preluded the vote > with a DISCUSS email. If feedback arises the vote period will be extended in > good faith.> > > regards,> > Mick> > > > [1] > https://lists.apache.org/thread.html/9aab116a5df46d10a655bbf243f525260bad7763f6f65bce19ec33bd@%3Cdev.skywalking.apache.org%3E> > > [2] > https://cwiki.apache.org/confluence/display/SKYWALKING/Apache+Maturity+Model+Assessment+for+SkyWalking> > > [3] > https://lists.apache.org/thread.html/68b06b2efdcd4f519cd9aa3df55d46bf0dade28002065fbad75d4195@%3Cdev.skywalking.apache.org%3E> > > [4] > https://lists.apache.org/thread.html/9f05862dffb40a967f867ba0fee4ab8549b08736cde27571e303ab30@%3Cdev.skywalking.apache.org%3E> > > > > > > > Establish the Apache SkyWalking Project> > > WHEREAS, the Board of Directors deems it to be in the best interests of> > the Foundation and consistent with the Foundation's purpose to establish> > a Project Management Committee charged with the creation and maintenance> > of open-source software, for distribution at no charge to the public,> > related to application performance management and monitoring (APM).> > > NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee> > (PMC), to be known as the "Apache SkyWalking Project", be and hereby is> > established pursuant to Bylaws of the Foundation; and be it further> > > RESOLVED, that the Apache SkyWalking Project be and hereby is> > responsible for the creation and maintenance of software related to> > application performance management and monitoring (APM); and > > be it further> > > RESOLVED, that the office of "Vice President, Apache SkyWalking" be and> > hereby is created, the person holding such office to serve at the> > direction of the Board of Directors as the chair of the Apache> > SkyWalking Project, and to have primary responsibility for management of> > the projects within the scope of responsibility of the Apache SkyWalking> > Project; and be it further> > > RESOLVED, that the persons listed immediately below be and hereby are> > appointed to serve as the initial members of the Apache SkyWalking> > Project:> > > * Haoyang Liu (刘浩杨) > > * Hongtao Gao (高洪涛) > > * Ignasi Barrera > > * Mick Semb Wever > > * Sheng Wu (吴晟) > > * Shinn Zhang (张鑫) > > * Willem Ning Jiang (姜宁)> > * Yongsheng Peng (彭勇升) > > * DongXue Si (司冬雪)> > * Jian Tan (谭建) > > * Kai Wang (王凯) > > * Yang Bai (柏杨)
[New feature] Independent encryptedDataSource to decrypt or encrypt sensitive data.
Hi, everyone, This new feature development plan needs your advice. It is to create independent encrypted DataSource which can encrypt sensitive information, e.g, password or ID to store them in database, and decrypt ciphertext in database for queries. By using encrypted DataSource, you can encrypt or decrypt sensitive data in aboriginal JAVA coding way. Here are the main tasks: - [ ] SQL parsing for sensitive columns - [ ] SQL rewriting for sensitive columns - [ ] SQL executing with encrypt DataSource - [ ] SQL resultSet creating - [ ] JDBC interface implementation for EncryptedDataSource, EncryptedConnection, EncryptedPreparedStatement, EncryptedStatement, EncryptedResultSet. - [ ] Usage API for Yaml, Spring, Proxy Currently first task is assigned to hongJun Du, and i am doing the rest. Any suggestions, please let us know. Waiting for your reply. - Juan Pan (Trista) Apache ShardingSphere
[New API] Write configuration online into log files
To write configuration online into log files will make user get configuration online, so that users can check configs or troubleshoot. Therefore, we plan to add API to control ShardingSphere writes configuration online into log files. Development todo lists: - [ ] At start up, ShardingSphere writes configuration online into log files in the uniform format. - [ ] When configuration is refreshed, new configuration will be written into log files. - [ ] Move the module of yaml conversion from orchestration to sharding core. If you have any suggestion, please reply this email,thanks a lot. - Juan Pan (Trista) Apache ShardingSphere
Re: [New feature] Sharding Encryptor
Hi, everyone, This task has been done almostly. The rest of work is to parse SQL to fill necessary objects, which will be done by hongJun Du. You can get more details by this issue [1]. If any problems, please contact me. Hope everything will be ok with you. [1] https://github.com/apache/incubator-shardingsphere/issues/1844 - Juan Pan (Trista) Apache ShardingSphere 吴晟 Sheng Wu 于2019年1月30日周三 下午9:40写道： > If you are planning to use Apache common to do md5, I think it is safe. > Just be carefully, if someone tries to contribute new encrytor, you may > can't accept it. > > > > Sheng Wu > Apache SkyWalking, ShardingSphere, Zipkin > > From Wu Sheng 's phone. > > > -- Original -- > From: zhangli...@apache.org > Date: Wed,Jan 30,2019 9:07 PM > To: dev > Subject: Re: [New feature] Sharding Encryptor > > > > Use MD5 by default, and provide interface, can use SPI to adapter > customized encryption algorithm by user. > > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo > > > 吴晟 Sheng Wu 于2019年1月30日周三 下午7:13写道： > > > What encryptor? Is there any encryption algorithm in it? > > > > > > Apache has some rules to make sure you are not breaking the IP related to > > this. > > > > > > > > Sheng Wu > > Apache SkyWalking, ShardingSphere, Zipkin > > > > From Wu Sheng 's phone. > > > > > > -- Original -- > > From: juan pan > > Date: Wed,Jan 30,2019 7:10 PM > > To: dev > > Subject: Re: [New feature] Sharding Encryptor > > > > > > > > [New feature] Sharding Encryptor > > > > This new feature is to encode sensitive information, e.g, password or ID > to > > store them in databases, and decode ciphertext in databases for queries. > > Here are the main tasks: > > > > * SQL parsing for sensitive columns > > * SQL rewriting for sensitive columns > > * API of Sharding Encryptor > > - [ ] Design API of encryptor for ShardingRule > > - [ ] Design API of encryptRule > > - [ ] Design API of encryptor for Sharding SpringNameSpace > > - [ ] Design API of encryptor for Sharding SpringBoot > > - [ ] Add unit tests > > * JDBC interface implementation for Sharding Encryptor > > * Built-in Encryptor implementation > > > > This new feature is important and time-consuming, so each of tasks will > > take a plenty of time to finish.Currently first task is assigned to > Hongjun > > Du, and i am doing the thrid one, whose child tasks can be seen above. > > *@Hongjun > > Du*, can you list the child tasks of first one? > > > > I hope i can finish the third one before Spring Festival, therefore i can > > continue to do others. > > > > Any suggestions, please let us know. Waiting for youre reply. > > - > > Juan Pan (Trista) > > Apache ShardingSphere
[Plan] Enhancement for parsing and rewriting modules of Sharding-Core
To make Sharding-Core stable and reliable, it is necessary to go through current parsing and rewriting modules of Sharding-Core. Here are main tasks: 1. Consider consistent values and names e.g. StartIndex, StopIndex to define token index for rewriting 2. Sort out all of the segments, and consider to define tokenSegment 3. Instead of original literals, use StartIndex, StopIndex to rewrite SQL. 4. Review all of tokens, plese specially notice IndexToken 5. Consider whether statements could be made of segments and tokens. What is your opinion? Welcome to see your reply. - Juan Pan (Trista) Apache ShardingSphere
Re: [apache/incubator-shardingsphere] #1754 failed to get string sharding value (#1760)
Thanks for your proposal, i have checked my name in gitHub already. Juan Pan (Trista) Apache ShardingSphere Craig Russell 于2019年1月16日周三 上午11:19写道： > Can everyone in shardingsphere community please change your name in github > to include your Latin-character name? Having only the Chinese name is > distracting. > > Thanks, > > Craig > > Begin forwarded message: > > *From: *张亮 > *Subject: **Re: [apache/incubator-shardingsphere] #1754 failed to get > string sharding value (#1760)* > *Date: *January 15, 2019 at 7:06:27 PM PST > *To: *apache/incubator-shardingsphere < > incubator-shardingsph...@noreply.github.com> > *Cc: *Subscribed > *Reply-To: *apache/incubator-shardingsphere < > reply+00f8cf44750bbafde2f251df9763fed9e7132cab898464ea92cf0001185661b392a169ce17d1b...@reply.github.com > > > > Merged #1760 > <https://github.com/apache/incubator-shardingsphere/pull/1760> into dev. > > — > You are receiving this because you are subscribed to this thread. > Reply to this email directly, view it on GitHub > <https://github.com/apache/incubator-shardingsphere/pull/1760#event-2076330323>, > or mute the thread > <https://github.com/notifications/unsubscribe-auth/APjPRFLcyQC1QHJaZozt987Qq0Vv0o5Pks5vDpczgaJpZM4aCMRk> > . > > > Craig L Russell > c...@apache.org > >
Enhancement for generating globally unique ID for ShardingSphere
To modify API of generating gobally unique ID, and provide alternatives of gobally unique ID generator for users now is planned to start. Here are the main tasks of this plan: - 1. Modify the type of returned value of keyGenerator from Number to Comparable. - 2. Support to set or get properties for keyGenerator by all kinds of configuration files, e.g. yaml or springboot. - 3. Modify API of keyGenerator for Sharding-JDBC and Sharding-Proxy - 4. Besides Snowflake, implement other popular keyGenerator algorithms for ShardingSphere, e.g. Leaf[1] or UUID. [1] https://tech.meituan.com/MT_Leaf.html The first task has been done, please refer to https://github.com/sharding-sphere/sharding-sphere/pull/1724. Any suggestions, please reply to this email. - Juan Pan (Trista) Apache ShardingSphere
Re: Module refactoring of merging the data generated by `DISTINCT` syntax
Yep, there is no other better solutions except sorting result sets, but the important thing is how? Firstly how to rewrite those sytaxes, e.g. `AVG(DISTINCT col)`, rewrite it to `DISTINCT col` or not? Secondly how to sort those result sets to calcuate aggregation results of distinct columns, e.g. `SUM(DISTINCT col1 + col2)` row by row for each result set. Finally, how to make users get the resultset using original column labels or indexes, not the rewrited column labels or indexes. - Juan Pan (Trista) Apache ShardingSphere Hongtao Gao 于2019年1月3日周四 下午2:37写道： > Would you list some examples to share the "new ideas"? I couldn't find > other solutions besides sorting result sets. > > juan pan 于2019年1月2日周三 上午10:49写道： > > > Hi, all > > > > New year, new start. > > > > The code refactoring of merging the data generated by `DISTINCT` syntax > is > > also on the way. > > > > I decided to do this for i got some new ideas about this module > > implementation so as to make its implementation easier to extend in the > > next stage and clearer to understand. > > > > This work does not take up too much time, so it will be done before next > > release. > > > > - > > Juan Pan (Trista) > > Apache ShardingSphere > > > > > -- > Gao Hongtao > Apache SkyWalking & ShardingSphere >
Module refactoring of merging the data generated by `DISTINCT` syntax
Hi, all New year, new start. The code refactoring of merging the data generated by `DISTINCT` syntax is also on the way. I decided to do this for i got some new ideas about this module implementation so as to make its implementation easier to extend in the next stage and clearer to understand. This work does not take up too much time, so it will be done before next release. - Juan Pan (Trista) Apache ShardingSphere
[New API] Add new API to check table metadata or not at startup of ShardingSphere
Hi, all To add an API for configuring whether ShardingSphere checks the metadata consistancy of all the tables at startup is in progress Many users will pay more attention on performance at startup, and do not want to check the metadata consistancy of all the tables in database, but others want. Therefore we need to add API to make user decide to check it or not. Please refer to #1688 <https://github.com/sharding-sphere/sharding-sphere/issues/1688> for more detail. - Juan Pan (Trista) Apache ShardingSphere
Re: New feature for Sharding-orchestration
Thanks for your efforts. if so, maybe we can mark this task done. - Juan Pan (Trista) Apache ShardingSphere Zhang Yonglun 于2018年12月25日周二 下午12:29写道： > I've tried this feature last night. This really can provide good experience > to users. > > juan pan 于2018年12月25日周二 下午12:01写道： > > > Hi all, > > > > This task is moving ahead, here is The lastest status > > <https://github.com/sharding-sphere/sharding-sphere/pull/1665> > > > > On this special day, Merry Christmas to you and your family. > > ----- > > Juan Pan (Trista) > > Apache ShardingSphere > > > > > > juan pan 于2018年12月23日周日 上午9:59写道： > > > > > Hi everyone, > > > > > > Considering the suggestions from ShardingSphere community, I plan to > add > > a > > > new feather for Sharding-orchestration, which basically includes > > > 1. User can add or delete scheme configurations in registry, e.g. > > > zookeeper or etcd. > > > 2. Registry pushes those changed events to all of applications online. > > > 3. Applications online refresh their schema configurations to make > those > > > changes effective. > > > > > > Your voice is important for this feature, any suggestion, please tell > me. > > > > > > - > > > Juan Pan (Trista) > > > Apache ShardingSphere > > > > > > > > -- > Zhang Yonglun > Apache ShardingSphere >
New plan for supporting `DISTINCT` syntax
Hi, all As a distributed database middleware, ShardingSphere is on the way to support all the SQL syntax as possible as we can. This current supporting detail of `DISTINCT` syntax is as follows, *Available SQL Of ShardingSphere* SELECT DISTINCT * FROM tbl_name WHERE col1 = ? SELECT DISTINCT col1 FROM tbl_name SELECT DISTINCT col1, col2, col3 FROM tbl_name SELECT COUNT(DISTINCT col1) FROM tbl_name SELECT SUM(DISTINCT col1) FROM tbl_name SELECT DISTINCT col1 FROM tbl_name ORDER BY col1 SELECT DISTINCT col1 FROM tbl_name ORDER BY col2 SELECT COUNT(DISTINCT col1) FROM tbl_name GROUP BY col1 SELECT COUNT(DISTINCT col1), col1 FROM tbl_name GROUP BY col1 *Unavailable SQL Of ShardingSphere* SELECT DISTINCT(col1) FROM tbl_name SELECT COUNT(DISTINCT col1 + col2) FROM tbl_name SELECT AVG(DISTINCT col1) FROM tbl_name SELECT COUNT(DISTINCT col1), SUM(DISTINCT col1) FROM tbl_name SELECT col1, COUNT(DISTINCT col2) FROM tbl_name GROUP BY col1 SELECT SUM(DISTINCT col1), SUM(col1) FROM tbl_name The next step planned is to support 1st, 2nd, 3rd, 5th, 6th of *Unavailable SQL*, and add unit cases for them as well. The expected end time of this task is about before January 4, 2019. More details will be presented on the issues and Prs on gitHub, and any progress will also be updated afterward here. Welcome your suggestions, and wish you *merry **Christmas* - Juan Pan (Trista) Apache ShardingSphere
Re: New feature for Sharding-orchestration
Hi all, This task is moving ahead, here is The lastest status <https://github.com/sharding-sphere/sharding-sphere/pull/1665> On this special day, Merry Christmas to you and your family. - Juan Pan (Trista) Apache ShardingSphere juan pan 于2018年12月23日周日 上午9:59写道： > Hi everyone, > > Considering the suggestions from ShardingSphere community, I plan to add a > new feather for Sharding-orchestration, which basically includes > 1. User can add or delete scheme configurations in registry, e.g. > zookeeper or etcd. > 2. Registry pushes those changed events to all of applications online. > 3. Applications online refresh their schema configurations to make those > changes effective. > > Your voice is important for this feature, any suggestion, please tell me. > > - > Juan Pan (Trista) > Apache ShardingSphere >
Re: Release document ref from SkyWalking community
That is just what we need, thanks for your kindness. - Juan Pan (Trista) Apache ShardingSphere 吴晟 Sheng Wu 于2018年12月22日周六 下午9:56写道： > Hi ShardingSphere > > > We are going to move repositories to Apache org soon, plan says Jan. Then > we will face preparing and organizing our Apache release, > beside feature requirements, such as PostgreSQL DB support is the key, we > need to know how to do Apache release. > > > SkyWalking has a long document, lists all steps when SkyWalking release > manager does that. I think you could learn from it. > > https://github.com/apache/incubator-skywalking/blob/master/docs/en/guides/How-to-release.md > > > Also, attention, Apache release requires you prepare LICENSE/NOTICE for > source and distribution packages, which are not same. > There is an Apache license catagory list, you should learn and follow > https://www.apache.org/legal/resolved.html > > > First release is hard, usually take 3-4 votes and more than 1 months to > prepare. Since I am in the project, I hope to assist you move easier. > > > > > -- > Sheng Wu > Apache SkyWalking, ShardingSphere, Zipkin > Twitter, wusheng1108
New feature for Sharding-orchestration
Hi everyone, Considering the suggestions from ShardingSphere community, I plan to add a new feather for Sharding-orchestration, which basically includes 1. User can add or delete scheme configurations in registry, e.g. zookeeper or etcd. 2. Registry pushes those changed events to all of applications online. 3. Applications online refresh their schema configurations to make those changes effective. Your voice is important for this feature, any suggestion, please tell me. - Juan Pan (Trista) Apache ShardingSphere
Re: Discuss include Elastic-Job as a part of ShardingSphere
Considering the elastic data migration, maybe it is better to use it as an ETL tool, for John is familiar with it. But we also need to spend more time and effort on it, do we have extra energy to take good care of it? zhangli...@apache.org 于2018年12月17日周一 下午3:16写道： > Hi, > > ShardingSphere need a distributed job framework to async execute > retrying and compensation for Saga transaction. > And in future, ShardingSphere also need a job framework as an ETL tool for > elastic data migration. > I plan including elastic-job[1] as a sub project of ShardingSphere or > could use directly. > > Because elastic-job need more works to do, for example: > > 1. Upgrade quartz for elastic-job's dependency, quartz 2.1.1 is use c3p0 > which is LGPL license. > 2. New features, like sharding rule with elastic-job > > So, I prefer make elastic-job as a sub project of ShardingSphere, If the > idea is fine, I can communicate with company, and begin to prepare SGA, any > suggestion? > > [1] https://github.com/elasticjob/elastic-job-lite > > -- > > Liang Zhang (John) > Apache ShardingSphere & Dubbo > -- Juan Pan (Trista) Apache ShardingSphere
Re: Discuss for new mentor required of ShardingSphere
Welcome~ -- Juan Pan (Trista) Apache ShardingSphere Gosling Von 于2018年12月14日周五 下午3:11写道： > Hi, > > I would like to help shardingsphere community to be podling. Consider my > personal tech. Interest, I am vey happy to help to build a prosper > Database Middleware in Apache Technology Ecosystem. > > > Best Regards, > Von Gosling > > > 在 2018年12月13日，上午11:06，Willem Jiang 写道： > > > > I think we need the confirmation from Von Gosling. > > > > Gosling Could you reply this mail? > > > > > > Willem Jiang > > > > Twitter: willemjiang > > Weibo: 姜宁willem > > > > On Thu, Dec 13, 2018 at 10:37 AM zhangli...@apache.org > > wrote: > >> > >> Welcome Von Gosling as Apache ShardingSphere's mentor. > >> > >> Hi, Craig and Willem, could you add Von Gosling as mentor to > >> ShardingSphere's whimsy? > >> > >> -- > >> > >> Liang Zhang (John) > >> Apache ShardingSphere & Dubbo > >> > >> > >> 彭勇升 Peng Yongsheng <8082...@qq.com> 于2018年12月13日周四 上午12:14写道： > >> > >>> +1 > >>> > >>> — > >>> Yongsheng Peng > >>> Apache SkyWalking & ShardingSphere > >>> > >>> > >>> > >>> > >>>> 在 2018年12月12日，11:19，zhangli...@apache.org 写道： > >>>> > >>>> Sorry, I forget to introduce Von Gosling. > >>>> He is initial committer of Apache RocketMQ and Apache Dubbo, he also > is > >>>> mentor of Apache brpc. > >>>> I would like invite Von Gosling sincerely as a mentor of Apache > >>>> ShardingSphere. > >>>> > >>>> -- > >>>> > >>>> Liang Zhang (John) > >>>> Apache ShardingSphere & Dubbo > >>>> > >>>> > >>>> zhaojun 于2018年12月12日周三 上午11:08写道： > >>>> > >>>>> +1 > >>>>> > >>>>> -- > >>>>> Zhao Jun > >>>>> Apache Sharding-Sphere & ServiceComb > >>>>> > >>>>>> On Dec 12, 2018, at 10:11 AM, Willem Jiang > >>>>> wrote: > >>>>>> > >>>>>> Hi Zhangliang, > >>>>>> > >>>>>> I think you may introduce Von Gosling first even I know him a lot. > >>>>>> > >>>>>> Willem Jiang > >>>>>> > >>>>>> Twitter: willemjiang > >>>>>> Weibo: 姜宁willem > >>>>>> > >>>>>> On Wed, Dec 12, 2018 at 4:03 AM zhangli...@apache.org > >>>>>> wrote: > >>>>>>> > >>>>>>> Hi all, > >>>>>>> > >>>>>>> ShardingSphere needs more mentors to help us to create a diverse > >>>>> community > >>>>>>> and best practice of Apache way. > >>>>>>> So I want to discuss about inviting Von Gosling(apache id is > >>>>> vongosling) as > >>>>>>> our mentor. Any suggestions? > >>>>>>> > >>>>>>> -- > >>>>>>> > >>>>>>> Liang Zhang (John) > >>>>>>> Apache Sharding-Sphere & Dubbo > >>>>> > >>>>> > >>> > >>> > >
Re: Discuss for new mentor required of ShardingSphere
+1 for this zhangli...@apache.org 于2018年12月12日周三 上午4:03写道： > Hi all, > > ShardingSphere needs more mentors to help us to create a diverse community > and best practice of Apache way. > So I want to discuss about inviting Von Gosling(apache id is vongosling) as > our mentor. Any suggestions? > > -- > > Liang Zhang (John) > Apache Sharding-Sphere & Dubbo >
