Re: WeChat Public Account of ALC Beijing
Hi Thanks for everyone’s effort. My main concern is that we just want to record content of each meeting for us or to promote ALC Beijing to welcome others join? If it is the later, is gitHub a friendly way for people to look? I think it is better to record and promote along with twitter or a website. Cheers, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 03/6/2020 07:23，Willem Jiang wrote： As we discussed during the ALC-Beijing meeting[1], the better solution is use git to host the content for us to corparted and the WeChat Public Account is for releasing the content to WeChat user. Willem Jiang On Thu, Mar 5, 2020 at 8:29 PM Sheng Wu wrote: I am feeling a similar thing about private(sort of) content. Maybe it is not a big deal as it is still free and open to everyone as the fact is, everyone has the wechat already, but we could consider host it somewhere else, or achieve them in some way. Sheng Wu 吴晟 Twitter, wusheng1108 适兕 于2020年3月5日周四 下午6:45写道： Hi, Willem Well done. But I have a question, WeChat Public is can not access from outside of Tencent system. and it‘s URL is not for human being. Google can't search , the worst is in the WeChat Public article can not link Internet content. So I suggest , We need a space for store content first , Just like GitHub page etc. WeChat Public is just one of the spread channel. Any feedback is appreciated. On Thu, Mar 5, 2020 at 6:26 PM Willem Jiang wrote: FYI, I just applied a WeChat Public Account of alc-beijing. You can use "ALC Beijing" to search for the account if you are using WeChat. Please feel free to drop your articles about ASF or ASF projects in Chinese, we are happy to share it with our audience. Willem Jiang - To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org -- Welcome to http://opensourceway.community! The open source way: Dedicated to the exploration of ideas, knowledge and values related to open source. - To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org
Re:[VOTE] Graduate Apache ShardingSphere (incubating)
+ 1 from me, it is an enjoyable journey, hope it more prosperous in the future. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 03/5/2020 12:04，zhangli...@apache.org wrote： Establish the Apache ShardingSphere Project WHEREAS, the Board of Directors deems it to be in the best interests of the Foundation and consistent with the Foundation's purpose to establish a Project Management Committee charged with the creation and maintenance of open-source software, for distribution at no charge to the public, related to Apache ShardingSphere is an ecosystem consisted of a set of distributed database middleware solutions, including 2 independent products, Sharding-JDBC, Sharding-Proxy. They all provide functions of data sharding, distributed transaction, database and data governance, applicable in a variety of situations such as Java isomorphism and heterogeneous language.. NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee (PMC), to be known as the "Apache ShardingSphere Project", be and hereby is established pursuant to Bylaws of the Foundation; and be it further RESOLVED, that the Apache ShardingSphere Project be and hereby is responsible for the creation and maintenance of software related to Apache ShardingSphere is an ecosystem consisted of a set of distributed database middleware solutions, including 2 independent products, Sharding-JDBC, Sharding-Proxy. They all provide functions of data sharding, distributed transaction, database and data governance, applicable in a variety of situations such as Java isomorphism and heterogeneous language.; and be it further RESOLVED, that the office of "Vice President, Apache ShardingSphere" be and hereby is created, the person holding such office to serve at the direction of the Board of Directors as the chair of the Apache ShardingSphere Project, and to have primary responsibility for management of the projects within the scope of responsibility of the Apache ShardingSphere Project; and be it further RESOLVED, that the persons listed immediately below be and hereby are appointed to serve as the initial members of the Apache ShardingSphere Project: * Craig L Russell * Hao Cao * Hongjun Du * Hongtao Gao * Juan Pan * Jun Zhao * Liang Zhang * QingYang Chen * Sheng Wu * Von Gosling * Willem Ning Jiang * Xiaoguang Ma * Yang Yi * Yonglun Zhang NOW, THEREFORE, BE IT FURTHER RESOLVED, that Liang Zhang be appointed to the office of Vice President, Apache ShardingSphere, to serve in accordance with and subject to the direction of the Board of Directors and the Bylaws of the Foundation until death, resignation, retirement, removal or disqualification, or until a successor is appointed; and be it further RESOLVED, that the Apache ShardingSphere Project be and hereby is tasked with the migration and rationalization of the Apache Incubator ShardingSphere podling; and be it further RESOLVED, that all responsibilities pertaining to the Apache Incubator ShardingSphere podling encumbered upon the Apache Incubator PMC are hereafter discharged. -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re:[MENTORS] https://www.apache.org/dist/ has been deprecated
Hi Justin, Just a PPMC of ShardingSphere, but thanks for your reminder, and we will update them ASAP. Cheers, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 03/4/2020 17:14，Justin Mclean wrote： Hi, The new URL to use is https://downloads.apache.org. Currently there is a redirect in place that should work but it would be be good to double check that all is working The following podling may need to update their download pages: Crail Daffodil DolphinScheduler Flagon Gobblin Hudi IoTDB Livy Milagro Pinot PonyMail ShardingSphere Toree Training Tuweni Weex And there may be others I’ve not identified. If you are a mentor of one of these projects please reach out and organise for this to be done. Thanks, Justin - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Too many sub tables lead to slow start
Hi The dev list will generally drop the attachments, if you debugged and found something, my suggestion is to attach the log a ISSUE[1]. [1] https://github.com/apache/incubator-shardingsphere/issues Cheers, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 03/4/2020 21:19<546810...@qq.com> wrote?? I have alreadycheck.table.metadata.enabled: false But the startup is still slow. I have about 3000 meters The code in the attachment is that I track the slow execution position. Although my database performance is average, it takes more than 15 minutes to start Definitely help check.table.metadata.enabled: false ??3000 ??15 ---- ??:"zhangli...@apache.org"
Re:Too many sub tables lead to slow start
Hi The configuration option `check.table.metadata.enabled` which decides to check metadata of each table or not can affect the speed of start-up. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 03/4/2020 18:19<546810...@qq.com> wrote?? Hello I use mysql5 database Sharding version: 4.0.0-rc2 As there are about 2000 tables, the program starts slowly. Is there any way to solve this problem?
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
Hi Justin, Thanks for your prompt feedback, which always provides us valuable instructions. It seems like items currently remaining Errata is not a big issue, and the more critical case is the brand thing. Besides, to make the website more 'Apache' is another improvement. Make sense, and we will look into two of them. Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 03/4/2020 12:18，Justin Mclean wrote： Hi, IMO it's not immediately obvious from the project web site that this is an Apache project. It probably meets the minimum requirements but it would be nice to see more than that. Thanks, Justin
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
Hello folks, With the help of the community (Specially thinks to Yue Zhao), Podling Website Check page[1] said the status of our website is healthy. However, three items below still stay in Errata of the incubator status page[2]. The 2nd to 3rd items have joined our website[3][4], and my best guess is Errata can not detect them. Could anyone give us some hints? Another question here is those items are required or not for graduation? - 1 Project does not have 'commits' mailing list 2 Has not provided an issue tracker link 3 Has not provided a wiki link - Hope to see your kind advice, thanks in advance. Cheers, Trista [1] https://whimsy.apache.org/pods/project/shardingsphere [2] https://incubator.apache.org/clutch/shardingsphere.html [3] https://github.com/apache/incubator-shardingsphere/issues [4]https://cwiki.apache.org/confluence/display/SHARDINGSPHERE Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/24/2020 18:47，Juan Pan wrote： Hi folks, - Update incubator status site[3]. [DOING] To make our website line with Apache way, we need to add some links, copyright, trademark and disclaimer to our website. This sub-task is underway, you can learn more referring to [1]. - [1] https://lists.apache.org/thread.html/r633f0ab3ee2440cb856b167d9deef5972473c95445ab4138b00bc100%40%3Cdev.shardingsphere.apache.org%3E Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/24/2020 13:21，zhangli...@apache.org wrote： Tasks status update: - Remove author information in java code. [DONE] - Some remain codes[1] still using the old package name `io.shardingsphere`, we plan to rename them as `io.opensharding`. [DONE] - Major contributors sign ICLA. [DONE] - Discuss PMC list. [DONE] - Podling name search[2]. [DONE] - Update incubator status site[3]. [DOING] - Discuss how to handle powered by page [4]. [DOING] [1] https://github.com/OpenSharding [2] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-178 [3] https://incubator.apache.org/clutch/shardingsphere.html [4] https://shardingsphere.apache.org/community/en/poweredby/ -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年2月20日周四 下午4:40写道： Hi Justin, I dislike pages like this [4] and it may not in line with ASF policy. [5] It also generated confusion with [6] The powered by page means companies using ShardingSphere, not ShardingSphere powered by the companies. How about change the page url form `poweredby` to `users`? -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年2月20日周四 下午4:08写道： I am doing the podling name search, the JIRA ticket[1]. [1] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-178 -- Liang Zhang (John) Apache ShardingSphere & Dubbo Juan Pan 于2020年2月20日周四 下午2:05写道： Hi Justin, Very appreciated your time to give us some valuable feedback and suggestions. We will take time to visit those links and pay attention to the issues you mentioned.:-) Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/20/2020 12:21，Justin Mclean wrote： Hi, Now I've only take a quick look so it may be that things mentioned below have already been discussed or work is currently been done of them. Has the podling done a podling name search yet? [1] You cannot graduate until that is done. The incubator status page is showing a few things that still need to be done [2] and looking at your website there are are number of issues that need to be addressed [3] in particularly branding. How clear is it that this is an ASF project? I dislike pages like this [4] and it may not in line with ASF policy. [5] It also generated confusion with [6] Thanks, Justin 1. https://incubator.apache.org/guides/names.html 2. https://incubator.apache.org/clutch/shardingsphere.html 3. https://incubator.apache.org/guides/sites.html 4. https://shardingsphere.apache.org/community/en/poweredby/ 5. https://www.apache.org/foundation/marks/linking 6. https://www.apache.org/foundation/marks/pmcs#poweredby
Re: subscribe dev community
Detailed and so kind reminder. :-) Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/28/2020 15:59，Swapnil M Mane wrote： Hello Gang Li, Welcome to the Apache Community Development! It seems you have sent the mail mistakenly to the dev list, if this was intentional then for subscribing the mailing list, please send a mail to dev-subscr...@community.apache.org After this, you will receive a 'confirm subscribe' mail, simply send an empty reply to that as well. :) Best regards, Swapnil M Mane, www.apache.org On Fri, Feb 28, 2020 at 1:18 PM lgcareer2...@outlook.com wrote: DolphinScheduler(Incubator) PPMC Gang Li 李岗 lgcareer2...@outlook.com<mailto:lgcareer2...@outlook.com> - To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org
Re:[VOTE] Release Apache ShardingSphere (Incubating) 4.0.1
Hi +1 from me. Here is my check list. [x] Download links are valid. [x] Checksums and PGP signatures are valid. [x] DISCLAIMER is included. [x] Source code artifacts have correct names matching the current release. [x] LICENSE and NOTICE files are correct. [x] All files have license headers if necessary. [x] Source code can compile successfully. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/25/2020 22:47，zhaojun wrote： Hello ShardingSphere Community, This is a call for vote to release Apache ShardingSphere (Incubating) version 4.0.1 Release notes: https://github.com/apache/incubator-shardingsphere/blob/dev-4.x/RELEASE-NOTES.md <https://github.com/apache/incubator-shardingsphere/blob/dev-4.x/RELEASE-NOTES.md> The release candidates: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.1/ <https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.1/> Maven 2 staging repository: https://repository.apache.org/content/repositories/orgapacheshardingsphere-1047/org/apache/shardingsphere/ <https://repository.apache.org/content/repositories/orgapacheshardingsphere-1047/org/apache/shardingsphere/> Git tag for the release: https://github.com/apache/incubator-shardingsphere/tree/4.0.1/ <https://github.com/apache/incubator-shardingsphere/tree/4.0.1/> Release Commit ID: https://github.com/apache/incubator-shardingsphere/commit/b67d320209b4d4585231b356f2c575cfa383a98b <https://github.com/apache/incubator-shardingsphere/commit/b67d320209b4d4585231b356f2c575cfa383a98b> Keys to verify the Release Candidate: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS <https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS> Look at here for how to verify this release candidate: https://shardingsphere.apache.org/community/en/contribute/release/ <https://shardingsphere.apache.org/community/en/contribute/release/> The vote will be open for at least 72 hours or until necessary number of votes are reached. Please vote accordingly: [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove with the reason Checklist for reference: [ ] Download links are valid. [ ] Checksums and PGP signatures are valid. [ ] DISCLAIMER is included. [ ] Source code artifacts have correct names matching the current release. [ ] LICENSE and NOTICE files are correct for each ShardingSphere repo. [ ] All files have license headers if necessary. [ ] No compiled archives bundled in source archive. -- Zhao Jun (cherrylzhao) Apache ShardingSphere & ServiceComb
Re: [ALC] Request to setup ALC in Beijing
Hi Hadrian, I like your idea, very clear. If possible, we can share this summary to other ALCs or add something to [1] in the future. Cheers. Trista [1] https://cwiki.apache.org/confluence/display/COMDEV/Apache+Local+Community+-+ALC#ApacheLocalCommunity-ALC-ALCRolesandResponsibilities Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/27/2020 04:47，Hadrian Zbarcea wrote： Hi Juan Pan, Best is to keep things simple. My suggestion would be to have 3 roles: 1. Associate Members = anybody interested, low barrier to entry 2. Members (or Full Members) = members who are also committers to any ASF project 3. Steering Committee = elected from Full Members with an administrative/organizational role (similar to a PMC); size up to you Associate Members would become Full Members simply by getting the Vote of an ASF community/project, not special procedure would be necessary inside the ALC. At least one member of the Steering Committee SHOULD be a member of dev@community.a.o. You could consider removing Associate Members who were inactive for a significant time, say 2 years. Cheers, Hadrian On Tue, Feb 25, 2020 at 10:19 PM Juan Pan wrote: Hi After reading the thread, two of questions came to my mind, i.e. What is the Responsibility of ALC member? How to become a ALC member? Moreover, i guess other ALCs will have the same questions as well. From the ALC doc[1], we can learn that the responsibilities of ALC are mostly related to Apache way, so if the responsibilities of a member is to help do those things, that means a member at least has a basic understanding of Apache or did some contributions? Secondly, if many of people who may has no understanding of Apache, or just want to be a member (for interest?), is it ok to include him as a member? Is there any condition or bar? IMO, we may consider nomination and vote for a member. Our upcoming online meet up is a good chance to discuss. See you then. [1] https://cwiki.apache.org/confluence/display/COMDEV/Apache+Local+Community+-+ALC#ApacheLocalCommunity-ALC-ALCRolesandResponsibilities *Juan Pan (Trista) * Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/26/2020 09:53，Sheng Wu wrote： Hi Hadrian So, from what I read in the thread above, I see you all being mostly in agreement, but are referring to different (and important) aspects. Yes, we are. We could discuss this more on Thur. online meeting. Sheng Wu 吴晟 Twitter, wusheng1108 Hadrian Zbarcea 于2020年2月26日周三 上午12:27写道： Most of the disagreements on the ASF lists can be traced back to a communication issue. I think I understand what Willem proposed and I agree on the low bar aspect, but I think the way the term bar is used may create unnecessary misunderstandings. This being an ASF local community, it must be guided by ASF standards (let's not call them rules). This is in the interest of advancing the ASF values we believe in and proved successful for over 2 decades. From this point of view the people who are organizing the community must know what they're are doing, Sheng Wu you are correct. There should be a way in which the organizers (or members or whatever word we choose to describe that PMC member like role) communicate with each other, build consensus and execute. If necessary, they are smart and experienced enough to ask for advice from an ASF officer or the board, whatever the case may be. On the other side, thinking about the intent behind the ACL Beijing, it is not intended (I assume) as a private club, but a way to promote open source and the ASF. From this point of view the community should be inclusive, there should be a low bar to entry, there should be good and active mentoring of new individuals (whatever we call them if not members) and they should be encouraged, helped, guided, mentored to be successful with open source, ASF projects and the ASF way in particular. Interested and talented individuals will get the karma in ASF projects and will go as far as they want, and will get a better understanding of what the ASF is about. The 'status' in the ACL Beijing will come from their contributions to open source projects, not the fact that they 'joined the club'. And to be clear, contributions don't mean just code contributions. IMHO, it matters less if those who join are called members of the ALC, what matters is what they do and how they are helped to become successful and how they help others to become successful. Actually the term member is a bit overloaded at the ASF as well. I remember many cases when newly voted PMC members thought they are members of the foundation, and it took a bit for them to understand the difference. So, from what I read in the thread above, I see you all being mostly in agreement, but are referring to different (and important) aspects. Best of luck, Hadrian On Tue, Feb 25, 2020 at 8:04 AM Sheng Wu wrote: H
Re: How about we hold a online meeting of ALC Beijing this thursday?
Hi Willem, That time is ok for me, BTW, how long is it expected to end? Hope see everyone guys then! Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/24/2020 23:23, Willem Jiang wrote: Hi, I think we could hold a online meeting through Zoom this Thursday (27th Feb) night around 9:00 PM Beijing time. It could be great if we introduce each other and talk about the meetup plan in the coming up month. We will send a mail to the mailing list to summarize the discussion we have. Please let me know if the time works for you. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
Hi folks, > - Update incubator status site[3]. [DOING] To make our website line with Apache way, we need to add some links, copyright, trademark and disclaimer to our website. This sub-task is underway, you can learn more referring to [1]. - [1] https://lists.apache.org/thread.html/r633f0ab3ee2440cb856b167d9deef5972473c95445ab4138b00bc100%40%3Cdev.shardingsphere.apache.org%3E Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/24/2020 13:21，zhangli...@apache.org wrote： Tasks status update: - Remove author information in java code. [DONE] - Some remain codes[1] still using the old package name `io.shardingsphere`, we plan to rename them as `io.opensharding`. [DONE] - Major contributors sign ICLA. [DONE] - Discuss PMC list. [DONE] - Podling name search[2]. [DONE] - Update incubator status site[3]. [DOING] - Discuss how to handle powered by page [4]. [DOING] [1] https://github.com/OpenSharding [2] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-178 [3] https://incubator.apache.org/clutch/shardingsphere.html [4] https://shardingsphere.apache.org/community/en/poweredby/ -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年2月20日周四 下午4:40写道： Hi Justin, I dislike pages like this [4] and it may not in line with ASF policy. [5] It also generated confusion with [6] The powered by page means companies using ShardingSphere, not ShardingSphere powered by the companies. How about change the page url form `poweredby` to `users`? -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年2月20日周四 下午4:08写道： I am doing the podling name search, the JIRA ticket[1]. [1] https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-178 -- Liang Zhang (John) Apache ShardingSphere & Dubbo Juan Pan 于2020年2月20日周四 下午2:05写道： Hi Justin, Very appreciated your time to give us some valuable feedback and suggestions. We will take time to visit those links and pay attention to the issues you mentioned.:-) Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/20/2020 12:21，Justin Mclean wrote： Hi, Now I've only take a quick look so it may be that things mentioned below have already been discussed or work is currently been done of them. Has the podling done a podling name search yet? [1] You cannot graduate until that is done. The incubator status page is showing a few things that still need to be done [2] and looking at your website there are are number of issues that need to be addressed [3] in particularly branding. How clear is it that this is an ASF project? I dislike pages like this [4] and it may not in line with ASF policy. [5] It also generated confusion with [6] Thanks, Justin 1. https://incubator.apache.org/guides/names.html 2. https://incubator.apache.org/clutch/shardingsphere.html 3. https://incubator.apache.org/guides/sites.html 4. https://shardingsphere.apache.org/community/en/poweredby/ 5. https://www.apache.org/foundation/marks/linking 6. https://www.apache.org/foundation/marks/pmcs#poweredby
[Website] To make incubator website more `Apache way`
Hi fellows, As Justin said[1], there are some of blockers for our graduation, and a few things that still need to be done on our website. For this reason, i explored Apache doc and provided those missing notes at ISSUE[2], moreover our contributor Yue Zhao is willing to add them to our website with nice-look presentation. Thanks for your contribution in advance, Yue. Any help if you need, please speak up. Sincerely, Trista [1] https://lists.apache.org/thread.html/r885653f36d76c9d842b52f0ba2576dd962efd2e9a24acc03515c9e24%40%3Cdev.shardingsphere.apache.org%3E [2] https://github.com/apache/incubator-shardingsphere/issues/4383 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
Hi Justin, Very appreciated your time to give us some valuable feedback and suggestions. We will take time to visit those links and pay attention to the issues you mentioned.:-) Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/20/2020 12:21，Justin Mclean wrote： Hi, Now I've only take a quick look so it may be that things mentioned below have already been discussed or work is currently been done of them. Has the podling done a podling name search yet? [1] You cannot graduate until that is done. The incubator status page is showing a few things that still need to be done [2] and looking at your website there are are number of issues that need to be addressed [3] in particularly branding. How clear is it that this is an ASF project? I dislike pages like this [4] and it may not in line with ASF policy. [5] It also generated confusion with [6] Thanks, Justin 1. https://incubator.apache.org/guides/names.html 2. https://incubator.apache.org/clutch/shardingsphere.html 3. https://incubator.apache.org/guides/sites.html 4. https://shardingsphere.apache.org/community/en/poweredby/ 5. https://www.apache.org/foundation/marks/linking 6. https://www.apache.org/foundation/marks/pmcs#poweredby
Re:[PROPOSAL]ShardingShpere Cloud on Kubernetes(SSCK)
Hi Hongtao, Thanks for your detailed proposal which looks great. I fixed some typos base on google doc’s advice, and one item seems no clue for me is that Sharding-Sidecar is still in our mind without any progress. Sincerely, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/20/2020 09:50，Hongtao Gao wrote： Hongtao Gao 2019年11月26日周二 上午10:04 发送至 dev Hi everyone I'm glad to share my proposal with you about to setup ShardingShpere Cloud on Kubernetes(SSCK) project. The aim of SSCK is to enable users to configure and manage components of ShardingShpere in Kubernetes Cluster. The following is the doc of this proposal. I'm hoping to hear thoughts from you soon. [PROPOSAL]ShardingShpere Cloud on Kubernetes(SSCK) - https://docs.google.com/document/d/1Yixu9Mik9dkQdEzuJm1HCAmoPxjlGuEpKUfjFFD99O8/edit?usp=sharing -- Hongtao Gao Apache SkyWalking && Apache ShardingSphere Twitter, @hanahmily
Re: [Announcement] - Establishing ALC Beijing Chapter
Thanks for your kind reminder, it is a good way to know each other before f2f. :-) Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/20/2020 08:30，jincheng sun wrote： Just a little reminder to Members:), Please provide your photo / avatar on the page [1], which is pretty convenient for know each other :) Best, Jincheng [1] https://s.apache.org/alc-beijing jincheng sun 于2020年2月20日周四 上午8:18写道： Congrats for ALC Beijing. It’s really a pleasure working with all of you on ALC Beijing ! Best, Jincheng zhangli...@apache.org 于2020年2月19日周三 下午9:43写道： Online meeting and remote working are the best practice of apache way, we can learn more from the crisis. Hope everything will be better soon :) -- Liang Zhang (John) Apache ShardingSphere & Dubbo 适兕 于2020年2月19日周三 下午5:10写道： yes, online meeting is mainstream in all China now. maybe we should thinking this way. Sheng Wu 于2020年2月19日周三 下午5:00写道： Hi Craig Thanks. Out of the Hubei Province, it is already being better. It is still not suitable for the f2f meetup, but online ones should be fine :) Sheng Wu 吴晟 Twitter, wusheng1108 Craig Russell 于2020年2月19日周三 下午2:02写道： Congratulations to everyone involved in the new ALC in Beijing. I can only imagine how hard it is for you during the coronavirus situation and wish you a speedy resolution to the crisis. Best regards, Craig On Feb 18, 2020, at 3:02 AM, Swapnil M Mane < swapnilmm...@apache.org wrote: Hello all, ComDev PMC is pleased to announce our next ALC Chapter, ALC Beijing [1] and Willem Jiang as ALC Beijing Chapter lead. We have the following members in ALC Beijing: 1. Willem Jiang -- ASF Member -- Chair, Servicecomb -- PMC (Camel, CXF, Incubator, RocketMQ, ServiceMix, SkyWalking) 2. Jeff Zhang -- ASF Member -- PMC (Tez, Zeppelin) -- Committer (Incubator, Pig, Submarine, Livy) 3. Hadrian Zbarcea -- ASF Member -- PMC (Brooklyn, Camel, Incubator, TinkerPop) -- Non-PMC (Fundraising) -- Committer (ActiveMQ, Labs) 4. Liu Ted -- ASF Member -- PMC (Incubator) -- Non-PMC (Fundraising) 5. Sheng Wu -- Chair, SkyWalking -- PMC (Incubator) -- Committer (DolphinScheduler, ECharts, and ShardingSphere) 6. Liang Zhang -- PMC (Dubbo) -- Committer (Incubator, ShardingSphere) 7. Jincheng Sun -- PMC (Flink) -- Committer (Incubator, IoTDB) 8. Xiangdong Huang -- Committer (Incubator, IoTDB) 9. Juan Pan -- Committer (ShardingSphere, Incubator) 10. Skylar Deranick Please join me in congratulating the ALC Beijing Chapter and wishing them the best luck for their future events. [1] https://s.apache.org/alc-beijing Best regards, Swapnil M Mane, www.apache.org - To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org Craig L Russell c...@apache.org - To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org -- 独立之思想，自由之精神。 --陈寅恪
Re:[Announcement] - Establishing ALC Beijing Chapter
Congratulation! Many thanks for our members’ help. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/18/2020 19:02，Swapnil M Mane wrote： Hello all, ComDev PMC is pleased to announce our next ALC Chapter, ALC Beijing [1] and Willem Jiang as ALC Beijing Chapter lead. We have the following members in ALC Beijing: 1. Willem Jiang -- ASF Member -- Chair, Servicecomb -- PMC (Camel, CXF, Incubator, RocketMQ, ServiceMix, SkyWalking) 2. Jeff Zhang -- ASF Member -- PMC (Tez, Zeppelin) -- Committer (Incubator, Pig, Submarine, Livy) 3. Hadrian Zbarcea -- ASF Member -- PMC (Brooklyn, Camel, Incubator, TinkerPop) -- Non-PMC (Fundraising) -- Committer (ActiveMQ, Labs) 4. Liu Ted -- ASF Member -- PMC (Incubator) -- Non-PMC (Fundraising) 5. Sheng Wu -- Chair, SkyWalking -- PMC (Incubator) -- Committer (DolphinScheduler, ECharts, and ShardingSphere) 6. Liang Zhang -- PMC (Dubbo) -- Committer (Incubator, ShardingSphere) 7. Jincheng Sun -- PMC (Flink) -- Committer (Incubator, IoTDB) 8. Xiangdong Huang -- Committer (Incubator, IoTDB) 9. Juan Pan -- Committer (ShardingSphere, Incubator) 10. Skylar Deranick Please join me in congratulating the ALC Beijing Chapter and wishing them the best luck for their future events. [1] https://s.apache.org/alc-beijing Best regards, Swapnil M Mane, www.apache.org - To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org
Re: [DISCUSS] Add Apache ShardingSphere as the server storage for Apache SkyWalking
Hi Daming, That’s not a big issue, we can do it step by step and you can learn it more at link[1]. @Wu-Sheng and @Daming, 2nd sub-task concerning tables and SQLs analysis was presented at issue[2], please review it and give your comments. :-) [1] https://shardingsphere.apache.org/ [2] https://github.com/apache/skywalking/issues/4131#issuecomment-587302393 Sincerely, trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/18/2020 11:32，Daming wrote： Hi Trista, I am not very familiar with ShardingSphere. I think I need to learn how to run it for e2e test, so I pick up the task. :-) ——— Daming(@dmsolr) Apache SkyWalking 在 2020年2月18日，上午10:49，Juan Pan 写道： Hi Daming, I am glad you can take part in, of course ,you could. Therefore i will take care of sub-task 1to 3. BTW, do you know something about Sharding Proxy[1]? To finish sub-task 4 and 5, you have to use Sharding Proxy to shard DBs and tables, so as to make e2e tests run well. Don’t worry, i will work with you together, and to be frank, it is a good chance to learn two of Apache projects and coordinate them together for a better solution! [1] https://shardingsphere.apache.org/document/current/en/quick-start/sharding-proxy-quick-start/ Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/17/2020 10:33，Daming wrote： Could I pick up this two sub-tasks? 4. Provide configuration of Sharding Proxy[2] for Skywalking.[TODO] 5. Provide Acceptance test(maybe e2e tests of Skywalking?).[TODO] — Daming(@dmsolr) Apache SkyWalking 在 2020年2月17日，上午9:58，Juan Pan 写道： That exactly what i concerned, moreover thanks for your joining. Could you tell me which part you are interested in, so that we can share the task list and work together. :-) Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/17/2020 00:34，吴晟 Sheng Wu wrote： Hi Which part or both? ShengWu吴晟 FromWuSheng'sphone. -- Original -- From: apmail-wusheng-owner https://shardingsphere.apache.org/ gt; [2] gt; https://shardingsphere.apache.org/document/current/en/quick-start/sharding-proxy-quick-start/ gt; [3] https://github.com/apache/skywalking/tree/master/install gt; [4 ] gt; https://github.com/apache/skywalking/blob/master/docs/en/setup/backend/backend-storage.md gt; [5] https://github.com/apache/skywalking/issues/4131 gt; gt; gt; gt; gt; gt;nbsp; Juan Pan (Trista) gt; gt; Senior DBA amp; PPMC of Apache ShardingSphere(Incubating) gt; E-mail: panj...@apache.org gt; gt; gt; gt;
Re: PMC and Committer list after graduation
Thanks for Roster, LGTM +1 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/17/2020 17:48，zhangli...@apache.org wrote： OK. PMC: - Benjamin Hindman - Craig L Russell - Hao Cao - Hongjun Du - Hongtao Gao - Juan Pan - Jun Zhao - Liang Zhang (VP) - QingYang Chen - Sheng Wu - Von Gosling - Willem Ning Jiang - Xiaoguang Ma - Yang Yi - Yonglun Zhang Committers: - Guangyuan Wang - Haisheng Sun - Ling Yue - Nicholas Jiang - Qi Wang - Ya Li - Yanan Zhao - YangWen Ou - Zhiyi Yan - Zonglei Dong -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年2月17日周一 下午5:39写道： Hi I think you should list the names here, other contributors, and even committers can't access Roster. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年2月17日周一 下午5:31写道： Hi PPMC and Committers, The final PMC and committer list are confirmed[1]. Please feel free to discuss the list if you have any advices. [1] https://whimsy.apache.org/roster/ppmc/shardingsphere -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: Mentor invitation of the ShardingSphere PMC
Hi Nicholas, Sorry to say, but this is an invitation for our mentors, not for committers… Sincerely, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/18/2020 00:42，蒋晓峰 wrote： Yes. On Mon, Feb 17, 2020 at 5:42 PM zhangli...@apache.org wrote: Dear ShardingSphere mentors, Please accept our deepest thanks of the great help during ASF incubator from ShardingSphere community. We are nearly graduation now. I sincere invitation you as of ShardingSphere PMC member. If you'd like to be the member of ShardingSphere PMC, it's welcome and please respond 'Yes' in this thread, or *respond 'No' if you are not interested in any more, 'Yes' by default. -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: [DISCUSS] Add Apache ShardingSphere as the server storage for Apache SkyWalking
Hi Sheng and Daming, Today, i guess i can propose one sharding strategy for us to discuss, which means sub-task 2 (Analyse those tables and query SQLs to explore appropriate sharding) will be done. Once the sharding strategy is settled down by us, i am going to work on sub-task 3(Provide class implementation ShardingAlgorithm), meanwhile, Daming can prepare configuration of Sharding Proxy. After that, e2e tests will come behind. It is my plan draft, looking forward to your suggestions. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/17/2020 14:01，Sheng Wu wrote： Daming 于2020年2月17日周一 上午10:33写道： Could I pick up this two sub-tasks? 4. Provide configuration of Sharding Proxy[2] for Skywalking.[TODO] Hi Juan I think you have a draft about this already? Sheng Wu 吴晟 Twitter, wusheng1108 5. Provide Acceptance test(maybe e2e tests of Skywalking?).[TODO] This would be helpful. You are more familiar with the e2e than her. — Daming(@dmsolr) Apache SkyWalking 在 2020年2月17日，上午9:58，Juan Pan 写道： That exactly what i concerned, moreover thanks for your joining. Could you tell me which part you are interested in, so that we can share the task list and work together. :-) Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/17/2020 00:34，吴晟 Sheng Wu wrote： Hi Which part or both? ShengWu吴晟 FromWuSheng'sphone. -- Original -- From: apmail-wusheng-owner https://shardingsphere.apache.org/ gt; [2] gt; https://shardingsphere.apache.org/document/current/en/quick-start/sharding-proxy-quick-start/ gt; [3] https://github.com/apache/skywalking/tree/master/install gt; [4 ] gt; https://github.com/apache/skywalking/blob/master/docs/en/setup/backend/backend-storage.md gt; [5] https://github.com/apache/skywalking/issues/4131 gt; gt; gt; gt; gt; gt;nbsp; Juan Pan (Trista) gt; gt; Senior DBA amp; PPMC of Apache ShardingSphere(Incubating) gt; E-mail: panj...@apache.org gt; gt; gt; gt;
Re: [DISCUSS] Add Apache ShardingSphere as the server storage for Apache SkyWalking
Hi Daming, I am glad you can take part in, of course ,you could. Therefore i will take care of sub-task 1to 3. BTW, do you know something about Sharding Proxy[1]? To finish sub-task 4 and 5, you have to use Sharding Proxy to shard DBs and tables, so as to make e2e tests run well. Don’t worry, i will work with you together, and to be frank, it is a good chance to learn two of Apache projects and coordinate them together for a better solution! [1] https://shardingsphere.apache.org/document/current/en/quick-start/sharding-proxy-quick-start/ Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/17/2020 10:33，Daming wrote： Could I pick up this two sub-tasks? 4. Provide configuration of Sharding Proxy[2] for Skywalking.[TODO] 5. Provide Acceptance test(maybe e2e tests of Skywalking?).[TODO] — Daming(@dmsolr) Apache SkyWalking 在 2020年2月17日，上午9:58，Juan Pan 写道： That exactly what i concerned, moreover thanks for your joining. Could you tell me which part you are interested in, so that we can share the task list and work together. :-) Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/17/2020 00:34，吴晟 Sheng Wu wrote： Hi Which part or both? ShengWu吴晟 FromWuSheng'sphone. -- Original -- From: apmail-wusheng-owner https://shardingsphere.apache.org/ gt; [2] gt; https://shardingsphere.apache.org/document/current/en/quick-start/sharding-proxy-quick-start/ gt; [3] https://github.com/apache/skywalking/tree/master/install gt; [4 ] gt; https://github.com/apache/skywalking/blob/master/docs/en/setup/backend/backend-storage.md gt; [5] https://github.com/apache/skywalking/issues/4131 gt; gt; gt; gt; gt; gt;nbsp; Juan Pan (Trista) gt; gt; Senior DBA amp; PPMC of Apache ShardingSphere(Incubating) gt; E-mail: panj...@apache.org gt; gt; gt; gt;
Re: [DISCUSS] Optimization for Sharing Parser with Antlr Visitor
Hi Nicholas, Very appreciated for your close follow-up for this thread. You can learn more about the most recent progress of this task here [1]. I am handling this issue, and when i need your assistance, could i ping you then? Regards, Trista [1] https://github.com/apache/incubator-shardingsphere/issues/4335 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/16/2020 22:16，蒋晓峰 wrote： Hi Juan, What's the plan of improvements for new MySQL parser? I found no email including something about improvements for new MySQL parser. Thanks, Nicholas On Thu, Feb 13, 2020 at 3:17 PM Juan Pan wrote: Hi everyone, Good news for us that we basically finish the parser refactoring for MySQL.[1] Specially thanks for @terrymanu @SteNicholas @dongzl @tianbin1001 @beijing-penguin! Our next step is to do some improvements for new MySQL parser, and continue working on parser refactoring for other databases. So Veterans, would you like to move on? Additionally, we welcome anyone to join us for parser integrated tests! Please reply to give your comment. Best wishes, [1] https://github.com/apache/incubator-shardingsphere/issues/3914 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/12/2020 10:32，Juan Pan wrote： Kind reminder, If you could not edit issue, please be free to contact any committer or reply this email then i will provide you any help. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/12/2020 10:25，Juan Pan wrote： Hi everyone, The task of `DML SQL Visitor` has made some progress, and i updated the status of issue #3914. However, i am unclear of others’ progress, any changes, could you please update the issue[1][2]? [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 [2] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/7/2020 11:51，Juan Pan wrote： Hi Provide feedback on task progress, refer to [1] to learn more. Welcome your any suggestion. [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/2/2020 18:04，Juan Pan wrote： Hi everyone, Thanks for your attention. I am glad to tell the community that this long-term task has been on the right way and made some progress. Please refer to [1] for its detailed progress. Many thanks for the contributions from SteNicholas, dongzl, jingshanglu, tianbin1001 and beijing-penguin and your effort make this progress possible. However there are many optimization and work for community to do for this task, so we welcome everyone interested in it to join us! Hope your good health during this special Chinese new year. - [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/9/2020 14:20，Juan Pan wrote： Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re: [DISCUSS] Add Apache ShardingSphere as the server storage for Apache SkyWalking
That exactly what i concerned, moreover thanks for your joining. Could you tell me which part you are interested in, so that we can share the task list and work together. :-) Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/17/2020 00:34?? Sheng Wu wrote?? Hi Which part or both? ShengWu FromWuSheng'sphone. -- Original -- From: apmail-wusheng-owner https://shardingsphere.apache.org/ gt; [2] gt; https://shardingsphere.apache.org/document/current/en/quick-start/sharding-proxy-quick-start/ gt; [3] https://github.com/apache/skywalking/tree/master/install gt; [4 ] gt; https://github.com/apache/skywalking/blob/master/docs/en/setup/backend/backend-storage.md gt; [5] https://github.com/apache/skywalking/issues/4131 gt; gt; gt; gt; gt; gt;nbsp; Juan Pan (Trista) gt; gt; Senior DBA amp; PPMC of Apache ShardingSphere(Incubating) gt; E-mail: panj...@apache.org gt; gt; gt; gt;
Re: [DISCUSS] Add Apache ShardingSphere as the server storage for Apache SkyWalking
Make sense to me, thanks for your reply. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/16/2020 22:20，Sheng Wu wrote： Juan Pan 于2020年2月16日周日 下午6:36写道： Hi fellows, I am working on providing ShardingSphere[1] as one of the server storages for Skywalking. ShardingSphere will help shard the data collected by Skywalking into different databases(Popular RDBMS, like MySQL, PostgreSQL and so on) and tables to seek better query performance and do scale-out of database. Since it is not an easy job, and needs some helps from community, i put task schedule and discussion items here to welcome your comments and suggestions. If you are interested in this one, welcome to be my partner! :-) Here is the schedule, 1. Acquire all required tables and query SQLs from db logs, like general log of MySQL. [DONE] 2. Analyse those tables and query SQLs to explore appropriate sharding strategy.[DOING] 3. Provide class implementation of `PreciseShardingAlgorithm` and `RangeShardingAlgorithm` of ShardingSphere to do sharding.[TODO] 4. Provide configuration of Sharding Proxy[2] for Skywalking.[TODO] 5. Provide Acceptance test(maybe e2e tests of Skywalking?).[TODO Yes. We call it e2e. You could find many storage implementation tests there. Zhenxu Ke and Haochao Zhuang are the two leading this part. BTW, your plan looks good to me. Sheng Wu 吴晟 Twitter, wusheng1108 ] 6. Update readme[3].[TODO] 7. Update storage doc[4].[TODO] - It seems a long-term work, and i will do it step by step. Any progress will be updated here, also ISSUE [5] will give you thread of PRs and discussion detail. [1] https://shardingsphere.apache.org/ [2] https://shardingsphere.apache.org/document/current/en/quick-start/sharding-proxy-quick-start/ [3] https://github.com/apache/skywalking/tree/master/install [4 ] https://github.com/apache/skywalking/blob/master/docs/en/setup/backend/backend-storage.md [5] https://github.com/apache/skywalking/issues/4131 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
[DISCUSS] Add Apache ShardingSphere as the server storage for Apache SkyWalking
Hi fellows, I am working on providing ShardingSphere[1] as one of the server storages for Skywalking. ShardingSphere will help shard the data collected by Skywalking into different databases(Popular RDBMS, like MySQL, PostgreSQL and so on) and tables to seek better query performance and do scale-out of database. Since it is not an easy job, and needs some helps from community, i put task schedule and discussion items here to welcome your comments and suggestions. If you are interested in this one, welcome to be my partner! :-) Here is the schedule, 1. Acquire all required tables and query SQLs from db logs, like general log of MySQL. [DONE] 2. Analyse those tables and query SQLs to explore appropriate sharding strategy.[DOING] 3. Provide class implementation of `PreciseShardingAlgorithm` and `RangeShardingAlgorithm` of ShardingSphere to do sharding.[TODO] 4. Provide configuration of Sharding Proxy[2] for Skywalking.[TODO] 5. Provide Acceptance test(maybe e2e tests of Skywalking?).[TODO] 6. Update readme[3].[TODO] 7. Update storage doc[4].[TODO] - It seems a long-term work, and i will do it step by step. Any progress will be updated here, also ISSUE [5] will give you thread of PRs and discussion detail. [1] https://shardingsphere.apache.org/ [2] https://shardingsphere.apache.org/document/current/en/quick-start/sharding-proxy-quick-start/ [3] https://github.com/apache/skywalking/tree/master/install [4 ]https://github.com/apache/skywalking/blob/master/docs/en/setup/backend/backend-storage.md [5] https://github.com/apache/skywalking/issues/4131 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
The preparation process for graduation is clear now, anything i can help, please tell me. Thanks. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/15/2020 17:58，zhangli...@apache.org wrote： Remain tasks: - Remove author information in java code. [TODO] - Some remain codes[1] still using the old package name `io.shardingsphere`, we plan to rename them as `io.opensharding`. [TODO] - Major contributors sign ICLA. [DONE] - Discuss PMC list. [DONE] [1] https://github.com/OpenSharding -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年2月15日周六 下午5:57写道： I am OK to remove them from the PMC list. But maybe keep them in the committer? At least, they used to contribute to the community a lot. Agree. -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年2月15日周六 下午2:12写道： I am OK to remove them from the PMC list. But maybe keep them in the committer? At least, they used to contribute to the community a lot. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年2月15日周六 下午1:53写道： Ling Yue and Yongsheng Peng have no response for the invitation and they do not interest during ShardingSphere incubating, how about remove them from PMC and committer list? Other person will be the member of ShardingSphere PMC. Any suggestion? -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年2月15日周六 下午1:48写道： The invitation has finished, I paste the result here: Invitation result: Like to be the member of ShardingSphere PMC: - Liang Zhang - Hongtao Gao - Sheng Wu - Juan Pan - Jun Zhao - Yi Yang - Yonglun Zhang - Gosling Von - Gosling Von - QingYang Chen - Willem Jiang - Hongjun Du - Xiaoguang Ma - Hao Cao No response: - Yongsheng Peng - Ling Yue -- Liang Zhang (John) Apache ShardingSphere & Dubbo Hongtao Gao 于2020年2月12日周三 上午10:28写道： I agree with that, the current important task to gather all members to build a group and I have replied to that mail. And I'm going to share my work through the public channels, for instance, mail list and issue. Let more members know what am I doing or will do. Thanks, Hongtao Craig Russell 于2020年2月12日周三 上午12:30写道： Hi Hongtao Gao, Obviously I was unaware of your contributions to the community. The important thing is to review all contributions and decide as a group. Best regards, Craig On Feb 10, 2020, at 10:43 PM, Hongtao Gao wrote: Hi Craig My current work is more on propagation of ShardingSphere, including off-site meetings and talks in some professional conferences (There will be one in June 2020). And next week I will send a proposal in dev mail list about the k8s controller of shardingshpere, which is talked with some of PMC members on COSCon'19. So I think we should keep my PMC position, Thanks a lot. Craig Russell 于2020年2月11日周二 下午12:57写道： Hi, Maybe I'm misreading the sheet but it looks like Ling Yue and Hongtao Gao have not contributed anything to the project. It looks like they have not been active on mail lists either. If this is true, I'd probably remove them from the proposed PMC. Include them as committers if they had contributions before incubating. Yongsheng Peng did contribute a PR so I would not drop him from the PMC. Finally, I would include all of the PPMC and committers who did contribute during the incubation process. Just a suggestion: If you want only people who are paying attention, you could start a doc with the graduation proposal and ask folks on the dev@ list to add their names if they are interested in becoming part of the PMC. Craig On Feb 6, 2020, at 8:47 AM, zhangli...@apache.org wrote: I agree to remove Yongsheng Peng and always welcome him come back when he feel free. Other initial PPMC had contributed before ShardingSphere go to incubator, I prefer keep them and let them as PMC in future. -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年2月6日周四 下午7:44写道： Hi From my reading of this data, all initial PPMC and current committers are/were contributing to the project a lot with only one exception, Yongsheng Peng. He is SkyWalking's PMC, used to ask contributions to the ShardingSphere, so he was added when the project joined the incubator. But during the journey, he didn't do that. I think it makes sense to remove him. What do others think? Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年2月6日周四 下午5:28写道： Sure, please see google excel doc. [1] [1] https://docs.google.com/spreadsheets/d/19U4t0rAnLbQW02qZlZ1lwZCB7sZxGUiMMmv8zEpee9g/edit?usp=sharing -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年2月6日周四 下午5:14写道： Liang Could you change this to a google excel doc? The email is hard to read. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apach
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
+1 from me to remove them from PMC, and thanks for the contribution they did. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/15/2020 13:52，zhangli...@apache.org wrote： Ling Yue and Yongsheng Peng have no response for the invitation and they do not interest during ShardingSphere incubating, how about remove them from PMC and committer list? Other person will be the member of ShardingSphere PMC. Any suggestion? -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年2月15日周六 下午1:48写道： The invitation has finished, I paste the result here: Invitation result: Like to be the member of ShardingSphere PMC: - Liang Zhang - Hongtao Gao - Sheng Wu - Juan Pan - Jun Zhao - Yi Yang - Yonglun Zhang - Gosling Von - Gosling Von - QingYang Chen - Willem Jiang - Hongjun Du - Xiaoguang Ma - Hao Cao No response: - Yongsheng Peng - Ling Yue -- Liang Zhang (John) Apache ShardingSphere & Dubbo Hongtao Gao 于2020年2月12日周三 上午10:28写道： I agree with that, the current important task to gather all members to build a group and I have replied to that mail. And I'm going to share my work through the public channels, for instance, mail list and issue. Let more members know what am I doing or will do. Thanks, Hongtao Craig Russell 于2020年2月12日周三 上午12:30写道： Hi Hongtao Gao, Obviously I was unaware of your contributions to the community. The important thing is to review all contributions and decide as a group. Best regards, Craig On Feb 10, 2020, at 10:43 PM, Hongtao Gao wrote: Hi Craig My current work is more on propagation of ShardingSphere, including off-site meetings and talks in some professional conferences (There will be one in June 2020). And next week I will send a proposal in dev mail list about the k8s controller of shardingshpere, which is talked with some of PMC members on COSCon'19. So I think we should keep my PMC position, Thanks a lot. Craig Russell 于2020年2月11日周二 下午12:57写道： Hi, Maybe I'm misreading the sheet but it looks like Ling Yue and Hongtao Gao have not contributed anything to the project. It looks like they have not been active on mail lists either. If this is true, I'd probably remove them from the proposed PMC. Include them as committers if they had contributions before incubating. Yongsheng Peng did contribute a PR so I would not drop him from the PMC. Finally, I would include all of the PPMC and committers who did contribute during the incubation process. Just a suggestion: If you want only people who are paying attention, you could start a doc with the graduation proposal and ask folks on the dev@ list to add their names if they are interested in becoming part of the PMC. Craig On Feb 6, 2020, at 8:47 AM, zhangli...@apache.org wrote: I agree to remove Yongsheng Peng and always welcome him come back when he feel free. Other initial PPMC had contributed before ShardingSphere go to incubator, I prefer keep them and let them as PMC in future. -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年2月6日周四 下午7:44写道： Hi From my reading of this data, all initial PPMC and current committers are/were contributing to the project a lot with only one exception, Yongsheng Peng. He is SkyWalking's PMC, used to ask contributions to the ShardingSphere, so he was added when the project joined the incubator. But during the journey, he didn't do that. I think it makes sense to remove him. What do others think? Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年2月6日周四 下午5:28写道： Sure, please see google excel doc. [1] [1] https://docs.google.com/spreadsheets/d/19U4t0rAnLbQW02qZlZ1lwZCB7sZxGUiMMmv8zEpee9g/edit?usp=sharing -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年2月6日周四 下午5:14写道： Liang Could you change this to a google excel doc? The email is hard to read. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年2月6日周四 下午5:12写道： The statistics after incubator: PPMCs: | *Name*| *Mails* | *Assigned Issues* | *Merged PRs* | *Code ++* | *Code --* | *Doc ++* | *Doc --* | | - | --- | - | | - | - | | | | Hao Cao | 6 | 2 | 14 | 1,278 | 44| 5| 5| | Hongjun Du| 12 | 38| 67 | 38,788 | 33,670| 2| 0| | Hongtao Gao | 2 | 0 | 0 | 0 | 0 | 0 | 0| | Juan Pan | 167 | 85| 319 | 91,675 | 71,611| 1,300,919| 1,284,356| | Jun Zhao | 46 | 76| 130 | 166,356 | 170,890 | 2,138| 2,122| | Liang Zhang | 279 | 130 | 164 | 1,198,935 | 1,245,278 | 691,617 | 54,337 | | Ling Yue | 0 | 0
Re:[DISCUSS] Remove some class members from `WhereSegment`
Hi I assumed this is a lazy consensus, so PR [1] was raised to fix this issue. If you have any objection, please speak up. [1] https://github.com/apache/incubator-shardingsphere/pull/4290 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/13/2020 14:43，Juan Pan wrote： Hi everyone, I found the class member `parametersCount` and `parameterMarkerStartIndex` of `WhereSegment .java` are written, but do not used or read by any other objects. So i plan to remove them to simply our parsing module and integrated tests. If i miss something, please tell me ASAP. Regards, Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re:[DISCUSS] Optimization for Sharing Parser with Antlr Visitor
Hi everyone, Good news for us that we basically finish the parser refactoring for MySQL.[1] Specially thanks for @terrymanu @SteNicholas @dongzl @tianbin1001 @beijing-penguin! Our next step is to do some improvements for new MySQL parser, and continue working on parser refactoring for other databases. So Veterans, would you like to move on? Additionally, we welcome anyone to join us for parser integrated tests! Please reply to give your comment. Best wishes, [1] https://github.com/apache/incubator-shardingsphere/issues/3914 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/12/2020 10:32，Juan Pan wrote： Kind reminder, If you could not edit issue, please be free to contact any committer or reply this email then i will provide you any help. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/12/2020 10:25，Juan Pan wrote： Hi everyone, The task of `DML SQL Visitor` has made some progress, and i updated the status of issue #3914. However, i am unclear of others’ progress, any changes, could you please update the issue[1][2]? [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 [2] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/7/2020 11:51，Juan Pan wrote： Hi Provide feedback on task progress, refer to [1] to learn more. Welcome your any suggestion. [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/2/2020 18:04，Juan Pan wrote： Hi everyone, Thanks for your attention. I am glad to tell the community that this long-term task has been on the right way and made some progress. Please refer to [1] for its detailed progress. Many thanks for the contributions from SteNicholas, dongzl, jingshanglu, tianbin1001 and beijing-penguin and your effort make this progress possible. However there are many optimization and work for community to do for this task, so we welcome everyone interested in it to join us! Hope your good health during this special Chinese new year. - [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/9/2020 14:20，Juan Pan wrote： Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
[DISCUSS] Remove some class members from `WhereSegment`
Hi everyone, I found the class member `parametersCount` and `parameterMarkerStartIndex` of `WhereSegment .java` are written, but do not used or read by any other objects. So i plan to remove them to simply our parsing module and integrated tests. If i miss something, please tell me ASAP. Regards, Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re: [DISCUSS] merge docs and example repos into trunk repo
Hi community, ISSUE [1] concerning doc merging has fixed already. Once redundant branch of sharding-sphere-doc is deleted, there will be a successful end. [1] https://github.com/apache/incubator-shardingsphere/issues/4243 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/12/2020 13:24，Juan Pan wrote： Hi We find there are some improvements to do for `incubator-shardingsphere/docs`, which i am working on, so once it makes some headway, i will update here. Please refer to issue[1] to learn more. [1] https://github.com/apache/incubator-shardingsphere/issues/4243 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/10/2020 20:58，Zhang Yonglun wrote： incubator-shardingsphere-doc has been merged into incubator-shardingsphere/docs via https://github.com/apache/incubator-shardingsphere/pull/4226 -- Zhang Yonglun Apache ShardingSphere guangyuan wang 于2020年1月20日周一 下午4:58写道： I think it's a good idea. As I am a contributor whose first contribution in the sharding sphere is the modification in docs. This will encourage the contributor to participate in the sharding sphere, especially for those new players. Zhiyi Yan 于2020年1月17日周五 下午3:49写道： +1. Good idea! It makes easier to find examples. - Zhiyi Yan (Zhyee) Apache ShardingSphere zhangli...@apache.org 于2020年1月17日周五 下午12:16写道： Hi ShardingSphere community, I'd like to discuss about merge docs[1] and examples[2] repos into the trunk repo[3]. The benefit is encourage potential contributors begin from docs and examples. Docs and examples are same important with source codes, it is a good way to decrease the bar to participant the community. After merging, the structure of project may be: ``` -- src -- docs -- examples ``` Any suggestions? [1] https://github.com/apache/incubator-shardingsphere-doc [2] https://github.com/apache/incubator-shardingsphere-example [3] https://github.com/apache/incubator-shardingsphere -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: [DISCUSS] merge docs and example repos into trunk repo
Hi We find there are some improvements to do for `incubator-shardingsphere/docs`, which i am working on, so once it makes some headway, i will update here. Please refer to issue[1] to learn more. [1] https://github.com/apache/incubator-shardingsphere/issues/4243 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/10/2020 20:58，Zhang Yonglun wrote： incubator-shardingsphere-doc has been merged into incubator-shardingsphere/docs via https://github.com/apache/incubator-shardingsphere/pull/4226 -- Zhang Yonglun Apache ShardingSphere guangyuan wang 于2020年1月20日周一 下午4:58写道： I think it's a good idea. As I am a contributor whose first contribution in the sharding sphere is the modification in docs. This will encourage the contributor to participate in the sharding sphere, especially for those new players. Zhiyi Yan 于2020年1月17日周五 下午3:49写道： +1. Good idea! It makes easier to find examples. - Zhiyi Yan (Zhyee) Apache ShardingSphere zhangli...@apache.org 于2020年1月17日周五 下午12:16写道： Hi ShardingSphere community, I'd like to discuss about merge docs[1] and examples[2] repos into the trunk repo[3]. The benefit is encourage potential contributors begin from docs and examples. Docs and examples are same important with source codes, it is a good way to decrease the bar to participant the community. After merging, the structure of project may be: ``` -- src -- docs -- examples ``` Any suggestions? [1] https://github.com/apache/incubator-shardingsphere-doc [2] https://github.com/apache/incubator-shardingsphere-example [3] https://github.com/apache/incubator-shardingsphere -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: [DISCUSS] Suggestion For setVariable
Hi jingshang, Thanks for your PR to make it better. In order to make the task status of parser optimization updated, could you give your feedback to [1][2]? [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 [2] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/9/2020 10:43，ternence wrote： Ok, I will support set statement for mysql dialect. 在 2020-02-08 14:57:01，"zhangli...@apache.org" 写道： Sure, the SET statement should distinguish by database dialect, we need to split them. By the way, the apache mailing list cannot display the picture, please use text only in mailing list. -- Liang Zhang (John) Apache ShardingSphere & Dubbo ternence 于2020年2月8日周六 上午10:42写道： Hi , Sharding sql parser module exists problem for setVariable, setVariable like attachment mysql.png now sharding DALStatment.g4 for mysql like attachment sharding.png,and the setStatement is shard by all dbtype. my suggestion is delete shard setStatement ,and each db have its own setstatement. Thanks, Jingshang Lu
Re:[DISCUSS] Optimization for Sharing Parser with Antlr Visitor
Kind reminder, If you could not edit issue, please be free to contact any committer or reply this email then i will provide you any help. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/12/2020 10:25，Juan Pan wrote： Hi everyone, The task of `DML SQL Visitor` has made some progress, and i updated the status of issue #3914. However, i am unclear of others’ progress, any changes, could you please update the issue[1][2]? [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 [2] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/7/2020 11:51，Juan Pan wrote： Hi Provide feedback on task progress, refer to [1] to learn more. Welcome your any suggestion. [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/2/2020 18:04，Juan Pan wrote： Hi everyone, Thanks for your attention. I am glad to tell the community that this long-term task has been on the right way and made some progress. Please refer to [1] for its detailed progress. Many thanks for the contributions from SteNicholas, dongzl, jingshanglu, tianbin1001 and beijing-penguin and your effort make this progress possible. However there are many optimization and work for community to do for this task, so we welcome everyone interested in it to join us! Hope your good health during this special Chinese new year. - [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/9/2020 14:20，Juan Pan wrote： Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re:[DISCUSS] Optimization for Sharing Parser with Antlr Visitor
Hi everyone, The task of `DML SQL Visitor` has made some progress, and i updated the status of issue #3914. However, i am unclear of others’ progress, any changes, could you please update the issue[1][2]? [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 [2] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/7/2020 11:51，Juan Pan wrote： Hi Provide feedback on task progress, refer to [1] to learn more. Welcome your any suggestion. [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/2/2020 18:04，Juan Pan wrote： Hi everyone, Thanks for your attention. I am glad to tell the community that this long-term task has been on the right way and made some progress. Please refer to [1] for its detailed progress. Many thanks for the contributions from SteNicholas, dongzl, jingshanglu, tianbin1001 and beijing-penguin and your effort make this progress possible. However there are many optimization and work for community to do for this task, so we welcome everyone interested in it to join us! Hope your good health during this special Chinese new year. - [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/9/2020 14:20，Juan Pan wrote： Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re:[IMPORTANT][PPMC] Invitation to be ShardingSphere PMC member
Yes, i am willing to be part of PMC and make my effort. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/11/2020 15:40，zhangli...@apache.org wrote： Dear ShardingSphere PPMC members, ShardingSphere community is discussing the graduation of ShardingSphere to be a Top Level project of Apache Software Foundation in the dev mailing list[1]. As one of the steps towards graduation, the community needs to set up list of Project Management Committees (PMC) members after graduation, which will be included in the graduation resolution. The role of the PMC is included as follows[2]: ”The role of the PMC from a Foundation perspective is oversight. The main role of the PMC is not code and not coding - but to ensure that all legal issues are addressed, that procedure is followed, and that each and every release is the product of the community as a whole. That is key to our litigation protection mechanisms. Secondly the role of the PMC is to further the long term development and health of the community as a whole, and to ensure that balanced and wide scale peer review and collaboration does happen. Within the ASF we worry about any community which centers around a few individuals who are working virtually uncontested. We believe that this is detrimental to quality, stability, and robustness of both code and long term social structures.“ If you'd like to be the member of ShardingSphere PMC, please respond YES to this thread by replying to dev@shardingsphere.apache.org no later than 2020-02-14 (Friday). If you are not subscribing the private list, please remember to subscribe to the private@ list. [1] https://lists.apache.org/thread.html/rf6a2cec7143395ac0126dcb13f331fbc87b680eaca015d50d7793172%40%3Cdev.shardingsphere.apache.org%3E [2] http://www.apache.org/foundation/how-it-works.html#pmc -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
> Just a suggestion: If you want only people who are paying attention, you > could start a doc with the graduation proposal and ask folks on the dev@ list > to add their names if they are interested in becoming part of the PMC. +1, kind reminder to them and listen to each PPMC's wish to be PMC or not. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/11/2020 12:56，Craig Russell wrote： Hi, Maybe I'm misreading the sheet but it looks like Ling Yue and Hongtao Gao have not contributed anything to the project. It looks like they have not been active on mail lists either. If this is true, I'd probably remove them from the proposed PMC. Include them as committers if they had contributions before incubating. Yongsheng Peng did contribute a PR so I would not drop him from the PMC. Finally, I would include all of the PPMC and committers who did contribute during the incubation process. Just a suggestion: If you want only people who are paying attention, you could start a doc with the graduation proposal and ask folks on the dev@ list to add their names if they are interested in becoming part of the PMC. Craig On Feb 6, 2020, at 8:47 AM, zhangli...@apache.org wrote: I agree to remove Yongsheng Peng and always welcome him come back when he feel free. Other initial PPMC had contributed before ShardingSphere go to incubator, I prefer keep them and let them as PMC in future. -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年2月6日周四 下午7:44写道： Hi From my reading of this data, all initial PPMC and current committers are/were contributing to the project a lot with only one exception, Yongsheng Peng. He is SkyWalking's PMC, used to ask contributions to the ShardingSphere, so he was added when the project joined the incubator. But during the journey, he didn't do that. I think it makes sense to remove him. What do others think? Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年2月6日周四 下午5:28写道： Sure, please see google excel doc. [1] [1] https://docs.google.com/spreadsheets/d/19U4t0rAnLbQW02qZlZ1lwZCB7sZxGUiMMmv8zEpee9g/edit?usp=sharing -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年2月6日周四 下午5:14写道： Liang Could you change this to a google excel doc? The email is hard to read. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年2月6日周四 下午5:12写道： The statistics after incubator: PPMCs: | *Name*| *Mails* | *Assigned Issues* | *Merged PRs* | *Code ++* | *Code --* | *Doc ++* | *Doc --* | | - | --- | - | | - | - | | | | Hao Cao | 6 | 2 | 14 | 1,278 | 44| 5| 5| | Hongjun Du| 12 | 38| 67 | 38,788 | 33,670| 2| 0| | Hongtao Gao | 2 | 0 | 0| 0 | 0 | 0 | 0| | Juan Pan | 167 | 85| 319 | 91,675 | 71,611| 1,300,919| 1,284,356| | Jun Zhao | 46 | 76| 130 | 166,356 | 170,890 | 2,138| 2,122| | Liang Zhang | 279 | 130 | 164 | 1,198,935 | 1,245,278 | 691,617 | 54,337 | | Ling Yue | 0 | 0 | 0| 0 | 0 | 0| 0| | Qingyang Chen | 9 | 10| 8| 24,115 | 18,901| 237 | 0| | Sheng Wu | 175 | 1 | 2| 18 | 1 | 0| 0| | Xiaoguang Ma | 1 | 2 | 17 | 7,279 | 4,741 | 173 | 60 | | Yi Yang | 56 | 83| 101 | 24,556 | 13,150| 1,289| 217 | | Yonglun Zhang | 87 | 126 | 124 | 103,754 | 65,066| 18,733 | 18,249 | | Yongsheng Peng| 3 | 0 | 1| 262 | 0 | 0| 0| Committers: | *Name*| *Mails* | *Assigned Issues* | *Merged PRs* | *Code ++* | *Code --* | *Doc ++* | *Doc --* | | - | --- | - | | - | - | | | | Guangyuan Wang| 28 | 5 | 21 | 6,130 | 2,458 | 290 | 190 | | Haisheng Sun | 18 | 20| 26 | 4,791 | 1,877 | 12 | 8| | Xiaofeng Jiang| 5 | 21| 31 | 29,296 | 291 | 0| 0| | Qi Wang | 5 | 21| 62 | 24,040 | 10,437| 1,978| 1,968| | Ya Li | 0 | 6 | 21 | 6,070 | 1,282 | 55 | 34 | | Yanan Zhao
Re: [DISCUSS] merge docs and example repos into trunk repo
Great job! Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/10/2020 20:58，Zhang Yonglun wrote： incubator-shardingsphere-doc has been merged into incubator-shardingsphere/docs via https://github.com/apache/incubator-shardingsphere/pull/4226 -- Zhang Yonglun Apache ShardingSphere guangyuan wang 于2020年1月20日周一 下午4:58写道： I think it's a good idea. As I am a contributor whose first contribution in the sharding sphere is the modification in docs. This will encourage the contributor to participate in the sharding sphere, especially for those new players. Zhiyi Yan 于2020年1月17日周五 下午3:49写道： +1. Good idea! It makes easier to find examples. - Zhiyi Yan (Zhyee) Apache ShardingSphere zhangli...@apache.org 于2020年1月17日周五 下午12:16写道： Hi ShardingSphere community, I'd like to discuss about merge docs[1] and examples[2] repos into the trunk repo[3]. The benefit is encourage potential contributors begin from docs and examples. Docs and examples are same important with source codes, it is a good way to decrease the bar to participant the community. After merging, the structure of project may be: ``` -- src -- docs -- examples ``` Any suggestions? [1] https://github.com/apache/incubator-shardingsphere-doc [2] https://github.com/apache/incubator-shardingsphere-example [3] https://github.com/apache/incubator-shardingsphere -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: [DISCUSS] 4.0.1 stable version release plan
This release is mainly to do bug fix and some little optimizations for our Release 4.0.0, right? I am in charge of sharding-parser, and plan it for our release 5.x. Anything if i could do, please tell me. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/10/2020 11:45，zhangli...@apache.org wrote： The enhancement has a little more in name than in reality. Maybe we need change all enhancement tags to bug tags. -- Liang Zhang (John) Apache ShardingSphere & Dubbo Zonglei Dong 于2020年2月10日周一 上午9:57写道： Hi Zhao Jun, I was participated in discussing the 3918[1], I agree with that Metadata model’s redesign is a big refactor 3922[2] I suggest we can merge the 3918’s PR and not care of the Metadata model’s redesign right now, because if we don’t merge it, user may be always meet this bug in 4.x’s version. [1]: https://github.com/apache/incubator-shardingsphere/pull/3918 < https://github.com/apache/incubator-shardingsphere/pull/3918> [2]: https://github.com/apache/incubator-shardingsphere/issues/3922 < https://github.com/apache/incubator-shardingsphere/issues/3922> Thanks. Best wishes. Zonglei Dong Apache ShardingSphere On 02/10/2020 09:31，zhaojun wrote： Hi, Nicholas 3918[1] PR have introduced another bug, see issue 3995[2]. Metada model needs to redesign in 3992[3] This will be a big refactor, so we don’t plan to include it in 4.0.1 [1]: https://github.com/apache/incubator-shardingsphere/pull/3918 < https://github.com/apache/incubator-shardingsphere/pull/3918> [2]: https://github.com/apache/incubator-shardingsphere/issues/3995 < https://github.com/apache/incubator-shardingsphere/issues/3995> [3]: https://github.com/apache/incubator-shardingsphere/issues/3922 < https://github.com/apache/incubator-shardingsphere/issues/3922> -- Zhao Jun (cherrylzhao) Apache ShardingSphere & ServiceComb On Feb 9, 2020, at 8:18 PM, 蒋晓峰 wrote: Hi zhaojun, what about the pull request of https://github.com/apache/incubator-shardingsphere/pull/3918? I thought that this pull request is necessary to 4.0.1 version. Thanks, Nicholas Jiang On Sun, Feb 9, 2020 at 3:44 PM zhaojun wrote: Hi, ShardingSphere community, I’d like to be the release manager of 4.0.1 version. We have done some bug fixes and performance optimization in past month based on 4.0.0. If there is no other requirement, I think we can start to release 4.0.1 recently. ## Bug fixes 3975 oracle insert SQL could not work in encrypt mode 3997 proxy for PostgreSQL decode parameters error in all types except String 4022 none sharding strategy could not config in spring-boot 4052 plain column could not get from resultSet in sharding-encrypt mode 4173 wasNull field was wrong in GroupByStreamMergeResult ## Enhancement 3956 using guava cache to improve parsing performance 4004 optimize COM_STM_EXECUTE of MySQL to support sysbench 4054 optimize antlr performance using two-stage parsing strategy 4205 add class filter constructor to restrict the illegal class from YAML Thanks to these contributors for their code commits. - tuohai666, xiyelife, SteNicholas, KomachiSion, beckhampu, plazmdk Any other task missing here? Please feel free to let me know. -- Zhao Jun (cherrylzhao) Apache ShardingSphere & ServiceComb
Re: [ALC] Request to setup ALC in Beijing
+1 from me. I am tracking this thread. Hope see ACL Beijing setting up, i believe there are much more active PMCs, committers and contributors in Beijing waiting for this good news. Best wishes Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/7/2020 13:50，Sheng Wu wrote： Hi Willem I am interested in helping ALC Beijing. Sorry I didn't respond earlier. +1 from me. I am Apache SkyWalking VP, Incubator PMC, ShardingSphere(incubating) PPMC and mentor of DolphinScheduler(incubating) & ECharts(incubating). ALC Beijing is good news for SkyWalking, ShardingSphere, and DolphinScheduler, which has many initial PMC and active contributors here. Sheng Wu On 2019/12/03 02:50:52, Willem Jiang wrote: Hi, I'm Apache member and there are bunch of Apache project developers in Beijing I know. ALC just give us a very good excuse to hand out and hold meetup together. Regards， Willem - To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org - To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org
Re:[DISCUSS] Optimization for Sharing Parser with Antlr Visitor
Hi Provide feedback on task progress, refer to [1] to learn more. Welcome your any suggestion. [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-583220969 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/2/2020 18:04，Juan Pan wrote： Hi everyone, Thanks for your attention. I am glad to tell the community that this long-term task has been on the right way and made some progress. Please refer to [1] for its detailed progress. Many thanks for the contributions from SteNicholas, dongzl, jingshanglu, tianbin1001 and beijing-penguin and your effort make this progress possible. However there are many optimization and work for community to do for this task, so we welcome everyone interested in it to join us! Hope your good health during this special Chinese new year. - [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/9/2020 14:20，Juan Pan wrote： Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
I think it is ok. If one PPMC was not active(need to discuss the definition) in our mail list, or community, including voting release, nominating new committer, reviewing PRs or do other contribution over half year(i guess) or more after entering into incubator, that means he could not provide appropriate oversight. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/6/2020 11:28，zhangli...@apache.org wrote： I can statistics some data for all PPMCs and committers, which can include count of mails, issues, pull requests, code addition and deletion after we goto incubator, and can statistics last contribution time, does the statistics enough? -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年2月6日周四 上午1:59写道： Before I list all PPMCs and committers, we need to discuss the rule of how to define `inactive` PPMC. The rules maybe: - Stop contribution after ShardingSphere goto incubator. - Rare contribution after ShardingSphere goto incubator. We need to define how to define `rare` too. - Stop contribution during past period until now. The definition of `during past period` maybe one year or half year. If we decide follow these rules, we may let these PPMCs as committers. And do we need to discuss the rules to upgrade committers to PMC? Any suggestions? -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年2月5日周三 下午9:28写道： Zonglei Dong 于2020年2月5日周三 下午9:19写道： Hi Sheng, Liang, As a committer, I want to take on greater responsibility, make more contribution to ShardingSphere and take better practice for Apache Way in the future. I understand some permissions only for PMC(or PPMC), e.g release new version, Does there are any difference between PMC and committer? For release, the committer is enough to go for a release, you just need PMC's vote to make release official. As an active PMC member should 1. Watching the project to follow the Apache way 2. Watching the branding issue, and work on the issues if find it(such as talk with other committer/contributor or 3rd party) 3. Find and promote new committer and PMC member For more, read https://www.apache.org/dev/pmc.html Also, in the Apache, we don't(also shouldn't) require people always active. You could do these in part-time, or when you have time. Thanks. Best wishes. Zonglei Dong Apache ShardingSphere On 02/5/2020 20:34，Sheng Wu wrote： I had the impression that inactive PPMC will be excluded to become PMC. ALL in or not? Do you have the list? I think if some of them stop contributing to the project after joining the incubator, I could exclude those. I nominate myself as project VP because my responsibility is monthly report to incubator, and I will in charge of to report to ASF in future. +1 I would like to keep all PPMC members to PMC, and keep all current committers as committers too. Personally, I prefer to move all committers to PMC. I trust they will follow the more experienced PMC's suggestions and they wouldn't break the ASF rules intentionally. To All committer(but not PMC) What do you think? I would like to support their own decision. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年2月5日周三 下午6:55写道： I would like to keep all PPMC members to PMC, and keep all current committers as committers too. I had the impression that inactive PPMC will be excluded to become PMC. ALL in or not? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/5/2020 17:38，zhangli...@apache.org wrote： I want discuss about project VP, PMC and committer list after graduation. I would like to keep all PPMC members to PMC, and keep all current committers as committers too. The almost committers are new guys for ShardingSphere, they may need more experiences for open source community governance, we can vote committers to PMC one by one after graduation. I nominate myself as project VP because my responsibility is monthly report to incubator, and I will in charge of to report to ASF in future. Any suggestion? -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年1月20日周一 下午3:26写道： Got it, it means those threads are not block for our graduation, and could be done anytime. Yes -- Liang Zhang (John) Apache ShardingSphere & Dubbo Juan Pan 于2020年1月20日周一 上午10:14写道： Got it, it means those threads are not block for our graduation, and could be done anytime. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/19/2020 10:37，Sheng Wu wrote： As far as those docs and examples already in the Apache repos, I think those are irrelavent. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月19日周日 上午10:30写道： +1 Agreeing to put graduation into our upcoming agenda. BTW, do you th
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
> I would like to keep all PPMC members to PMC, and keep all current committers > as committers too. I had the impression that inactive PPMC will be excluded to become PMC. ALL in or not? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 02/5/2020 17:38，zhangli...@apache.org wrote： I want discuss about project VP, PMC and committer list after graduation. I would like to keep all PPMC members to PMC, and keep all current committers as committers too. The almost committers are new guys for ShardingSphere, they may need more experiences for open source community governance, we can vote committers to PMC one by one after graduation. I nominate myself as project VP because my responsibility is monthly report to incubator, and I will in charge of to report to ASF in future. Any suggestion? -- Liang Zhang (John) Apache ShardingSphere & Dubbo zhangli...@apache.org 于2020年1月20日周一 下午3:26写道： Got it, it means those threads are not block for our graduation, and could be done anytime. Yes -- Liang Zhang (John) Apache ShardingSphere & Dubbo Juan Pan 于2020年1月20日周一 上午10:14写道： Got it, it means those threads are not block for our graduation, and could be done anytime. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/19/2020 10:37，Sheng Wu wrote： As far as those docs and examples already in the Apache repos, I think those are irrelavent. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月19日周日 上午10:30写道： +1 Agreeing to put graduation into our upcoming agenda. BTW, do you think we need finish the work discussed in other thread, like moving doc and example repos to ShardingSphere repo? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/17/2020 23:39，zhangli...@apache.org wrote： I list remain issues here: 1. Remove author information in java code, copyright should belong to ASF. 2. Some remain codes[1] still using the old package name `io.shardingsphere`, we plan to rename them as `io.opensharding`. <https://github.com/OpenSharding>3. Let the major contributors to sign ICLA if they haven't singed yet. Please complement the list if I missing anything. [1] https://github.com/OpenSharding -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年1月17日周五 下午6:01写道： From my perspective, we should. Like I said in another thread. I think we should be ready to consider and filter whether we have left any issue before graduation. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年1月17日周五 下午3:10写道： Hello community, I'd like to talk about graduation as TLP for Apache ShardingSphere(Incubator). We were open source at 16th Jan 2016, and entered into ASF incubator in 10th Nov 2018. During the past period in incubator, our community grow up quickly. I summarize some data below: - There are 1301 emails sent by 159 people in dev mailing-list excepted GitBox forwarded; - 2539 Issues created during ASF incubating, 2468 Issues resolved during ASF incubating; - 1073 PRs created during ASF incubating, 918 PRs merged during ASF incubating; - There are 89 contributors for now; - There are 4 versions released successfully conformant to Apache release policy by 3 release managers; - There are 2 new PPMCs and 8 new committers were invited to join the community. We had already finished the Podling Maturity Assessment for ShardingSphere[1], the 34 items are all passed. We had resolved all branding issues which include Logo, GitHub repo, document, website and DockerHub image. Can we talk about when will start to consider about graduate? [1] https://github.com/apache/incubator-shardingsphere/blob/dev/MATURITY.md -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re:[DISCUSS] Optimization for Sharing Parser with Antlr Visitor
Hi everyone, Thanks for your attention. I am glad to tell the community that this long-term task has been on the right way and made some progress. Please refer to [1] for its detailed progress. Many thanks for the contributions from SteNicholas, dongzl, jingshanglu, tianbin1001 and beijing-penguin and your effort make this progress possible. However there are many optimization and work for community to do for this task, so we welcome everyone interested in it to join us! Hope your good health during this special Chinese new year. - [1] https://github.com/apache/incubator-shardingsphere/issues/3914#issuecomment-581108911 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/9/2020 14:20，Juan Pan wrote： Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re:Looking for community development stories
Hi Craig, As the PPMC of Apache ShardingSphere (Incubating), i would like to share our experience of community growing. Hope it could provide some help to you. :-) ## The data of our community growing As i summarized in our dev@list [1], we made a great improvement of community growing last year. More contributors, committers and PPMC joined us during 2019. Many thanks to Craig, Willem Jiang, Gosling, Justin and Sheng Wu. ## How to make community grow up ### Guideline When we entered into incubator at the beginning, actually we did not have a better understanding of Apache way, and could not put community first. A guideline or docs are very important to tell us how to do to, or what we should do to walk on the road of Apache way. And [2] is a good manual, we thought. ### Performance 1. Be open and welcome anyone. Since we are doing open-source, we should not put code beyond community and make the committer bar so high due to worrying about some wrong changes from community. After discussion in thread [3], we made our committer bar lower and began to be open to anyone. 2. Detailed Document Document could help novice learn about your project quickly, and they could get some font help as well. We are continually add something new to documents, like [4], which will help committers do release easier and standard. 3. Volunteer issue list A list of tasks or issues helping people who wants to learn or join to know what issues they can begin with. What’s more, issue list could also provide archived threads for users. 4. Talking open We would like to make our main talkings open to let anyone know what is happening in our community, which gives people sense of participation. Meanwhile, some important discussion or conclusion will be pushed into our dev mail list. 5. Promotion Sometimes, we are invited to give some talkings in conferences or hold our meet-up [5]. It is very important to let people know you, and maybe become interested in you. I guess this is the first step to interact with your community. 6. Listen to mentor or other communities’ advices Just as this title said, we are willing to listen to your valuable opinions or experiences. Would you like to share your idea to us? Thanks in advance. Oh, it is a long article. I guess only a few of people would give it a look… But, i am willing to share those things, and appreciated if you could get something from it. Best wishes to everyone. Trista [1] https://lists.apache.org/thread.html/r344a38974cd737678e23f8f94338a4a022e6b90bc75ea67fef226dde%40%3Cdev.shardingsphere.apache.org%3E [2] https://community.apache.org/apache-way/apache-project-maturity-model.html [3] https://lists.apache.org/thread.html/e8d5ab2ea936fcb1205f7a0ee80aedfae90649c80f96dffa458ef341%40%3Cdev.shardingsphere.apache.org%3E [4] https://shardingsphere.apache.org/community/en/contribute/release/ [5] https://twitter.com/ShardingSphere Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/22/2020 09:30，Craig Russell wrote： Hi, I'm working on a presentation to the Huawei Developer Conference in Shenzhen February 11 on the subject of "Growing Communities The Apache Way". I'd like to share with the audience some stories of Apache Projects that have grown their communities, either in the incubator or after becoming a top level project. What I'd like is some facts to discuss, e.g. community makeup before entering incubator, community exiting incubator, any special actions done by the community to encourage growth, etc. With some details, I can share the projects' successes with the developers at the conference. Any help is very appreciated. I'll need any input by Friday January 31 (10 days from now; a day before FOSDEM). Thanks, Craig Craig L Russell c...@apache.org - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re:Looking for community development stories
Hi Craig, As the PPMC of Apache ShardingSphere (Incubating), i would like to share our experience of community growing. Hope it could provide some help to you. :-) ## The data of our community growing As i summarized in our dev@list [1], we made a great improvement of community growing last year. More contributors, committers and PPMC joined us during 2019. Many thanks to Craig, Willem Jiang, Gosling, Justin and Sheng Wu. ## How to make community grow up ### Guideline When we entered into incubator at the beginning, actually we did not have a better understanding of Apache way, and could not put community first. A guideline or docs are very important to tell us how to do to, or what we should do to walk on the road of Apache way. And [2] is a good manual, we thought. ### Performance 1. Be open and welcome anyone. Since we are doing open-source, we should not put code beyond community and make the committer bar so high due to worrying about some wrong changes from community. After discussion in thread [3], we made our committer bar lower and began to be open to anyone. 2. Detailed Document Document could help novice learn about your project quickly, and they could get some font help as well. We are continually add something new to documents, like [4], which will help committers do release easier and standard. 3. Volunteer issue list A list of tasks or issues helping people who wants to learn or join to know what issues they can begin with. What’s more, issue list could also provide archived threads for users. 4. Talking open We would like to make our main talkings open to let anyone know what is happening in our community, which gives people sense of participation. Meanwhile, some important discussion or conclusion will be pushed into our dev mail list. 5. Promotion Sometimes, we are invited to give some talkings in conferences or hold our meet-up [5]. It is very important to let people know you, and maybe become interested in you. I guess this is the first step to interact with your community. 6. Listen to mentor or other communities’ advices Just as this title said, we are willing to listen to your valuable opinions or experiences. Would you like to share your idea to us? Thanks in advance. Oh, it is a long article. I guess only a few of people would give it a look… But, i am willing to share those things, and appreciated if you could get something from it. Best wishes to everyone. Trista [1] https://lists.apache.org/thread.html/r344a38974cd737678e23f8f94338a4a022e6b90bc75ea67fef226dde%40%3Cdev.shardingsphere.apache.org%3E [2] https://community.apache.org/apache-way/apache-project-maturity-model.html [3] https://lists.apache.org/thread.html/e8d5ab2ea936fcb1205f7a0ee80aedfae90649c80f96dffa458ef341%40%3Cdev.shardingsphere.apache.org%3E [4] https://shardingsphere.apache.org/community/en/contribute/release/ [5] https://twitter.com/ShardingSphere Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/22/2020 09:30，Craig Russell wrote： Hi, I'm working on a presentation to the Huawei Developer Conference in Shenzhen February 11 on the subject of "Growing Communities The Apache Way". I'd like to share with the audience some stories of Apache Projects that have grown their communities, either in the incubator or after becoming a top level project. What I'd like is some facts to discuss, e.g. community makeup before entering incubator, community exiting incubator, any special actions done by the community to encourage growth, etc. With some details, I can share the projects' successes with the developers at the conference. Any help is very appreciated. I'll need any input by Friday January 31 (10 days from now; a day before FOSDEM). Thanks, Craig Craig L Russell c...@apache.org - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
Got it, it means those threads are not block for our graduation, and could be done anytime. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/19/2020 10:37，Sheng Wu wrote： As far as those docs and examples already in the Apache repos, I think those are irrelavent. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月19日周日 上午10:30写道： +1 Agreeing to put graduation into our upcoming agenda. BTW, do you think we need finish the work discussed in other thread, like moving doc and example repos to ShardingSphere repo? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/17/2020 23:39，zhangli...@apache.org wrote： I list remain issues here: 1. Remove author information in java code, copyright should belong to ASF. 2. Some remain codes[1] still using the old package name `io.shardingsphere`, we plan to rename them as `io.opensharding`. <https://github.com/OpenSharding>3. Let the major contributors to sign ICLA if they haven't singed yet. Please complement the list if I missing anything. [1] https://github.com/OpenSharding -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年1月17日周五 下午6:01写道： From my perspective, we should. Like I said in another thread. I think we should be ready to consider and filter whether we have left any issue before graduation. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年1月17日周五 下午3:10写道： Hello community, I'd like to talk about graduation as TLP for Apache ShardingSphere(Incubator). We were open source at 16th Jan 2016, and entered into ASF incubator in 10th Nov 2018. During the past period in incubator, our community grow up quickly. I summarize some data below: - There are 1301 emails sent by 159 people in dev mailing-list excepted GitBox forwarded; - 2539 Issues created during ASF incubating, 2468 Issues resolved during ASF incubating; - 1073 PRs created during ASF incubating, 918 PRs merged during ASF incubating; - There are 89 contributors for now; - There are 4 versions released successfully conformant to Apache release policy by 3 release managers; - There are 2 new PPMCs and 8 new committers were invited to join the community. We had already finished the Podling Maturity Assessment for ShardingSphere[1], the 34 items are all passed. We had resolved all branding issues which include Logo, GitHub repo, document, website and DockerHub image. Can we talk about when will start to consider about graduate? [1] https://github.com/apache/incubator-shardingsphere/blob/dev/MATURITY.md -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: [DISCUSS] Optimization for Sharing Parser with Antlr Visitor
Here are some detail, 1. Finish parser refactoring of MySQL It is better to finish the following child tasks(from easy level to hard level) in order before 15th Feb. 1.1 TCLStatement.g4 and DCLStatement.g4 1.2 DALStatement.g4 and DDLStatement.g4 1.3 DMLStatement.g4 2. Finish parser refactoring of Oracle, PostgreSQL, SQLServer, SQL92 After completing the above task, those branches could begin simultaneously. This plan is a huge one, and we would like to welcome more people to join. Thanks Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/17/2020 16:15，Nicholas wrote： Hi Juan, About "Optimization for Sharing Parser with Antlr Visitor", does the refactor have any roadmap or subtask that provides community developers to choose for contribution? This could attract more developers to contribute to parser refactoring. Thanks, Nicholas On 2020/01/09 06:20:48, "Juan Pan" wrote: Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re: Talk about graduation as TLP for Apache ShardingSphere(Incubator)
+1 Agreeing to put graduation into our upcoming agenda. BTW, do you think we need finish the work discussed in other thread, like moving doc and example repos to ShardingSphere repo? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/17/2020 23:39，zhangli...@apache.org wrote： I list remain issues here: 1. Remove author information in java code, copyright should belong to ASF. 2. Some remain codes[1] still using the old package name `io.shardingsphere`, we plan to rename them as `io.opensharding`. <https://github.com/OpenSharding>3. Let the major contributors to sign ICLA if they haven't singed yet. Please complement the list if I missing anything. [1] https://github.com/OpenSharding -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年1月17日周五 下午6:01写道： From my perspective, we should. Like I said in another thread. I think we should be ready to consider and filter whether we have left any issue before graduation. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年1月17日周五 下午3:10写道： Hello community, I'd like to talk about graduation as TLP for Apache ShardingSphere(Incubator). We were open source at 16th Jan 2016, and entered into ASF incubator in 10th Nov 2018. During the past period in incubator, our community grow up quickly. I summarize some data below: - There are 1301 emails sent by 159 people in dev mailing-list excepted GitBox forwarded; - 2539 Issues created during ASF incubating, 2468 Issues resolved during ASF incubating; - 1073 PRs created during ASF incubating, 918 PRs merged during ASF incubating; - There are 89 contributors for now; - There are 4 versions released successfully conformant to Apache release policy by 3 release managers; - There are 2 new PPMCs and 8 new committers were invited to join the community. We had already finished the Podling Maturity Assessment for ShardingSphere[1], the 34 items are all passed. We had resolved all branding issues which include Logo, GitHub repo, document, website and DockerHub image. Can we talk about when will start to consider about graduate? [1] https://github.com/apache/incubator-shardingsphere/blob/dev/MATURITY.md -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re:[DISCUSS] merge docs and example repos into trunk repo
If so, i guess our users would not ask any question concerning examples repo any more. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/17/2020 12:15，zhangli...@apache.org wrote： Hi ShardingSphere community, I'd like to discuss about merge docs[1] and examples[2] repos into the trunk repo[3]. The benefit is encourage potential contributors begin from docs and examples. Docs and examples are same important with source codes, it is a good way to decrease the bar to participant the community. After merging, the structure of project may be: ``` -- src -- docs -- examples ``` Any suggestions? [1] https://github.com/apache/incubator-shardingsphere-doc [2] https://github.com/apache/incubator-shardingsphere-example [3] https://github.com/apache/incubator-shardingsphere -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re:[Great time] We are expecting our 200th contributor in the main repo
congrats! Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/17/2020 10:02，Sheng Wu wrote： Hi all dev community We have been a Top Level Project in the Apache Software Foundation for about 8-9 months, we progress a lot, with 150+ open users, 12k+ stars and widely used in the enterprises, especially big ones. The more exciting thing is, we are reaching the 200 contributors soon, now, we have 199 for the single main repo. https://github.com/apache/skywalking. It is a super good sign that we have an active dev community around the world. Thanks all for being a part of this community. Happy Chinese New Year, and having a good vacation for many of you. Looking forward we make a greater journey next Chinese year and our new 2020. Good luck, SkyWalker(s). Sheng Wu 吴晟 Twitter, wusheng1108
Re:The 2019 Summary of ShardingSphere community
Sorry, a typo. Hope you could be our committer. :) Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/17/2020 10:51，Juan Pan wrote： Hi Shixiang, We are appreciated to have more contributors like you, hope you could be your committer ASAP. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/17/2020 09:23，sushixiang wrote： I am honored to witness and participate in the development of the community, and I believe the community will get better and better. Happy Chinese new year to everyone! --Original-- From:"Juan Pan"
Re:The 2019 Summary of ShardingSphere community
Hi Shixiang, We are appreciated to have more contributors like you, hope you could be your committer ASAP. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/17/2020 09:23，sushixiang wrote： I am honored to witness and participate in the development of the community, and I believe the community will get better and better. Happy Chinese new year to everyone! --Original-- From:"Juan Pan"
Re: The 2019 Summary of ShardingSphere community
Thanks for our experienced PPMC’s suggestion, i hope so. Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/16/2020 21:02，Sheng Wu wrote： Congrats to the whole community, and be honored as a part of the team. Happy Chinese new year to everyone. And in my mind, after the vacation of many of us, we could start the discussion about graduation. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月16日周四 下午8:42写道： Hello community, Although our 2020 journey has begun, it is worth reviewing what we did during last year and sharing the great progress we made with everyone in community. Here are some roughly interesting data from January 2019 to December 2019. Compared with 513 PRs in gitHub during 2018, 870+ PRs were merged into our dev branch last year. GitHub stars increased by 50%, compared to 6k at the beginning of 2019. 4 versions released successfully conformant to Apache release policy. 2 PPMCs and 8 committers were invited to join our community. 62 contributors did contribution for our community last year. This figure in 2018 was about 29. Although those figures are merely part of community data, it is the clear evidence that we made a great progress during 2019. All those grow-up are thanks to everyone in our community! Special thanks to Craig, Willem, Gosling and Justin. What you shared in Apache meetups shed lights on how to make our community active and diverse and gave us much of help. Many thanks to our PPMCs and committers. Your efforts made our community run pretty in order. Last but not least, many thanks to contributors and subscribers. You are important force to ShardingSphere community. In further, there are a lot of work and improvement need to do. Hope we can keep carrying on with passion and make our community more 'Apache way'. Any comment, suggestion, opinion are welcomed here, please step farword to say whatever you want! Warm greetings to you and your family, hope you could become who you are. Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
The 2019 Summary of ShardingSphere community
Hello community, Although our 2020 journey has begun, it is worth reviewing what we did during last year and sharing the great progress we made with everyone in community. Here are some roughly interesting data from January 2019 to December 2019. Compared with 513 PRs in gitHub during 2018, 870+ PRs were merged into our dev branch last year. GitHub stars increased by 50%, compared to 6k at the beginning of 2019. 4 versions released successfully conformant to Apache release policy. 2 PPMCs and 8 committers were invited to join our community. 62 contributors did contribution for our community last year. This figure in 2018 was about 29. Although those figures are merely part of community data, it is the clear evidence that we made a great progress during 2019. All those grow-up are thanks to everyone in our community! Special thanks to Craig, Willem, Gosling and Justin. What you shared in Apache meetups shed lights on how to make our community active and diverse and gave us much of help. Many thanks to our PPMCs and committers. Your efforts made our community run pretty in order. Last but not least, many thanks to contributors and subscribers. You are important force to ShardingSphere community. In further, there are a lot of work and improvement need to do. Hope we can keep carrying on with passion and make our community more 'Apache way'. Any comment, suggestion, opinion are welcomed here, please step farword to say whatever you want! Warm greetings to you and your family, hope you could become who you are. Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re:[DISCUSS] Optimization for Sharing Parser with Antlr Visitor
FYI, refer to [1] to learn the details more. [1] https://github.com/apache/incubator-shardingsphere/issues/3914 Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/9/2020 14:20，Juan Pan wrote： Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re:[DISCUSS] Optimization for Sharing Parser with Antlr Visitor
Hi folks, Groundwork for our new parser has already finished ahead of schedule, mainly including adding visitor entrance classes for different databases and creating new parsed integrated test architecture. At present, we would like to invite anyone who is experienced or interested in ANTLR and SQL parser to join this long-term task for our 5.x release! Welcome step forward and give your comment if you want to be part of this important task. :-) Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/9/2020 14:20，Juan Pan wrote： Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
[DISCUSS] Optimization for Sharing Parser with Antlr Visitor
Hi folks, It is not common practice and prone to low performance that `ExtractorEngine` and `FillerEngine` are used to get final SQL parsed result based on AST generated by ANTLR at present. Upon investigation, we would like to replace them with ANTLR visitor. It is scheduled as a long-term task and a big change for our 5.x release, and currently i am trying to do some basic work for our new branch[1]. After the groundwork (Roughly estimated time is one week. ) is basically laid, we would like to welcome anyone who is interested in it to join us for this wonderful sharding parser. Please watch this thread for follow-up. What’s more, welcome your any comment and suggestion! [1] https://github.com/apache/incubator-shardingsphere/tree/sharding-parser-5.x Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
[ANNOUNCE] New committer: Xiaofeng Jiang
Hi everyone, TheProjectManagementCommittee(PMC)forApache ShardingSphere hasinvited Xiaofeng Jiang tobecomeacommitterandwearepleasedtoannouncethathehasaccepted. Xiaofeng is being active in ShardingSphere community, and we are glad to see his more interactions with community in the future. Welcome Xiaofeng, and please enjoy your journey.:) Best wishes, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere
Re: Draft board report for January 2020
Totally agree. It deserves praise that rotate chair annually and run Calcite community so active and in order. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/7/2020 04:17，Julian Hyde wrote： Is it worth mentioning that we have a new PMC chair? (Of course you’re too modest to mention it.) I am proud of the fact that we change the chair annually, and are now on our fifth (distinct) chair. Orderly transfer of power is a mark of a stable democracy. On Jan 5, 2020, at 2:29 AM, Stamatis Zampetakis wrote: @Andrei: If I remember well both Ignite and Hazelcast decided to adopt Calcite and we mentioned Ignite in the previous board report. Best, Stamatis On Thu, Jan 2, 2020 at 9:49 PM Andrei Sereda wrote: +1 Question regarding Hazelcast : Finally, the Hazelcast system has decided to adopt Calcite for query planning. Was it Ignite [1] or Hazelcast team to adopt (prototype) Calcite ? https://lists.apache.org/thread.html/4211dbbe35690e70462370886afcbb35419ff016b0ee604acf07a4d3%40%3Cdev.ignite.apache.org%3E [1] On Thu, Jan 2, 2020 at 3:42 PM Rui Wang wrote: Looks nice! Thank you Stamatis! -Rui On Wed, Jan 1, 2020 at 6:52 PM Matt Wang wrote: +1, looks good. Thanks~ --- Best, Matt Wang On 01/2/2020 09:57，Chunwei Lei wrote： +1, looks good. Thanks, Stamatis~~ Best, Chunwei On Thu, Jan 2, 2020 at 8:41 AM Haisheng Yuan wrote: +1, looks good to me. Thanks. - Haisheng -- 发件人：Francis Chuang 日 期：2020年01月02日 04:54:46 收件人： 主 题：Re: Draft board report for January 2020 +1, looks good, Stamatis! On 1/01/2020 9:18 pm, Stamatis Zampetakis wrote: Attached below is a draft of this month's board report. I plan to submit it on January 7. Please let me know if you have any additions or corrections. ## Description: Apache Calcite is a highly customizable framework for parsing and planning queries on data in a wide variety of formats. It allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database. Avatica is a sub-project within Calcite and provides a framework for building local and remote JDBC and ODBC database drivers. Avatica has an independent release schedule and its own repository. ## Issues: There are no issues requiring board attention. ## Membership Data: Apache Calcite was founded 2015-10-22 (4 years ago). There are currently 45 committers and 22 PMC members in this project. The Committer-to-PMC ratio is roughly 2:1. Community changes, past quarter: - Danny Chen was added to the PMC on 2019-10-30. - Haisheng Yuan was added to the PMC on 2019-11-11. - Stamatis Zampetakis was appointed as PMC chair on 2019-12-18, continuing the tradition of the project of rotating the chair every year. - No new committers. Last addition was Mohamed Mohsen on 2019-09-17. ## Project Activity: Calcite 1.21.0 was released in the middle of September, including more than 100 resolved issues and maintaining a release cadence of roughly one release per quarter. Calcite 1.22.0 is under preparation and is expected to be released inside January while at the moment contains more than 230 commits and 150 resolved issues. Avatica 1.16.0 was released in the middle of December, including numerous bug fixes and security improvements while the build system has been migrated from maven to gradle. The build and test infrastructure has been modernized for both Calcite and Avatica, with the migration from maven to gradle, JUnit4 to JUnit5, and the introduction of GitHub actions as part of the CI. The changes shall improve developers experience, code quality, and protect better against regressions. Members of the project participated in ApacheCon EU on October and Flink Forward Asia on November, representing the community, and presenting talks about Calcite. Finally, the Hazelcast system has decided to adopt Calcite for query planning. ## Community Health: Activity levels on mailing lists (37%), git (40%) and JIRA (opened 15%, closed 19%) have increased significantly in the last quarter. One reason is the modernization of the build and test infrastructure for both Calcite and Avatica, which triggered many discussions and follow-up tasks. Another reason, is the changes in the roster of the PMC and open discussions about the future of the project. Last but not least, is the involvement of new people in the community bringing up new challenges and ideas for improvements. The rates of pull requests being closed and merged on Github has increased by 16%, as we work to clear our backlog. Nevertheless, the number of open pull requests is still big since the number of committers who get involved in reviews is rather small. Furthermore, there are pull requests which are stale, work in progress, or proposals that make the numbers look even bigger. On the positive side every pull req
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0
Get your point as well, thanks, Justin. :-) Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/8/2020 11:34，Justin Mclean wrote： Hi, I noticed this too in my dev vote check too. I want to ask, considering the source codes were tagged in 12/30/2019, the NOTICE should be right to keep in 2019 for this release. The year should be the year of publication, but it doesn’t really matter, and if it did it would be when we are long gone :-) Copyright typically lasts for 50 or 70 years after the death of the author. I’d just update it for the next release. Thanks, Justin - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [QUESTION] How could getTableName(columnIndex) return the correct result?
Thanks your explanation, Julian. Does it mean the optimization of this JDBC interface may be included in next release of Calcite? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/7/2020 11:17，Julian Hyde wrote： Yes, we should be returning “” rather than null. (Not an excuse, but that method is so old that I suspect that the authors of JDBC were still thinking in terms of ODBC. In C it’s difficult to return a null, it’s easier to return an empty string.) Julian On Jan 6, 2020, at 7:03 PM, Juan Pan wrote: FYI. The following information comes from `java.sql.ResultSetMetaData`. /** * Gets the designated column's table name. * * @param column the first column is 1, the second is 2, ... * @return table name or "" if not applicable * @exception SQLException if a database access error occurs */ String getTableName(int column) throws SQLException; Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/7/2020 10:56，Juan Pan wrote： Hi Julian, You’re right. From my tests, since “a” is not from table test, getTableName(columnIndex) returns `empty string` from MySQL and H2 databases, and `null` from calcite. It makes sense. The scenario happened to me is that some of third-part applications or open-source projects would call some jdbc interfaces, like getTableName(columnIndex). As a result, when they call getTableName(columnIndex), the null result from calcite makes them throw NPE, but empty string from DBs avoid this case. Julian, very appreciated your help. :-) Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/7/2020 04:12，Julian Hyde wrote： JDBC table names and column names are of limited use. They tell you where a particular column comes from, and your “a” column does not come (directly) from a table. I think you’ll find that Calcite is implementing the JDBC standard correctly, and is consistent with other databases. What do you need the table name for? If you want to understand the structure of the query - e.g. the fact that the query is sourced from the “test” table - then your might be better working with the SqlNode or RelNode representations. The RelNode representation of your query is Aggregate(count(*) as a) ^ | TableScan(“test”) and that probably tells you what you need to know. Julian On Jan 5, 2020, at 11:42 PM, Juan Pan wrote: Hi Calcite Community, Thanks for your attention. After failing self-helping by debug source code, i sent this email for your help. :) My query SQL is `SELECT count(*) a FROM test`, and i called JDBC interface, i.e, `ResultSet.getMetaData().getTableName(1)` to get table name, i.e, test, however the result of which is null. I traced the process and found that if !(selectItem instanceof SqlIdentifier) then return null in `SqlValidatorImpl.java`. Is there any way to get the real table name, i.e, test? Thanks in advance, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re: [QUESTION] How could getTableName(columnIndex) return the correct result?
FYI. The following information comes from `java.sql.ResultSetMetaData`. /** * Gets the designated column's table name. * * @param column the first column is 1, the second is 2, ... * @return table name or "" if not applicable * @exception SQLException if a database access error occurs */ String getTableName(int column) throws SQLException; Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/7/2020 10:56，Juan Pan wrote： Hi Julian, You’re right. From my tests, since “a” is not from table test, getTableName(columnIndex) returns `empty string` from MySQL and H2 databases, and `null` from calcite. It makes sense. The scenario happened to me is that some of third-part applications or open-source projects would call some jdbc interfaces, like getTableName(columnIndex). As a result, when they call getTableName(columnIndex), the null result from calcite makes them throw NPE, but empty string from DBs avoid this case. Julian, very appreciated your help. :-) Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/7/2020 04:12，Julian Hyde wrote： JDBC table names and column names are of limited use. They tell you where a particular column comes from, and your “a” column does not come (directly) from a table. I think you’ll find that Calcite is implementing the JDBC standard correctly, and is consistent with other databases. What do you need the table name for? If you want to understand the structure of the query - e.g. the fact that the query is sourced from the “test” table - then your might be better working with the SqlNode or RelNode representations. The RelNode representation of your query is Aggregate(count(*) as a) ^ | TableScan(“test”) and that probably tells you what you need to know. Julian On Jan 5, 2020, at 11:42 PM, Juan Pan wrote: Hi Calcite Community, Thanks for your attention. After failing self-helping by debug source code, i sent this email for your help. :) My query SQL is `SELECT count(*) a FROM test`, and i called JDBC interface, i.e, `ResultSet.getMetaData().getTableName(1)` to get table name, i.e, test, however the result of which is null. I traced the process and found that if !(selectItem instanceof SqlIdentifier) then return null in `SqlValidatorImpl.java`. Is there any way to get the real table name, i.e, test? Thanks in advance, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re: [QUESTION] How could getTableName(columnIndex) return the correct result?
Hi Julian, You’re right. From my tests, since “a” is not from table test, getTableName(columnIndex) returns `empty string` from MySQL and H2 databases, and `null` from calcite. It makes sense. The scenario happened to me is that some of third-part applications or open-source projects would call some jdbc interfaces, like getTableName(columnIndex). As a result, when they call getTableName(columnIndex), the null result from calcite makes them throw NPE, but empty string from DBs avoid this case. Julian, very appreciated your help. :-) Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/7/2020 04:12，Julian Hyde wrote： JDBC table names and column names are of limited use. They tell you where a particular column comes from, and your “a” column does not come (directly) from a table. I think you’ll find that Calcite is implementing the JDBC standard correctly, and is consistent with other databases. What do you need the table name for? If you want to understand the structure of the query - e.g. the fact that the query is sourced from the “test” table - then your might be better working with the SqlNode or RelNode representations. The RelNode representation of your query is Aggregate(count(*) as a) ^ | TableScan(“test”) and that probably tells you what you need to know. Julian On Jan 5, 2020, at 11:42 PM, Juan Pan wrote: Hi Calcite Community, Thanks for your attention. After failing self-helping by debug source code, i sent this email for your help. :) My query SQL is `SELECT count(*) a FROM test`, and i called JDBC interface, i.e, `ResultSet.getMetaData().getTableName(1)` to get table name, i.e, test, however the result of which is null. I traced the process and found that if !(selectItem instanceof SqlIdentifier) then return null in `SqlValidatorImpl.java`. Is there any way to get the real table name, i.e, test? Thanks in advance, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
[QUESTION] How could getTableName(columnIndex) return the correct result?
Hi Calcite Community, Thanks for your attention. After failing self-helping by debug source code, i sent this email for your help. :) My query SQL is `SELECT count(*) a FROM test`, and i called JDBC interface, i.e, `ResultSet.getMetaData().getTableName(1)` to get table name, i.e, test, however the result of which is null. I traced the process and found that if !(selectItem instanceof SqlIdentifier) then return null in `SqlValidatorImpl.java`. Is there any way to get the real table name, i.e, test? Thanks in advance, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re:[ANNOUNCE] Release Apache DolphinScheduler (Incubating) 1.2.0
Congrats for DolphinScheduler community. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 19:34，李 岗 wrote： Hi all, We are glad to announce the release of Apache DolphinScheduler(incubating) 1.2.0. Once again I would like to express my thanks to your help. Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system, dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Download Links: http://dolphinscheduler.apache.org/en-us/docs/user_doc/download.html Release Notes: https://github.com/apache/incubator-dolphinscheduler/blob/1.2.0/ReleaseNotes.md Website: https://dolphinscheduler.apache.org/ DolphinScheduler Resources: - Issue: https://github.com/apache/incubator-dolphinscheduler/issues/ - Mailing list: d...@dolphinscheduler.apache.org - Documents: https://github.com/apache/incubator-dolphinscheduler/blob/1.2.0/README.md DolphinScheduler(Incubator) PPMC Gang Li 李岗 lgcareer2...@outlook.com<mailto:lgcareer2...@outlook.com>
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0 round 2
+1, it is ok for me My check list, Download links are valid. Checksums and PGP signatures are valid. DISCLAIMER is included. LICENSE and NOTICE files are correct for each ShardingSphere repo. All files have license headers if necessary. Install source files successfully. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 12:37，zhangli...@apache.org wrote： Sorry, I can not find the old secret key, so we can not reuse the old public key for now. The only way is use the current key to check the gpg signature. Please reimport the `KEYS` file to validate the signature for now. It is unnecessary to re-release version. How about continue to vote on this thread? -- Liang Zhang (John) Apache ShardingSphere & Dubbo Willem Jiang 于2020年1月2日周四 下午12:08写道： No, I don't think using the KEYS file can keep good track of the public key, it doesn't support the revoke operation. It's better to use the public Key server to host the public key and we can know if the key is revoked or not. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Jan 2, 2020 at 12:04 PM Juan Pan wrote: That means once one key was used for one release, it could not be deleted from KEYS files anymore no matter it is great on or not, right? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 12:00，Willem Jiang wrote： If someone use the compromised private to sign a new release, we should be able to tell if the public key is revoked. If we just delete the key from the KEY file, it's hard to tell if the public key is valid or not. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Jan 2, 2020 at 11:55 AM Juan Pan wrote: Hi Willem, Just for curiosity, if the old key was used for one release and now is compromised, how about the release signed by this old and compromised key? Since this release exists in our release list and if anyone downloads it from our website and intends to check it again with the bad key. Thanks, trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 11:29，Willem Jiang wrote： If the private key is compromised[1] or if we cannot find the private key, we should revoke the public KEY[2]. Please keep your private key in a safe place. [1] https://www.thesslstore.com/blog/heres-what-happens-when-your-private-key-gets-compromised/ [3] http://blog.chapagain.com.np/gpg-revoking-your-public-key-and-notifiying-key-server/ Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Jan 2, 2020 at 10:21 AM Sheng Wu wrote: You can't simply delete the old one. Because ShardingSphere has existing release based on that KEY :) We could still continue in this way, but it should not be recommended if your old key is still available. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月2日周四 上午10:18写道： Hi Liang, If you plan not to use the old one any more, deleting is is an alternative to avoid confusion. If so, it is necessary to delete it in KEYS file and public key servers, IMO. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/1/2020 21:26，Sheng Wu wrote： My concern is making people confused. The PGP could export and import from the old laptop. You don't need a new one. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年1月1日周三 下午8:55写道： A question, why you have two pgp keys in the KEYS file? I change a computer, the 1st one is for the 4.0.0-RC1, the 4th one is for this version. Do you think we could remove the 1st one? because I will never use that gpp key again, but do we need to keep it to make the 4.0.0-RC1 can be validate? -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年1月1日周三 下午8:34写道： Hi Liang Zhang A question, why you have two pgp keys in the KEYS file? Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2019年12月30日周一 下午9:44写道： Hello ShardingSphere Community, This is a call for vote to release Apache ShardingSphere (Incubating) version 4.0.0 Release notes: https://github.com/apache/incubator-shardingsphere/blob/dev/RELEASE-NOTES.md The release candidates: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0/ Maven 2 staging repository: https://repository.apache.org/content/repositories/orgapacheshardingsphere-1029/org/apache/shardingsphere/ Git tag for the release: https://github.com/apache/incubator-shardingsphere/tree/4.0.0/ Release Commit ID: https://github.com/apache/incubator-shardingsphere/commit/f81f4f03b1dd4b426adf1f29ffe93f9540ce6fc9 Keys to verify the Release Candidate: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS Look at here for how to verify this release candidate: https://shardingsphere.apache.org/community/en/contr
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0 round 2
Thanks for your explanation, Willem. Let me make it clear, my concern is that a public key ever signed for one release, and now this key is compromised, and although this key is in KEYS file, it could not work well. Therefore we could not use it for verify the integrity of old release in [1] anymore. On the one hand, we keep this key in KEY file, people would get the wrong information when verifying this legacy release, for it is a bad key; On the other hand, if we delete if from KEY file, people could not verify this release either. So, if Liang could not use the old key for some reason anymore, he has to keep the old one well for previous release verification, and to create a new one for the coming release in the meantime. Is it right? [1] https://www.apache.org/dyn/closer.cgi#verify Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 12:08，Willem Jiang wrote： No, I don't think using the KEYS file can keep good track of the public key, it doesn't support the revoke operation. It's better to use the public Key server to host the public key and we can know if the key is revoked or not. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Jan 2, 2020 at 12:04 PM Juan Pan wrote: That means once one key was used for one release, it could not be deleted from KEYS files anymore no matter it is great on or not, right? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 12:00，Willem Jiang wrote： If someone use the compromised private to sign a new release, we should be able to tell if the public key is revoked. If we just delete the key from the KEY file, it's hard to tell if the public key is valid or not. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Jan 2, 2020 at 11:55 AM Juan Pan wrote: Hi Willem, Just for curiosity, if the old key was used for one release and now is compromised, how about the release signed by this old and compromised key? Since this release exists in our release list and if anyone downloads it from our website and intends to check it again with the bad key. Thanks, trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 11:29，Willem Jiang wrote： If the private key is compromised[1] or if we cannot find the private key, we should revoke the public KEY[2]. Please keep your private key in a safe place. [1]https://www.thesslstore.com/blog/heres-what-happens-when-your-private-key-gets-compromised/ [3]http://blog.chapagain.com.np/gpg-revoking-your-public-key-and-notifiying-key-server/ Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Jan 2, 2020 at 10:21 AM Sheng Wu wrote: You can't simply delete the old one. Because ShardingSphere has existing release based on that KEY :) We could still continue in this way, but it should not be recommended if your old key is still available. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月2日周四 上午10:18写道： Hi Liang, If you plan not to use the old one any more, deleting is is an alternative to avoid confusion. If so, it is necessary to delete it in KEYS file and public key servers, IMO. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/1/2020 21:26，Sheng Wu wrote： My concern is making people confused. The PGP could export and import from the old laptop. You don't need a new one. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年1月1日周三 下午8:55写道： A question, why you have two pgp keys in the KEYS file? I change a computer, the 1st one is for the 4.0.0-RC1, the 4th one is for this version. Do you think we could remove the 1st one? because I will never use that gpp key again, but do we need to keep it to make the 4.0.0-RC1 can be validate? -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年1月1日周三 下午8:34写道： Hi Liang Zhang A question, why you have two pgp keys in the KEYS file? Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2019年12月30日周一 下午9:44写道： Hello ShardingSphere Community, This is a call for vote to release Apache ShardingSphere (Incubating) version 4.0.0 Release notes: https://github.com/apache/incubator-shardingsphere/blob/dev/RELEASE-NOTES.md The release candidates: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0/ Maven 2 staging repository: https://repository.apache.org/content/repositories/orgapacheshardingsphere-1029/org/apache/shardingsphere/ Git tag for the release: https://github.com/apache/incubator-shardingsphere/tree/4.0.0/ Release Commit ID: https://github.com/apache/incubator-shardingsphere/commit/f81f4f03b1dd4b426adf1f29ffe93f9540ce6fc9 Keys to verify the Release Candidate: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS Look at he
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0 round 2
That means once one key was used for one release, it could not be deleted from KEYS files anymore no matter it is great on or not, right? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 12:00，Willem Jiang wrote： If someone use the compromised private to sign a new release, we should be able to tell if the public key is revoked. If we just delete the key from the KEY file, it's hard to tell if the public key is valid or not. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Jan 2, 2020 at 11:55 AM Juan Pan wrote: Hi Willem, Just for curiosity, if the old key was used for one release and now is compromised, how about the release signed by this old and compromised key? Since this release exists in our release list and if anyone downloads it from our website and intends to check it again with the bad key. Thanks, trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 11:29，Willem Jiang wrote： If the private key is compromised[1] or if we cannot find the private key, we should revoke the public KEY[2]. Please keep your private key in a safe place. [1]https://www.thesslstore.com/blog/heres-what-happens-when-your-private-key-gets-compromised/ [3]http://blog.chapagain.com.np/gpg-revoking-your-public-key-and-notifiying-key-server/ Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Jan 2, 2020 at 10:21 AM Sheng Wu wrote: You can't simply delete the old one. Because ShardingSphere has existing release based on that KEY :) We could still continue in this way, but it should not be recommended if your old key is still available. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月2日周四 上午10:18写道： Hi Liang, If you plan not to use the old one any more, deleting is is an alternative to avoid confusion. If so, it is necessary to delete it in KEYS file and public key servers, IMO. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/1/2020 21:26，Sheng Wu wrote： My concern is making people confused. The PGP could export and import from the old laptop. You don't need a new one. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年1月1日周三 下午8:55写道： A question, why you have two pgp keys in the KEYS file? I change a computer, the 1st one is for the 4.0.0-RC1, the 4th one is for this version. Do you think we could remove the 1st one? because I will never use that gpp key again, but do we need to keep it to make the 4.0.0-RC1 can be validate? -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年1月1日周三 下午8:34写道： Hi Liang Zhang A question, why you have two pgp keys in the KEYS file? Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2019年12月30日周一 下午9:44写道： Hello ShardingSphere Community, This is a call for vote to release Apache ShardingSphere (Incubating) version 4.0.0 Release notes: https://github.com/apache/incubator-shardingsphere/blob/dev/RELEASE-NOTES.md The release candidates: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0/ Maven 2 staging repository: https://repository.apache.org/content/repositories/orgapacheshardingsphere-1029/org/apache/shardingsphere/ Git tag for the release: https://github.com/apache/incubator-shardingsphere/tree/4.0.0/ Release Commit ID: https://github.com/apache/incubator-shardingsphere/commit/f81f4f03b1dd4b426adf1f29ffe93f9540ce6fc9 Keys to verify the Release Candidate: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS Look at here for how to verify this release candidate: https://shardingsphere.apache.org/community/en/contribute/release/ The vote will be open for at least 72 hours or until necessary number of votes are reached. Please vote accordingly: [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove with the reason Checklist for reference: [ ] Download links are valid. [ ] Checksums and PGP signatures are valid. [ ] DISCLAIMER is included. [ ] Source code artifacts have correct names matching the current release. [ ] LICENSE and NOTICE files are correct for each ShardingSphere repo. [ ] All files have license headers if necessary. [ ] No compiled archives bundled in source archive. -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0 round 2
Very appreciated Sheng, make sense. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 11:09，Sheng Wu wrote： Yes, because the verification is introduced on the official website, download page, right? If we delete it, users will fail when we do the verification. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月2日周四 上午11:03写道： Hi Sheng, Thanks for your correction. Just confirm, the key point is that the old key for 4.0.0-RC1 release which passed the release vote but exists in our release list now could not be deleted, right? In other words, only one certain release exists, the key used for which must exist？ Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 10:21，Sheng Wu wrote： You can't simply delete the old one. Because ShardingSphere has existing release based on that KEY :) We could still continue in this way, but it should not be recommended if your old key is still available. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月2日周四 上午10:18写道： Hi Liang, If you plan not to use the old one any more, deleting is is an alternative to avoid confusion. If so, it is necessary to delete it in KEYS file and public key servers, IMO. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/1/2020 21:26，Sheng Wu wrote： My concern is making people confused. The PGP could export and import from the old laptop. You don't need a new one. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年1月1日周三 下午8:55写道： A question, why you have two pgp keys in the KEYS file? I change a computer, the 1st one is for the 4.0.0-RC1, the 4th one is for this version. Do you think we could remove the 1st one? because I will never use that gpp key again, but do we need to keep it to make the 4.0.0-RC1 can be validate? -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年1月1日周三 下午8:34写道： Hi Liang Zhang A question, why you have two pgp keys in the KEYS file? Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2019年12月30日周一 下午9:44写道： Hello ShardingSphere Community, This is a call for vote to release Apache ShardingSphere (Incubating) version 4.0.0 Release notes: https://github.com/apache/incubator-shardingsphere/blob/dev/RELEASE-NOTES.md The release candidates: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0/ Maven 2 staging repository: https://repository.apache.org/content/repositories/orgapacheshardingsphere-1029/org/apache/shardingsphere/ Git tag for the release: https://github.com/apache/incubator-shardingsphere/tree/4.0.0/ Release Commit ID: https://github.com/apache/incubator-shardingsphere/commit/f81f4f03b1dd4b426adf1f29ffe93f9540ce6fc9 Keys to verify the Release Candidate: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS Look at here for how to verify this release candidate: https://shardingsphere.apache.org/community/en/contribute/release/ The vote will be open for at least 72 hours or until necessary number of votes are reached. Please vote accordingly: [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove with the reason Checklist for reference: [ ] Download links are valid. [ ] Checksums and PGP signatures are valid. [ ] DISCLAIMER is included. [ ] Source code artifacts have correct names matching the current release. [ ] LICENSE and NOTICE files are correct for each ShardingSphere repo. [ ] All files have license headers if necessary. [ ] No compiled archives bundled in source archive. -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0 round 2
Hi Sheng, Thanks for your correction. Just confirm, the key point is that the old key for 4.0.0-RC1 release which passed the release vote but exists in our release list now could not be deleted, right? In other words, only one certain release exists, the key used for which must exist？ Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/2/2020 10:21，Sheng Wu wrote： You can't simply delete the old one. Because ShardingSphere has existing release based on that KEY :) We could still continue in this way, but it should not be recommended if your old key is still available. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2020年1月2日周四 上午10:18写道： Hi Liang, If you plan not to use the old one any more, deleting is is an alternative to avoid confusion. If so, it is necessary to delete it in KEYS file and public key servers, IMO. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/1/2020 21:26，Sheng Wu wrote： My concern is making people confused. The PGP could export and import from the old laptop. You don't need a new one. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年1月1日周三 下午8:55写道： A question, why you have two pgp keys in the KEYS file? I change a computer, the 1st one is for the 4.0.0-RC1, the 4th one is for this version. Do you think we could remove the 1st one? because I will never use that gpp key again, but do we need to keep it to make the 4.0.0-RC1 can be validate? -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年1月1日周三 下午8:34写道： Hi Liang Zhang A question, why you have two pgp keys in the KEYS file? Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2019年12月30日周一 下午9:44写道： Hello ShardingSphere Community, This is a call for vote to release Apache ShardingSphere (Incubating) version 4.0.0 Release notes: https://github.com/apache/incubator-shardingsphere/blob/dev/RELEASE-NOTES.md The release candidates: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0/ Maven 2 staging repository: https://repository.apache.org/content/repositories/orgapacheshardingsphere-1029/org/apache/shardingsphere/ Git tag for the release: https://github.com/apache/incubator-shardingsphere/tree/4.0.0/ Release Commit ID: https://github.com/apache/incubator-shardingsphere/commit/f81f4f03b1dd4b426adf1f29ffe93f9540ce6fc9 Keys to verify the Release Candidate: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS Look at here for how to verify this release candidate: https://shardingsphere.apache.org/community/en/contribute/release/ The vote will be open for at least 72 hours or until necessary number of votes are reached. Please vote accordingly: [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove with the reason Checklist for reference: [ ] Download links are valid. [ ] Checksums and PGP signatures are valid. [ ] DISCLAIMER is included. [ ] Source code artifacts have correct names matching the current release. [ ] LICENSE and NOTICE files are correct for each ShardingSphere repo. [ ] All files have license headers if necessary. [ ] No compiled archives bundled in source archive. -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0 round 2
Hi Liang, If you plan not to use the old one any more, deleting is is an alternative to avoid confusion. If so, it is necessary to delete it in KEYS file and public key servers, IMO. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 01/1/2020 21:26，Sheng Wu wrote： My concern is making people confused. The PGP could export and import from the old laptop. You don't need a new one. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2020年1月1日周三 下午8:55写道： A question, why you have two pgp keys in the KEYS file? I change a computer, the 1st one is for the 4.0.0-RC1, the 4th one is for this version. Do you think we could remove the 1st one? because I will never use that gpp key again, but do we need to keep it to make the 4.0.0-RC1 can be validate? -- Liang Zhang (John) Apache ShardingSphere & Dubbo Sheng Wu 于2020年1月1日周三 下午8:34写道： Hi Liang Zhang A question, why you have two pgp keys in the KEYS file? Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2019年12月30日周一 下午9:44写道： Hello ShardingSphere Community, This is a call for vote to release Apache ShardingSphere (Incubating) version 4.0.0 Release notes: https://github.com/apache/incubator-shardingsphere/blob/dev/RELEASE-NOTES.md The release candidates: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/4.0.0/ Maven 2 staging repository: https://repository.apache.org/content/repositories/orgapacheshardingsphere-1029/org/apache/shardingsphere/ Git tag for the release: https://github.com/apache/incubator-shardingsphere/tree/4.0.0/ Release Commit ID: https://github.com/apache/incubator-shardingsphere/commit/f81f4f03b1dd4b426adf1f29ffe93f9540ce6fc9 Keys to verify the Release Candidate: https://dist.apache.org/repos/dist/dev/incubator/shardingsphere/KEYS Look at here for how to verify this release candidate: https://shardingsphere.apache.org/community/en/contribute/release/ The vote will be open for at least 72 hours or until necessary number of votes are reached. Please vote accordingly: [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove with the reason Checklist for reference: [ ] Download links are valid. [ ] Checksums and PGP signatures are valid. [ ] DISCLAIMER is included. [ ] Source code artifacts have correct names matching the current release. [ ] LICENSE and NOTICE files are correct for each ShardingSphere repo. [ ] All files have license headers if necessary. [ ] No compiled archives bundled in source archive. -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: [QUESTION] Why does Apache Flink add `org.antlr` to pom.xml
Hi Benchao, Thanks for your reply, key word `antlr` appeared in three modules of master branch, 1. flink-python 2. flink-sql-client 3. flink-hive-connector I also found just tag `exclusion` is used for `Antlr`, so the aim of which is to exclude it from 'hive-exec’ dependency, right? That makes sense. We are exploring Apache Flink and Apache Calcite, very appreciated your prompt reply. Regards, Trista. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/29/2019 15:22，Benchao Li wrote： Hi Juan, I searched in the repo, and only found two modules contains `org.antlr`: 1, flink-sql-client 2, flink-connector-hive But they exist only because we need to exclude them from 'hive-exec' dependency. BTW, where did you find flink importing `org.antlr` ? Juan Pan 于2019年12月29日周日 下午3:07写道： Hi folks, Excuse me for this help-seeking email. I tried to query the related questions on Stack Overflow and Apache Pony archived emails, but there is no answer there. From my understanding, Flink parses SQL with the help of JavaCC and Apache calcite. Therefore, why does Flink import Antlr at the same time? For what? Could anyone give me some hints? Thanks in advance. Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org -- Benchao Li School of Electronics Engineering and Computer Science, Peking University Tel:+86-15650713730 Email: libenc...@gmail.com; libenc...@pku.edu.cn
[QUESTION] Why does Apache Flink add `org.antlr` to pom.xml
Hi folks, Excuse me for this help-seeking email. I tried to query the related questions on Stack Overflow and Apache Pony archived emails, but there is no answer there. From my understanding, Flink parses SQL with the help of JavaCC and Apache calcite. Therefore, why does Flink import Antlr at the same time? For what? Could anyone give me some hints? Thanks in advance. Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org
Re: [VOTE] Release Apache ShardingSphere (Incubating) 4.0.0
Hi Willem, Your reply is what i am waiting for, however could give me more details about this issue? My Max OS is 10.13.6 (17G3025) now, is it needed to update my Max OS to higher version? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/26/2019 21:38，Willem Jiang wrote： Did you just upgrade your Mac OSX? I think you need to install the right version of Xcode to fix the issue. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Tue, Dec 24, 2019 at 2:25 PM Juan Pan wrote: Hi LICENSE, NOTICE, Checksums and PGP signatures have no problems, however when i installed this release, some exceptions threw up as follows. Does anyone run into this similar situation? - xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance Traceback (most recent call last): File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/gyp_main.py", line 16, in sys.exit(gyp.script_main()) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 545, in script_main return main(sys.argv[1:]) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 538, in main return gyp_main(args) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 523, in gyp_main generator.GenerateOutput(flat_list, targets, data, params) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 2170, in GenerateOutput part_of_all=qualified_target in needed_targets) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 795, in Write self.Pchify)) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 1190, in WriteSources cflags = self.xcode_settings.GetCflags(configname) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 551, in GetCflags archs = self.GetActiveArchs(self.configname) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 420, in GetActiveArchs xcode_archs_default = GetXcodeArchsDefault() File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 118, in GetXcodeArchsDefault xcode_version, _ = XcodeVersion() File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 1265, in XcodeVersion version = re.match(r'(\d\.\d\.?\d*)', version).groups()[0] AttributeError: 'NoneType' object has no attribute 'groups' gyp ERR! configure error gyp ERR! stack Error: `gyp` failed with exit code: 1 gyp ERR! stack at ChildProcess.onCpExit (/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/lib/configure.js:305:16) gyp ERR! stack at emitTwo (events.js:106:13) gyp ERR! stack at ChildProcess.emit (events.js:191:7) gyp ERR! stack at Process.ChildProcess._handle.onexit (internal/child_process.js:215:12) gyp ERR! System Darwin 17.7.0 gyp ERR! command "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node" "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild" gyp
Re:[VOTE] Release Apache ShardingSphere (Incubating) 4.0.0
Hi LICENSE, NOTICE, Checksums and PGP signatures have no problems, however when i installed this release, some exceptions threw up as follows. Does anyone run into this similar situation? - xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance Traceback (most recent call last): File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/gyp_main.py", line 16, in sys.exit(gyp.script_main()) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 545, in script_main return main(sys.argv[1:]) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 538, in main return gyp_main(args) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 523, in gyp_main generator.GenerateOutput(flat_list, targets, data, params) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 2170, in GenerateOutput part_of_all=qualified_target in needed_targets) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 795, in Write self.Pchify)) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 1190, in WriteSources cflags = self.xcode_settings.GetCflags(configname) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 551, in GetCflags archs = self.GetActiveArchs(self.configname) File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 420, in GetActiveArchs xcode_archs_default = GetXcodeArchsDefault() File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 118, in GetXcodeArchsDefault xcode_version, _ = XcodeVersion() File "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 1265, in XcodeVersion version = re.match(r'(\d\.\d\.?\d*)', version).groups()[0] AttributeError: 'NoneType' object has no attribute 'groups' gyp ERR! configure error gyp ERR! stack Error: `gyp` failed with exit code: 1 gyp ERR! stack at ChildProcess.onCpExit (/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/lib/configure.js:305:16) gyp ERR! stack at emitTwo (events.js:106:13) gyp ERR! stack at ChildProcess.emit (events.js:191:7) gyp ERR! stack at Process.ChildProcess._handle.onexit (internal/child_process.js:215:12) gyp ERR! System Darwin 17.7.0 gyp ERR! command "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node" "/Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild" gyp ERR! cwd /Users/trista/Downloads/apache-shardingsphere-incubating-4.0.0-src-release/sharding-ui/sharding-ui-frontend/node_modules/fsevents gyp ERR! node -v v6.10.0 gyp ERR! node-gyp -v v3.4.0 gyp ERR! not ok -- Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/23/2019 21:15，zhangli...@apache.org wrote： Hello ShardingSphere Community, This is a call for vote to release Apache ShardingSphere (Incub
Re: Quicksql
Thanks Gelbana, Very appreciated your explanation, which sheds me some light on exploring Calcite. :) Best wishes, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/22/2019 05:58，Muhammad Gelbana wrote： I am curious how to join the tables from different datasources. Based on Calcite's conventions concept, the Join operator and its input operators should all have the same convention. If they don't, the convention different from the Join operator's convention will have to register a converter rule. This rule should produce an operator that only converts from that convention to the Join operator's convention. This way the Join operator will be able to handle the data obtained from its input operators because it understands the data structure. Thanks, Gelbana On Wed, Dec 18, 2019 at 5:08 AM Juan Pan wrote: Some updates. Recently i took a look at their doc and source code, and found this project uses SQL parsing and Relational algebra of Calcite to get query plan, and also translates to spark SQL for joining different datasources, or corresponding query for single datasource. Although it copies many classes from Calcite, the idea of QuickSQL seems some of interests, and code is succinct. Best, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/13/2019 17:16，Juan Pan wrote： Yes, indeed. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/12/2019 18:00，Alessandro Solimando wrote： Adapters must be needed by data sources not supporting SQL, I think this is what Juan Pan was asking for. On Thu, 12 Dec 2019 at 04:05, Haisheng Yuan wrote: Nope, it doesn't use any adapters. It just submits partial SQL query to different engines. If query contains table from single source, e.g. select count(*) from hive_table1, hive_table2 where a=b; then the whole query will be submitted to hive. Otherwise, e.g. select distinct a,b from hive_table union select distinct a,b from mysql_table; The following query will be submitted to Spark and executed by Spark: select a,b from spark_tmp_table1 union select a,b from spark_tmp_table2; spark_tmp_table1: select distinct a,b from hive_table spark_tmp_table2: select distinct a,b from mysql_table On 2019/12/11 04:27:07, "Juan Pan" wrote: Hi Haisheng, The query on different data source will then be registered as temp spark tables (with filter or join pushed in), the whole query is rewritten as SQL text over these temp tables and submitted to Spark. Does it mean QuickSQL also need adaptors to make query executed on different data source? Yes, virtualization is one of Calcite’s goals. In fact, when I created Calcite I was thinking about virtualization + in-memory materialized views. Not only the Spark convention but any of the “engine” conventions (Drill, Flink, Beam, Enumerable) could be used to create a virtual query engine. Basically, i like and agree with Julian’s statement. It is a great idea which personally hope Calcite move towards. Give my best wishes to Calcite community. Thanks, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/11/2019 10:53，Haisheng Yuan wrote： As far as I know, users still need to register tables from other data sources before querying it. QuickSQL uses Calcite for parsing queries and optimizing logical expressions with several transformation rules. The query on different data source will then be registered as temp spark tables (with filter or join pushed in), the whole query is rewritten as SQL text over these temp tables and submitted to Spark. - Haisheng -- 发件人：Rui Wang 日 期：2019年12月11日 06:24:45 收件人： 主 题：Re: Quicksql The co-routine model sounds fitting into Streaming cases well. I was thinking how should Enumerable interface work with streaming cases but now I should also check Interpreter. -Rui On Tue, Dec 10, 2019 at 1:33 PM Julian Hyde wrote: The goal (or rather my goal) for the interpreter is to replace Enumerable as the quick, easy default convention. Enumerable is efficient but not that efficient (compared to engines that work on off-heap data representing batches of records). And because it generates java byte code there is a certain latency to getting a query prepared and ready to run. It basically implements the old Volcano query evaluation model. It is single-threaded (because all work happens as a result of a call to 'next()' on the root node) and cannot handle branching data-flow graphs (DAGs). The Interpreter operates uses a co-routine model (reading from queues, writing to queues, and yielding when there is no work to be done) and therefore could be more efficient than enumerable in a single-node multi-core system. Also, there is little start-up time, which
??????shardingsphere-spi-impl????????????
Hi Sorry to hear that. Since your picture could not show well, could you please create issue and upload picture or log error at ISSUES[1]? So we can see more details and give some solutions. [1] https://github.com/apache/incubator-shardingsphere/issues Thanks, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org ??2019??12??18?? 18:40<546810...@qq.com> ?? mvn clean install -Prelease -Dmaven.test.skip=true RC2 ?? -- -- ??????: "Juan Pan"; : 2019??12??18??(??) 6:25 ??: "dev@shardingsphere.apache.org"; : "dev"; : ??shardingsphere-spi-impl Sorry, i didn??t know the specific operations you did, however i suggest you command `mvn clean install -Prelease` to install the whole project. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org ??2019??12??18?? 18:17<546810...@qq.com> ?? ??ideagit In idea, it also reports errors. The same is that classes and methods cannot be found. Is it easy to download them from git? ------------ ??:"Juan Pan"
Re: Quicksql
Some updates. Recently i took a look at their doc and source code, and found this project uses SQL parsing and Relational algebra of Calcite to get query plan, and also translates to spark SQL for joining different datasources, or corresponding query for single datasource. Although it copies many classes from Calcite, the idea of QuickSQL seems some of interests, and code is succinct. Best, Trista Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/13/2019 17:16，Juan Pan wrote： Yes, indeed. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/12/2019 18:00，Alessandro Solimando wrote： Adapters must be needed by data sources not supporting SQL, I think this is what Juan Pan was asking for. On Thu, 12 Dec 2019 at 04:05, Haisheng Yuan wrote: Nope, it doesn't use any adapters. It just submits partial SQL query to different engines. If query contains table from single source, e.g. select count(*) from hive_table1, hive_table2 where a=b; then the whole query will be submitted to hive. Otherwise, e.g. select distinct a,b from hive_table union select distinct a,b from mysql_table; The following query will be submitted to Spark and executed by Spark: select a,b from spark_tmp_table1 union select a,b from spark_tmp_table2; spark_tmp_table1: select distinct a,b from hive_table spark_tmp_table2: select distinct a,b from mysql_table On 2019/12/11 04:27:07, "Juan Pan" wrote: Hi Haisheng, The query on different data source will then be registered as temp spark tables (with filter or join pushed in), the whole query is rewritten as SQL text over these temp tables and submitted to Spark. Does it mean QuickSQL also need adaptors to make query executed on different data source? Yes, virtualization is one of Calcite’s goals. In fact, when I created Calcite I was thinking about virtualization + in-memory materialized views. Not only the Spark convention but any of the “engine” conventions (Drill, Flink, Beam, Enumerable) could be used to create a virtual query engine. Basically, i like and agree with Julian’s statement. It is a great idea which personally hope Calcite move towards. Give my best wishes to Calcite community. Thanks, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/11/2019 10:53，Haisheng Yuan wrote： As far as I know, users still need to register tables from other data sources before querying it. QuickSQL uses Calcite for parsing queries and optimizing logical expressions with several transformation rules. The query on different data source will then be registered as temp spark tables (with filter or join pushed in), the whole query is rewritten as SQL text over these temp tables and submitted to Spark. - Haisheng -- 发件人：Rui Wang 日 期：2019年12月11日 06:24:45 收件人： 主 题：Re: Quicksql The co-routine model sounds fitting into Streaming cases well. I was thinking how should Enumerable interface work with streaming cases but now I should also check Interpreter. -Rui On Tue, Dec 10, 2019 at 1:33 PM Julian Hyde wrote: The goal (or rather my goal) for the interpreter is to replace Enumerable as the quick, easy default convention. Enumerable is efficient but not that efficient (compared to engines that work on off-heap data representing batches of records). And because it generates java byte code there is a certain latency to getting a query prepared and ready to run. It basically implements the old Volcano query evaluation model. It is single-threaded (because all work happens as a result of a call to 'next()' on the root node) and cannot handle branching data-flow graphs (DAGs). The Interpreter operates uses a co-routine model (reading from queues, writing to queues, and yielding when there is no work to be done) and therefore could be more efficient than enumerable in a single-node multi-core system. Also, there is little start-up time, which is important for small queries. I would love to add another built-in convention that uses Arrow as data format and generates co-routines for each operator. Those co-routines could be deployed in a parallel and/or distributed data engine. Julian On Tue, Dec 10, 2019 at 3:47 AM Zoltan Farkas wrote: What is the ultimate goal of the Calcite Interpreter? To provide some context, I have been playing around with calcite + REST (see https://github.com/zolyfarkas/jaxrs-spf4j-demo/wiki/AvroCalciteRest < https://github.com/zolyfarkas/jaxrs-spf4j-demo/wiki/AvroCalciteRest> for detail of my experiments) —Z On Dec 9, 2019, at 9:05 PM, Julian Hyde wrote: Yes, virtualization is one of Calcite’s goals. In fact, when I created Calcite I was thinking about virtualization + in-memory materialized views. Not only the Spark convention but any of the “engine” conventions (Drill, Flink,
Re: Quicksql
Thanks for your clarification, Haisheng. I am curious how to join the tables from different datasources. Supposing there is tb1 in datasource1 and tb2 in datasource2 and the SQL is `select tb1.col1, tb2.col2 from tb1, tb2 where tb1.id = tb2.id`, how to join two of tables together and get the final result? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/12/2019 11:05，Haisheng Yuan wrote： Nope, it doesn't use any adapters. It just submits partial SQL query to different engines. If query contains table from single source, e.g. select count(*) from hive_table1, hive_table2 where a=b; then the whole query will be submitted to hive. Otherwise, e.g. select distinct a,b from hive_table union select distinct a,b from mysql_table; The following query will be submitted to Spark and executed by Spark: select a,b from spark_tmp_table1 union select a,b from spark_tmp_table2; spark_tmp_table1: select distinct a,b from hive_table spark_tmp_table2: select distinct a,b from mysql_table On 2019/12/11 04:27:07, "Juan Pan" wrote: Hi Haisheng, The query on different data source will then be registered as temp spark tables (with filter or join pushed in), the whole query is rewritten as SQL text over these temp tables and submitted to Spark. Does it mean QuickSQL also need adaptors to make query executed on different data source? Yes, virtualization is one of Calcite’s goals. In fact, when I created Calcite I was thinking about virtualization + in-memory materialized views. Not only the Spark convention but any of the “engine” conventions (Drill, Flink, Beam, Enumerable) could be used to create a virtual query engine. Basically, i like and agree with Julian’s statement. It is a great idea which personally hope Calcite move towards. Give my best wishes to Calcite community. Thanks, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/11/2019 10:53，Haisheng Yuan wrote： As far as I know, users still need to register tables from other data sources before querying it. QuickSQL uses Calcite for parsing queries and optimizing logical expressions with several transformation rules. The query on different data source will then be registered as temp spark tables (with filter or join pushed in), the whole query is rewritten as SQL text over these temp tables and submitted to Spark. - Haisheng -- 发件人：Rui Wang 日 期：2019年12月11日 06:24:45 收件人： 主 题：Re: Quicksql The co-routine model sounds fitting into Streaming cases well. I was thinking how should Enumerable interface work with streaming cases but now I should also check Interpreter. -Rui On Tue, Dec 10, 2019 at 1:33 PM Julian Hyde wrote: The goal (or rather my goal) for the interpreter is to replace Enumerable as the quick, easy default convention. Enumerable is efficient but not that efficient (compared to engines that work on off-heap data representing batches of records). And because it generates java byte code there is a certain latency to getting a query prepared and ready to run. It basically implements the old Volcano query evaluation model. It is single-threaded (because all work happens as a result of a call to 'next()' on the root node) and cannot handle branching data-flow graphs (DAGs). The Interpreter operates uses a co-routine model (reading from queues, writing to queues, and yielding when there is no work to be done) and therefore could be more efficient than enumerable in a single-node multi-core system. Also, there is little start-up time, which is important for small queries. I would love to add another built-in convention that uses Arrow as data format and generates co-routines for each operator. Those co-routines could be deployed in a parallel and/or distributed data engine. Julian On Tue, Dec 10, 2019 at 3:47 AM Zoltan Farkas wrote: What is the ultimate goal of the Calcite Interpreter? To provide some context, I have been playing around with calcite + REST (see https://github.com/zolyfarkas/jaxrs-spf4j-demo/wiki/AvroCalciteRest < https://github.com/zolyfarkas/jaxrs-spf4j-demo/wiki/AvroCalciteRest> for detail of my experiments) —Z On Dec 9, 2019, at 9:05 PM, Julian Hyde wrote: Yes, virtualization is one of Calcite’s goals. In fact, when I created Calcite I was thinking about virtualization + in-memory materialized views. Not only the Spark convention but any of the “engine” conventions (Drill, Flink, Beam, Enumerable) could be used to create a virtual query engine. See e.g. a talk I gave in 2013 about Optiq (precursor to Calcite) https://www.slideshare.net/julianhyde/optiq-a-dynamic-data-management-framework < https://www.slideshare.net/julianhyde/optiq-a-dynamic-data-management-framework . Julian On Dec 9, 2019, at 2:29 PM, Muhammad Gelbana wrote: I recently contacted one of the active co
Re: Quicksql
Yes, indeed. Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) E-mail: panj...@apache.org On 12/12/2019 18:00，Alessandro Solimando wrote： Adapters must be needed by data sources not supporting SQL, I think this is what Juan Pan was asking for. On Thu, 12 Dec 2019 at 04:05, Haisheng Yuan wrote: Nope, it doesn't use any adapters. It just submits partial SQL query to different engines. If query contains table from single source, e.g. select count(*) from hive_table1, hive_table2 where a=b; then the whole query will be submitted to hive. Otherwise, e.g. select distinct a,b from hive_table union select distinct a,b from mysql_table; The following query will be submitted to Spark and executed by Spark: select a,b from spark_tmp_table1 union select a,b from spark_tmp_table2; spark_tmp_table1: select distinct a,b from hive_table spark_tmp_table2: select distinct a,b from mysql_table On 2019/12/11 04:27:07, "Juan Pan" wrote: Hi Haisheng, The query on different data source will then be registered as temp spark tables (with filter or join pushed in), the whole query is rewritten as SQL text over these temp tables and submitted to Spark. Does it mean QuickSQL also need adaptors to make query executed on different data source? Yes, virtualization is one of Calcite’s goals. In fact, when I created Calcite I was thinking about virtualization + in-memory materialized views. Not only the Spark convention but any of the “engine” conventions (Drill, Flink, Beam, Enumerable) could be used to create a virtual query engine. Basically, i like and agree with Julian’s statement. It is a great idea which personally hope Calcite move towards. Give my best wishes to Calcite community. Thanks, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/11/2019 10:53，Haisheng Yuan wrote： As far as I know, users still need to register tables from other data sources before querying it. QuickSQL uses Calcite for parsing queries and optimizing logical expressions with several transformation rules. The query on different data source will then be registered as temp spark tables (with filter or join pushed in), the whole query is rewritten as SQL text over these temp tables and submitted to Spark. - Haisheng -- 发件人：Rui Wang 日 期：2019年12月11日 06:24:45 收件人： 主 题：Re: Quicksql The co-routine model sounds fitting into Streaming cases well. I was thinking how should Enumerable interface work with streaming cases but now I should also check Interpreter. -Rui On Tue, Dec 10, 2019 at 1:33 PM Julian Hyde wrote: The goal (or rather my goal) for the interpreter is to replace Enumerable as the quick, easy default convention. Enumerable is efficient but not that efficient (compared to engines that work on off-heap data representing batches of records). And because it generates java byte code there is a certain latency to getting a query prepared and ready to run. It basically implements the old Volcano query evaluation model. It is single-threaded (because all work happens as a result of a call to 'next()' on the root node) and cannot handle branching data-flow graphs (DAGs). The Interpreter operates uses a co-routine model (reading from queues, writing to queues, and yielding when there is no work to be done) and therefore could be more efficient than enumerable in a single-node multi-core system. Also, there is little start-up time, which is important for small queries. I would love to add another built-in convention that uses Arrow as data format and generates co-routines for each operator. Those co-routines could be deployed in a parallel and/or distributed data engine. Julian On Tue, Dec 10, 2019 at 3:47 AM Zoltan Farkas wrote: What is the ultimate goal of the Calcite Interpreter? To provide some context, I have been playing around with calcite + REST (see https://github.com/zolyfarkas/jaxrs-spf4j-demo/wiki/AvroCalciteRest < https://github.com/zolyfarkas/jaxrs-spf4j-demo/wiki/AvroCalciteRest> for detail of my experiments) —Z On Dec 9, 2019, at 9:05 PM, Julian Hyde wrote: Yes, virtualization is one of Calcite’s goals. In fact, when I created Calcite I was thinking about virtualization + in-memory materialized views. Not only the Spark convention but any of the “engine” conventions (Drill, Flink, Beam, Enumerable) could be used to create a virtual query engine. See e.g. a talk I gave in 2013 about Optiq (precursor to Calcite) https://www.slideshare.net/julianhyde/optiq-a-dynamic-data-management-framework < https://www.slideshare.net/julianhyde/optiq-a-dynamic-data-management-framework . Julian On Dec 9, 2019, at 2:29 PM, Muhammad Gelbana wrote: I recently contacted one of the active contributors asking about the purpose of the project and here's his reply: From my understanding, Quicksql is a data virtualization platform. It can quer
Re:Sharding-Proxy-mysql8.0.18-BUG
Hi English communication is prerequisite. Could you use 4.0.0-RC3 to test? Juan Pan (Trista) Senior DBA & PPMC of Apache ShardingSphere(Incubating) email: panj...@apache.org On 12/12/2019 16:05，文光临 wrote： 您好！ Sharding-Proxy 连接 mysql8.0.18 报错，读取元数据出错。 报错信息如下（配置和报错日志 在附件。多谢了） [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.recovery_delay = 30 [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.automatic_resource_registration = false [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.oltp_max_retries = 5 [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.client_demarcation = false [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.threaded_2pc = false [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.serial_jta_transactions = false [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.log_base_dir = ./logs [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.rmi_export_class = none [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.max_actives = 1 [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.checkpoint_interval = 5 [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.enable_logging = true [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.log_base_name = xa_tx [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.max_timeout = 30 [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.trust_client_tm = false [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: java.naming.factory.initial = com.sun.jndi.rmi.registry.RegistryContextFactory [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.tm_unique_name = 127.0.1.1.tm [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.forget_orphaned_log_entries_delay = 8640 [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.oltp_retry_interval = 1 [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: java.naming.provider.url = rmi://localhost:1099 [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.force_shutdown_on_vm_exit = false [INFO ] 15:36:31.679 [main] c.a.icatch.provider.imp.AssemblerImp - USING: com.atomikos.icatch.default_jta_timeout = 30 [INFO ] 15:36:31.680 [main] c.a.icatch.provider.imp.AssemblerImp - Using default (local) logging and recovery... [INFO ] 15:36:31.701 [main] c.a.d.xa.XATransactionalResource - resource-1-ds_0: refreshed XAResource [INFO ] 15:36:31.720 [main] c.a.d.xa.XATransactionalResource - resource-2-ds_1: refreshed XAResource Exception in thread "main" java.sql.SQLDataException: Cannot determine value type from string 'NO' at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:114) at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97) at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89) at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63) at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:73) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:96) at com.mysql.cj.jdbc.result.ResultSetImpl.getObject(ResultSetImpl.java:1382) at com.mysql.cj.jdbc.result.ResultSetImpl.getBoolean(ResultSetImpl.java:663) at com.mysql.cj.jdbc.result.ResultSetImpl.getBoolean(ResultSetImpl.java:669) at org.apache.shardingsphere.core.execute.metadata.TableMetaDataLoader.getColumnMetaDataList(TableMetaDataLoader.java:169) at org.apache.shardingsphere.core.execute.metadata.TableMetaDataLoader.createTableMetaData(TableMetaDataLoader.java:147) at org.apache.shardingsphere.core.execute.metadata.TableMetaDataLoader.load(TableMetaDataLoader.java:112) at org.apache.shardingsphere.core.execute.metadata.TableMetaDataLoader.access$100(TableMetaDataLoader.java:56) at org.apache.shardingsphere.core.execute.metadata.TableMetaDataLoader$1.execute(TableMetaDataLoader.java:101) at org.apache.shardingsphere.core.execute.ShardingExecuteEngine.syncGroupExecute(ShardingExecuteEngine.java:125) at org.apache.shardingsphere.core.execute.ShardingExecuteEngine.parallelExecute(ShardingExecuteE
Re: [Discuss] sharding-orchestration module reconstruction
Take it easy. And FYI, maybe we could modify the internal of orchestration without changing API of orchestration. When the refactoring of orchestration finishes, API changes and behavior changes of callers comes. Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/11/2019 20:32，sunbufu wrote： I think this maybe not so hard, we can do this like follow. 1. Remove the old modules. 2. Rename the new modules. 3. Modify references we can easy find. 4.Follow the error lead. — Haisheng Sun (sunbufu) Apache ShardingSphere On 12/11/2019 16:14，guangyuan wang wrote： The modifications in sharding-orchestration are: 1. The RegistryCenter is changed to split into 3 interfaces: ConfigCenter, Registry Center, DistributedLockManagement. 2. The related implementation class is changed and initialization is changed. These changes mean the sharding-orchestration module will be totally changed. So we create two modules in the sharding-orchestration to replace old modules in the sharding-orchestration. And now I wanna make the replacing. But it's huge task, because many classes of the sharding-orchestration are called by other modules. I'd like to discuss the workflow of the replacing, to make this action safely be done without any unit test failure. Juan Pan 于2019年12月11日周三 下午4:02写道： Hi Yuan, I’d like to join in discussion, however i have no idea about what is going now, could you draft a workflow or schedule to give us a basic understanding about it. Based on that, maybe others could give some great suggestion or idea. Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/11/2019 14:28，guangyuan wang wrote： Hello everyone I'd like to reconstruct the sharding-orchestration module. So far as, we have develop a new sharding-orchestration-center module and sharding-orchestration-core-new module. I'd like to use them to replace the old ones. But It's really huge engineering. So I'd like to discuss the workflow of the reconstruction. Do you have any good suggestions?
Re:[Discuss] sharding-orchestration module reconstruction
Hi Yuan, I’d like to join in discussion, however i have no idea about what is going now, could you draft a workflow or schedule to give us a basic understanding about it. Based on that, maybe others could give some great suggestion or idea. Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/11/2019 14:28，guangyuan wang wrote： Hello everyone I'd like to reconstruct the sharding-orchestration module. So far as, we have develop a new sharding-orchestration-center module and sharding-orchestration-core-new module. I'd like to use them to replace the old ones. But It's really huge engineering. So I'd like to discuss the workflow of the reconstruction. Do you have any good suggestions?
Re: Quicksql
Hi Haisheng, > The query on different data source will then be registered as temp spark > tables (with filter or join pushed in), the whole query is rewritten as SQL > text over these temp tables and submitted to Spark. Does it mean QuickSQL also need adaptors to make query executed on different data source? > Yes, virtualization is one of Calcite’s goals. In fact, when I created > Calcite I was thinking about virtualization + in-memory materialized views. > Not only the Spark convention but any of the “engine” conventions (Drill, > Flink, Beam, Enumerable) could be used to create a virtual query engine. Basically, i like and agree with Julian’s statement. It is a great idea which personally hope Calcite move towards. Give my best wishes to Calcite community. Thanks, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/11/2019 10:53，Haisheng Yuan wrote： As far as I know, users still need to register tables from other data sources before querying it. QuickSQL uses Calcite for parsing queries and optimizing logical expressions with several transformation rules. The query on different data source will then be registered as temp spark tables (with filter or join pushed in), the whole query is rewritten as SQL text over these temp tables and submitted to Spark. - Haisheng -- 发件人：Rui Wang 日 期：2019年12月11日 06:24:45 收件人： 主 题：Re: Quicksql The co-routine model sounds fitting into Streaming cases well. I was thinking how should Enumerable interface work with streaming cases but now I should also check Interpreter. -Rui On Tue, Dec 10, 2019 at 1:33 PM Julian Hyde wrote: The goal (or rather my goal) for the interpreter is to replace Enumerable as the quick, easy default convention. Enumerable is efficient but not that efficient (compared to engines that work on off-heap data representing batches of records). And because it generates java byte code there is a certain latency to getting a query prepared and ready to run. It basically implements the old Volcano query evaluation model. It is single-threaded (because all work happens as a result of a call to 'next()' on the root node) and cannot handle branching data-flow graphs (DAGs). The Interpreter operates uses a co-routine model (reading from queues, writing to queues, and yielding when there is no work to be done) and therefore could be more efficient than enumerable in a single-node multi-core system. Also, there is little start-up time, which is important for small queries. I would love to add another built-in convention that uses Arrow as data format and generates co-routines for each operator. Those co-routines could be deployed in a parallel and/or distributed data engine. Julian On Tue, Dec 10, 2019 at 3:47 AM Zoltan Farkas wrote: What is the ultimate goal of the Calcite Interpreter? To provide some context, I have been playing around with calcite + REST (see https://github.com/zolyfarkas/jaxrs-spf4j-demo/wiki/AvroCalciteRest < https://github.com/zolyfarkas/jaxrs-spf4j-demo/wiki/AvroCalciteRest> for detail of my experiments) —Z On Dec 9, 2019, at 9:05 PM, Julian Hyde wrote: Yes, virtualization is one of Calcite’s goals. In fact, when I created Calcite I was thinking about virtualization + in-memory materialized views. Not only the Spark convention but any of the “engine” conventions (Drill, Flink, Beam, Enumerable) could be used to create a virtual query engine. See e.g. a talk I gave in 2013 about Optiq (precursor to Calcite) https://www.slideshare.net/julianhyde/optiq-a-dynamic-data-management-framework < https://www.slideshare.net/julianhyde/optiq-a-dynamic-data-management-framework . Julian On Dec 9, 2019, at 2:29 PM, Muhammad Gelbana wrote: I recently contacted one of the active contributors asking about the purpose of the project and here's his reply: From my understanding, Quicksql is a data virtualization platform. It can query multiple data sources altogether and in a distributed way; Say, you can write a SQL with a MySql table join with an Elasticsearch table. Quicksql can recognize that, and then generate Spark code, in which it will fetch the MySQL/ES data as a temporary table separately, and then join them in Spark. The execution is in Spark so it is totally distributed. The user doesn't need to aware of where the table is from. I understand that the Spark convention Calcite has attempts to achieve the same goal, but it isn't fully implemented yet. On Tue, Oct 29, 2019 at 9:43 PM Julian Hyde wrote: Anyone know anything about Quicksql? It seems to be quite a popular project, and they have an internal fork of Calcite. https://github.com/Qihoo360/ <https://github.com/Qihoo360/> https://github.com/Qihoo360/Quicksql/tree/master/analysis/src/main/java/org/apache/calcite < https://github.com/Qihoo360/Quicksql/tree/master/analysis/src/main/java/org/apache/calcite Julian
Re: Discussion of pluggable platform of ShardingSphere
Agree with Liang, Maybe there is no feature benefit apparently, however we make its architecture become…a structured plaza with many rooms. Consequently, more contributors could fill in specific implements for those rooms with less harms to this plaza, i.e our project. Oh, i have a great imagination, don’t you think so? :) Regards, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/9/2019 14:13，Nicholas wrote： Hi guys, What features will be planned in pluggable platform? And how to assign features splits from sharding-core? Based on user concept，what does user benefit from this pluggable platform? Thanks, Nicholas Jiang On 2019/12/09 05:29:47, "zhangli...@apache.org" wrote: Hi, ShardingSphere community, More and more features are added into ShardingSphere now, as you know, the scope of ShardingSphere is no longer for sharding only. There are more and more features related with sharding, such as distributed transaction, distributed orchestration, observability and so on; and there are couple of features did not relate with sharding obviously, for example: encrypt, shadow data source, SQL audit and so on. I'd like to discuss about establishing a pluggable platform of ShardingSphere. The proposal of pluggable platform is decoupling all features and technical implementations, the benefits are: 1. Flexible for add new feature. 2. Reduce the negative effects if problem occur on one feature. 3. Provide a platform to make more contributors work together without interact on each other. I plan split all features from sharding-core first, and then use SPI to introduce features into the pluggable platform(same thing with sharding, sharding can be remove from main process too). The pluggable platform is a blank JDBC and database protocol finally, and provide assist technical features such as SQL parser and SQL rewrite. Any advice? -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: 4.0.0 stable version release plan
Finishing Acceptance-test framework is better, but not a block, IMO. As Liang said, a detailed schedule is necessary to makes everyone review all the tasks and their time costs. Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/8/2019 22:50，Sheng Wu wrote： zhaojun 于2019年12月8日周日 下午9:50写道： Acceptance-test framework will make release workflow more smoothly. We will spend a lot of time (maybe months) to verify the function manually on every release time. Several months? Are you saying ShardingSphere will have no stable release in over 1.5 years? Are PPMC serious sure about this? Sheng Wu 吴晟 Twitter, wusheng1108 In fact, we could not release a version ASAP now. -- Zhao Jun (cherrylzhao) Apache ShardingSphere & ServiceComb On Dec 7, 2019, at 6:54 PM, Sheng Wu wrote: Make sense to me. Sheng Wu 吴晟 Twitter, wusheng1108 zhangli...@apache.org 于2019年12月7日周六 下午6:47写道： How about get the result of performance test at last? It is a good way to confirm there are no performance issue for the stable version. It should be ok soon, maybe next week. We can list a scheduler for the detail of performance test. -- Liang Zhang (John) Apache ShardingSphere & Dubbo Juan Pan 于2019年12月7日周六 下午6:09写道： Hi Sheng, Thanks for your clarification, i get your point. Juan Pan panj...@apache.org Juan Pan(T-rista), Apache ShardingSphere On 12/7/2019 17:59，Sheng Wu wrote： Hi Actually, my point is those two even not source release :) Those are test frameworks. The user would feel they exist. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2019年12月7日周六 下午5:50写道： Hi Sheng and Liang, I totally agree to release a stable version for community ASAP, however i am curious about the release note and the intending date of it. Is there any new for this release, or just hot bugfix? As Sheng said, ISSUE[1] and [2] seems not block, so Liang, would you like to include them into this release? What’s the estimated time of completion? Thanks, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/7/2019 17:23，Sheng Wu wrote： zhangli...@apache.org 于2019年12月7日周六 下午5:18写道： Hi, ShardingSphere community, I'd like to talk about the release plan of 4.0.0 stable version. As you know, after enter Apache incubator, ShardingSphere had released 3 RC versions during the past year. The features are stable more and more, it is the time to talk about task details before 4.0.0 release. I just list some tasks that I knew, please add if I missing something: 1. Performance test display. The current result is in [1], we still need to do some adjust to make it better. 2. Acceptance test. The repo is in [2], we still need docker and shell to make it run automatically. And we will transfer it to apache repo[3] soon. I think these two are not blocks for the stable release. :) 3. Remain bugs hot fix. I don't find any high priority bug to be fixed now. If no high priority bug, I think this is a good time to do the official release now. ShardingSphere has no stable release in the whole of 2019. We should do this ASAP. What do other PPMC think? Sheng Wu 吴晟 Twitter, wusheng1108 Any other tasks missing here? [1] https://shardingsphere.apache.org/benchmark/#/overview [2] https://github.com/OpenSharding/shardingsphere-acceptance-test [3] https://github.com/apache/incubator-shardingsphere-acceptance-test -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: 4.0.0 stable version release plan
Hi Sheng, Thanks for your clarification, i get your point. Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/7/2019 17:59，Sheng Wu wrote： Hi Actually, my point is those two even not source release :) Those are test frameworks. The user would feel they exist. Sheng Wu 吴晟 Twitter, wusheng1108 Juan Pan 于2019年12月7日周六 下午5:50写道： Hi Sheng and Liang, I totally agree to release a stable version for community ASAP, however i am curious about the release note and the intending date of it. Is there any new for this release, or just hot bugfix? As Sheng said, ISSUE[1] and [2] seems not block, so Liang, would you like to include them into this release? What’s the estimated time of completion? Thanks, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/7/2019 17:23，Sheng Wu wrote： zhangli...@apache.org 于2019年12月7日周六 下午5:18写道： Hi, ShardingSphere community, I'd like to talk about the release plan of 4.0.0 stable version. As you know, after enter Apache incubator, ShardingSphere had released 3 RC versions during the past year. The features are stable more and more, it is the time to talk about task details before 4.0.0 release. I just list some tasks that I knew, please add if I missing something: 1. Performance test display. The current result is in [1], we still need to do some adjust to make it better. 2. Acceptance test. The repo is in [2], we still need docker and shell to make it run automatically. And we will transfer it to apache repo[3] soon. I think these two are not blocks for the stable release. :) 3. Remain bugs hot fix. I don't find any high priority bug to be fixed now. If no high priority bug, I think this is a good time to do the official release now. ShardingSphere has no stable release in the whole of 2019. We should do this ASAP. What do other PPMC think? Sheng Wu 吴晟 Twitter, wusheng1108 Any other tasks missing here? [1] https://shardingsphere.apache.org/benchmark/#/overview [2] https://github.com/OpenSharding/shardingsphere-acceptance-test [3] https://github.com/apache/incubator-shardingsphere-acceptance-test -- Liang Zhang (John) Apache ShardingSphere & Dubbo
Re: 4.0.0 stable version release plan
Hi Sheng and Liang, I totally agree to release a stable version for community ASAP, however i am curious about the release note and the intending date of it. Is there any new for this release, or just hot bugfix? As Sheng said, ISSUE[1] and [2] seems not block, so Liang, would you like to include them into this release? What’s the estimated time of completion? Thanks, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/7/2019 17:23，Sheng Wu wrote： zhangli...@apache.org 于2019年12月7日周六 下午5:18写道： Hi, ShardingSphere community, I'd like to talk about the release plan of 4.0.0 stable version. As you know, after enter Apache incubator, ShardingSphere had released 3 RC versions during the past year. The features are stable more and more, it is the time to talk about task details before 4.0.0 release. I just list some tasks that I knew, please add if I missing something: 1. Performance test display. The current result is in [1], we still need to do some adjust to make it better. 2. Acceptance test. The repo is in [2], we still need docker and shell to make it run automatically. And we will transfer it to apache repo[3] soon. I think these two are not blocks for the stable release. :) 3. Remain bugs hot fix. I don't find any high priority bug to be fixed now. If no high priority bug, I think this is a good time to do the official release now. ShardingSphere has no stable release in the whole of 2019. We should do this ASAP. What do other PPMC think? Sheng Wu 吴晟 Twitter, wusheng1108 Any other tasks missing here? [1] https://shardingsphere.apache.org/benchmark/#/overview [2] https://github.com/OpenSharding/shardingsphere-acceptance-test [3] https://github.com/apache/incubator-shardingsphere-acceptance-test -- Liang Zhang (John) Apache ShardingSphere & Dubbo
回复：sharding在springboot2的环境下，对jpa与mybatis同时生效
Hi English for communication only. Beside, i have no clear idea about your problem, can you give more details of your issue? Thanks Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere 在2019年12月7日 16:29，石 写道： 你好，问题如标题； 我的项目为了开发便捷，同时使用了mybatis注解方式与Jpa注解方式；使用的是默认的一个datasource（hikarCPi）, 现在引入pom,添加sharding的配置文件内容后 io.shardingsphere sharding-jdbc-spring-boot-starter 3.1.0 只有mybatis相关的数据库操作生效
Re:Using mybatis, the parameter is list and null pointer error is reported
Hi thanks for your detailed log. What’s your sharding rule? Looking at log, i found the actual SQL is same with the logic one, and there is no difference. Does table named `cv_task_mark_user ` is a sharding table? Have you ever referred to sharding-examples[1], which provides several configuration examples for different situations ? - [1] https://github.com/apache/incubator-shardingsphere-example Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/6/2019 17:47，xu wrote： Using mybatis, the parameter is list to report null pointer error. The version of mybatis is 3.2.0，the version of sharding is 4.0.0-RC3 ,The specific log is as follows： Fetched SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@9d7c7b] from current transaction ooo Using Connection [org.apache.shardingsphere.shardingjdbc.jdbc.core.connection.ShardingConnection@121f239] ==> Preparing: INSERT INTO cv_task_mark_user ( team_id , task_id , pin, creator, created, deleted ) VALUES (?,?,?,?,now(),0) ==> Parameters: 122(Long), 2446(Long), xukaiwei1(String), xukaiwei1(String) [2019-12-06 17:39:12] INFO ShardingSphere-SQL(http-nio-8088-exec-8); :Rule Type: sharding [2019-12-06 17:39:12] INFO ShardingSphere-SQL(http-nio-8088-exec-8); :Logic SQL: INSERT INTO cv_task_mark_user ( team_id , task_id , pin, creator, created, deleted ) VALUES (?,?,?,?,now(),0) [2019-12-06 17:39:12] INFO ShardingSphere-SQL(http-nio-8088-exec-8); :SQLStatement: InsertSQLStatementContext(super=CommonSQLStatementContext(sqlStatement=org.apache.shardingsphere.core.parse.sql.statement.dml.InsertStatement@115c689, tablesContext=TablesContext(tables=[Table(name=cv_task_mark_user, alias=Optional.absent())], schema=Optional.absent())), columnNames=[team_id, task_id, pin, creator, created, deleted], insertValueContexts=[InsertValueContext(parametersCount=4, valueExpressions=[ParameterMarkerExpressionSegment(startIndex=180, stopIndex=180, parameterMarkerIndex=0), ParameterMarkerExpressionSegment(startIndex=182, stopIndex=182, parameterMarkerIndex=1), ParameterMarkerExpressionSegment(startIndex=184, stopIndex=184, parameterMarkerIndex=2), ParameterMarkerExpressionSegment(startIndex=186, stopIndex=186, parameterMarkerIndex=3), CommonExpressionSegment(startIndex=188, stopIndex=192, text=now()), LiteralExpressionSegment(startIndex=194, stopIndex=194, literals=0)], parameters=[122, 2446, xukaiwei1, xukaiwei1])]) [2019-12-06 17:39:12] INFO ShardingSphere-SQL(http-nio-8088-exec-8); :Actual SQL: cv_dataSource ::: INSERT INTO cv_task_mark_user ( team_id , task_id , pin, creator, created, deleted ) VALUES (?, ?, ?, ?, now(), 0) ::: [122, 2446, xukaiwei1, xukaiwei1] Releasing transactional SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@9d7c7b] Transaction synchronization rolling back SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@9d7c7b] Transaction synchronization closing SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@9d7c7b] [2019-12-06 17:39:19] DEBUG org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver(http-nio-8088-exec-8); :Resolving exception from handler [public net.sf.json.JSONObject com.jd.bdp.cv.web.controller.CvTaskController.save(com.jd.bdp.cv.domain.CvUser,com.jd.bdp.cv.domain.CvTask,org.springframework.web.multipart.MultipartFile,javax.servlet.http.HttpServletRequest) throws java.lang.Exception]: org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: java.lang.NullPointerException ### The error may exist in URL [jar:file:/D:/workspace_bdp/bdp_cv_inter/cv-web/target/cv-web/WEB-INF/lib/cv-dao-1.0-SNAPSHOT.jar!/com/jd/bdp/cv/dao/CvTaskMarkUser.xml] ### The error may involve com.jd.bdp.cv.dao.CvTaskMarkUserDao.insertByMarkPins-Inline ### The error occurred while setting parameters ### SQL: INSERT INTO cv_task_mark_user ( team_id , task_id , pin, creator, created, deleted ) VALUES(?,?,?,?,now(),0) ### Cause: java.lang.NullPointerException [2019-12-06 17:39:19] DEBUG org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver(http-nio-8088-exec-8); :Resolving exception from handler [public net.sf.json.JSONObject com.jd.bdp.cv.web.controller.CvTaskController.save(com.jd.bdp.cv.domain.CvUser,com.jd.bdp.cv.domain.CvTask,org.springframework.web.multipart.MultipartFile,javax.servlet.http.HttpServletRequest) throws java.lang.Exception]: org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.exceptions.PersistenceException: ### Error querying database. Cause: java.lang.NullPointerException ### The error may exist in URL [jar:file:/D:/workspace_bdp/bdp_cv_inter/cv-web/target/cv-web/WEB-INF/lib/cv-dao-1.0-SNAPSHOT.jar!/com/jd/bdp/cv/dao/CvTaskMarkUser.xml] ### The err
Re: Podling Shardingsphere Report Reminder - December 2019
Hi Justin, Thanks for your feedback and suggestion. You’re right, it seems not a proper expression, and maybe it is a better one that "Individuals from different companies and communities provided some patches to feed back ShardingSphere community”. We will pay more attention on it and try our best to make our community diverse and active. Best wishes, Trista Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/3/2019 05:07，Justin Mclean wrote： Hi, Looking at the report again I noticed this "some companies has already provided patches to feedback the community.". You might want to reword that, companies don't provide patches people do, people contribute to the project as individuals not who they work for. While it nice to know the project is being used by many companies, care needs to taken to make sure it's recognised that individuals are making the contributions. Thanks, Justin
Re:Does the shardingProxyRC3 support registry type is nacos?
Hi It was already underway, and is expected to get it done in our next release. Please refer to ISSUE[1] to learn more. [1] https://github.com/apache/incubator-shardingsphere/issues/3185 Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/2/2019 17:18，shiyu.w...@ifudata.com wrote： Hi: Does the shardingProxyRC3 support registry type is nacos? The code error is as follows: thank you
Re: What is the update of ShardingSphere new version plugin?
Hi Sheng and Yonglun, Keep in mind i do not know ShardingSphere plugin well, here is my understanding. ShardingSphere plugin for Skywalking is based on legacy version of ShardingSphere, so there is no problem if user adopt legacy ShardingSphere + any version Skywalking. Now the point is whether we should provide enhancement to make ShardingSphere plugin compatible with latest version of ShardingSphere, right? However ISSUE[1] is likely to be a bug for current ShardingSphere plugin. @Liang, what do you think? [1] https://github.com/apache/skywalking/issues/3984 Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/2/2019 15:50，Sheng Wu wrote： So, ShardingSphere will abandon all existing plugins for all old versions? What do you mean about only one plugin? Sheng Wu 吴晟 Twitter, wusheng1108 Zhang Yonglun 于2019年12月2日周一 下午3:49写道： Yes, there's only one shardingsphere 4.0.0 plugin finally. Zhang Yonglun Apache ShardingSphere Sheng Wu 于2019年12月2日周一 下午2:59写道： So, shardingsphere will give up the plugin for RC3, am I right? Sheng Wu 吴晟 Twitter, wusheng1108 Zhang Yonglun 于2019年12月2日周一 上午9:52写道： Hi Sheng, As I know ShardingSphere-4.0.0 will be released soon. Once the release launch, all the RC releases plugin get useless. So I prefer to deal with these issues you mentioned in the new release. Zhang Yonglun Apache ShardingSphere Sheng Wu 于2019年12月1日周日 下午3:46写道： Hi ShardingSphere community, especially for Yonglun, Juan The ShardingSphere internal APIs related to instrumentation have been changed in RC3, so this issue[1] created to track the progress. Could anyone sync to me, what is status? And what is the ETA? Including 1. ShardingSphere plugin needs to move into the current test framework as step 1[2] 2. A high possibility of ShardingSphere plugin bug[3] requires the feedback. Does ShardingSphere community know anything about this one? This is not likely a SkyWalking bug. [1] https://github.com/apache/skywalking/issues/3777 [2] https://github.com/apache/skywalking/issues/3583 [3] https://github.com/apache/skywalking/issues/3984 Sheng Wu 吴晟 Twitter, wusheng1108
Re: What is the update of ShardingSphere new version plugin?
Hi Sheng and Yonglun, Keep in mind i do not know ShardingSphere plugin well, here is my understanding. ShardingSphere plugin for Skywalking is based on legacy version of ShardingSphere, so there is no problem if user adopt legacy ShardingSphere + any version Skywalking. Now the point is whether we should provide enhancement to make ShardingSphere plugin compatible with latest version of ShardingSphere, right? However ISSUE[1] is likely to be a bug for current ShardingSphere plugin. @Liang, what do you think? [1] https://github.com/apache/skywalking/issues/3984 Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/2/2019 15:50，Sheng Wu wrote： So, ShardingSphere will abandon all existing plugins for all old versions? What do you mean about only one plugin? Sheng Wu 吴晟 Twitter, wusheng1108 Zhang Yonglun 于2019年12月2日周一 下午3:49写道： Yes, there's only one shardingsphere 4.0.0 plugin finally. Zhang Yonglun Apache ShardingSphere Sheng Wu 于2019年12月2日周一 下午2:59写道： So, shardingsphere will give up the plugin for RC3, am I right? Sheng Wu 吴晟 Twitter, wusheng1108 Zhang Yonglun 于2019年12月2日周一 上午9:52写道： Hi Sheng, As I know ShardingSphere-4.0.0 will be released soon. Once the release launch, all the RC releases plugin get useless. So I prefer to deal with these issues you mentioned in the new release. Zhang Yonglun Apache ShardingSphere Sheng Wu 于2019年12月1日周日 下午3:46写道： Hi ShardingSphere community, especially for Yonglun, Juan The ShardingSphere internal APIs related to instrumentation have been changed in RC3, so this issue[1] created to track the progress. Could anyone sync to me, what is status? And what is the ETA? Including 1. ShardingSphere plugin needs to move into the current test framework as step 1[2] 2. A high possibility of ShardingSphere plugin bug[3] requires the feedback. Does ShardingSphere community know anything about this one? This is not likely a SkyWalking bug. [1] https://github.com/apache/skywalking/issues/3777 [2] https://github.com/apache/skywalking/issues/3583 [3] https://github.com/apache/skywalking/issues/3984 Sheng Wu 吴晟 Twitter, wusheng1108
Re: What is the update of ShardingSphere new version plugin?
Got it. I would give an update on the issue of LICENSE when ShardingSphere for SkyWalking backend storage moves ahead. Except for that, let’s wait for Yonglun’s reply. Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/1/2019 21:06，Sheng Wu wrote： Juan Pan 于2019年12月1日 周日下午5:46写道： Hi Sheng, Considering some instrumental API of ShardingSphere were changed in 4.0.0-RC3, ISSUE[1] is needed to put on the agenda, which depends on Yonglun’s planning. Besides, it would be efficient if Yonglun could take charge of ISSUE[2] and ISSUE[3] since the ShardingSphere plugin for Skywalking is contributed by him. However i’d like to listen to his thoughts. Let’s wait for his reply. BTW, a nonstandard LICENSE has been used for ShardingSphere since 4.0.0-RC3, do you think it is supposed to syncit to SW? Thank you for the remind. Two parts, ShardingSphere could be involved. 1. ShardingSphere plugin. It is just compiling level dependency, so, it just requires ShardingSphere jar is available in Maven Central, and as Apache release. SkyWalking is good, no need to add any license to SkyWalking repo. 2. ShardingSphere for SkyWalking backend storage. I think this part is not ready, and 100% bases on your plan. If ShardingSphere jar will be re-distributed in SkyWalking tar, then, YES, we need LICENSE update. If we are going to use ShardingSphere proxy, which I like more, then no LICENSE update too. [1] https://github.com/apache/skywalking/issues/3777 [2] https://github.com/apache/skywalking/issues/3583 [3]https://github.com/apache/skywalking/issues/3984 [4] https://github.com/apache/incubator-shardingsphere/blob/dev/LICENSE Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/1/2019 15:46，Sheng Wu wrote： Hi ShardingSphere community, especially for Yonglun, Juan The ShardingSphere internal APIs related to instrumentation have been changed in RC3, so this issue[1] created to track the progress. Could anyone sync to me, what is status? And what is the ETA? Including 1. ShardingSphere plugin needs to move into the current test framework as step 1[2] 2. A high possibility of ShardingSphere plugin bug[3] requires the feedback. Does ShardingSphere community know anything about this one? This is not likely a SkyWalking bug. [1] https://github.com/apache/skywalking/issues/3777 [2] https://github.com/apache/skywalking/issues/3583 [3] https://github.com/apache/skywalking/issues/3984 Sheng Wu 吴晟 Twitter, wusheng1108 -- Sheng Wu 吴晟 Apache SkyWalking Apache Incubator Apache ShardingSphere, ECharts, DolphinScheduler podlings Zipkin Twitter, wusheng1108
Re: What is the update of ShardingSphere new version plugin?
Got it. I would give an update on the issue of LICENSE when ShardingSphere for SkyWalking backend storage moves ahead. Except for that, let’s wait for Yonglun’s reply. Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/1/2019 21:06，Sheng Wu wrote： Juan Pan 于2019年12月1日 周日下午5:46写道： Hi Sheng, Considering some instrumental API of ShardingSphere were changed in 4.0.0-RC3, ISSUE[1] is needed to put on the agenda, which depends on Yonglun’s planning. Besides, it would be efficient if Yonglun could take charge of ISSUE[2] and ISSUE[3] since the ShardingSphere plugin for Skywalking is contributed by him. However i’d like to listen to his thoughts. Let’s wait for his reply. BTW, a nonstandard LICENSE has been used for ShardingSphere since 4.0.0-RC3, do you think it is supposed to syncit to SW? Thank you for the remind. Two parts, ShardingSphere could be involved. 1. ShardingSphere plugin. It is just compiling level dependency, so, it just requires ShardingSphere jar is available in Maven Central, and as Apache release. SkyWalking is good, no need to add any license to SkyWalking repo. 2. ShardingSphere for SkyWalking backend storage. I think this part is not ready, and 100% bases on your plan. If ShardingSphere jar will be re-distributed in SkyWalking tar, then, YES, we need LICENSE update. If we are going to use ShardingSphere proxy, which I like more, then no LICENSE update too. [1] https://github.com/apache/skywalking/issues/3777 [2] https://github.com/apache/skywalking/issues/3583 [3]https://github.com/apache/skywalking/issues/3984 [4] https://github.com/apache/incubator-shardingsphere/blob/dev/LICENSE Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/1/2019 15:46，Sheng Wu wrote： Hi ShardingSphere community, especially for Yonglun, Juan The ShardingSphere internal APIs related to instrumentation have been changed in RC3, so this issue[1] created to track the progress. Could anyone sync to me, what is status? And what is the ETA? Including 1. ShardingSphere plugin needs to move into the current test framework as step 1[2] 2. A high possibility of ShardingSphere plugin bug[3] requires the feedback. Does ShardingSphere community know anything about this one? This is not likely a SkyWalking bug. [1] https://github.com/apache/skywalking/issues/3777 [2] https://github.com/apache/skywalking/issues/3583 [3] https://github.com/apache/skywalking/issues/3984 Sheng Wu 吴晟 Twitter, wusheng1108 -- Sheng Wu 吴晟 Apache SkyWalking Apache Incubator Apache ShardingSphere, ECharts, DolphinScheduler podlings Zipkin Twitter, wusheng1108
Re:What is the update of ShardingSphere new version plugin?
Hi Sheng, Considering some instrumental API of ShardingSphere were changed in 4.0.0-RC3, ISSUE[1] is needed to put on the agenda, which depends on Yonglun’s planning. Besides, it would be efficient if Yonglun could take charge of ISSUE[2] and ISSUE[3] since the ShardingSphere plugin for Skywalking is contributed by him. However i’d like to listen to his thoughts. BTW, a nonstandard LICENSE has been used for ShardingSphere since 4.0.0-RC3, do you think it is supposed to syncit to SW? [1] https://github.com/apache/skywalking/issues/3777 [2] https://github.com/apache/skywalking/issues/3583 [3]https://github.com/apache/skywalking/issues/3984 [4] https://github.com/apache/incubator-shardingsphere/blob/dev/LICENSE Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 12/1/2019 15:46，Sheng Wu wrote： Hi ShardingSphere community, especially for Yonglun, Juan The ShardingSphere internal APIs related to instrumentation have been changed in RC3, so this issue[1] created to track the progress. Could anyone sync to me, what is status? And what is the ETA? Including 1. ShardingSphere plugin needs to move into the current test framework as step 1[2] 2. A high possibility of ShardingSphere plugin bug[3] requires the feedback. Does ShardingSphere community know anything about this one? This is not likely a SkyWalking bug. [1] https://github.com/apache/skywalking/issues/3777 [2] https://github.com/apache/skywalking/issues/3583 [3] https://github.com/apache/skywalking/issues/3984 Sheng Wu 吴晟 Twitter, wusheng1108
Re: [QUESTION] Build Calcite using Gradle
Hi Vladimir, Super thanks for your suggestion! All the issues disappeared after upgrading IDEA. This is very important and first step for me to continue exploring Calcite. :) Thanks Cheng and Rui as well to help me look for issue cause. :-) Juan Pan panj...@apache.org Juan Pan(Trista), Apache ShardingSphere On 11/26/2019 19:20，Vladimir Sitnikov wrote： IntelliJ IDEA 2017.3.5 (Ultimate Edition) Could you please upgrade to 2019.3? Vladimir
