Re: Report for August, 2018
+1 On Tue, Aug 7, 2018 at 3:42 PM Raju Bairishetti wrote: > +1 > > On Tue, Aug 7, 2018 at 5:41 PM, Raghavendra Singh < > raghavendra.si...@inmobi.com> wrote: > > > +1 > > > > On Tue, Aug 7, 2018 at 3:08 PM, Siddharth Raj Jain < > > siddharth@inmobi.com > > > wrote: > > > > > +1 > > > > > > On Tue, Aug 7, 2018 at 3:04 PM rajitha r > wrote: > > > > > > > +1 > > > > > > > > On Tue, Aug 7, 2018 at 10:46 AM Amareshwari Sriramdasu < > > > > amareshw...@apache.org> wrote: > > > > > > > > > Hi, > > > > > > > > > > Have put up draft for August,2018 report > > > > > https://cwiki.apache.org/confluence/display/LENS/August%2C+2018. > > > > > > > > > > Please review and let me know your comments. > > > > > > > > > > Thanks > > > > > Amareshwari > > > > > > > > > > > > > > > > > -- > > > > Regards, > > > > > > > > Rajitha.R > > > > > > > > > > -- > > > _ > > > The > > > information contained in this communication is intended solely for the > > use > > > of the individual or entity to whom it is addressed and others > authorized > > > to receive it. It may contain confidential or legally privileged > > > information. If you are not the intended recipient you are hereby > > notified > > > that any disclosure, copying, distribution or taking any action in > > > reliance > > > on the contents of this information is strictly prohibited and may be > > > unlawful. If you have received this communication in error, please > notify > > > us immediately by responding to this email and then delete it from your > > > system. The firm is neither liable for the proper and complete > > > transmission > > > of the information contained in this communication nor for any delay in > > > its > > > receipt. > > > > > > > -- > > _ > > The > > information contained in this communication is intended solely for the > use > > of the individual or entity to whom it is addressed and others authorized > > to receive it. It may contain confidential or legally privileged > > information. If you are not the intended recipient you are hereby > notified > > that any disclosure, copying, distribution or taking any action in > > reliance > > on the contents of this information is strictly prohibited and may be > > unlawful. If you have received this communication in error, please notify > > us immediately by responding to this email and then delete it from your > > system. The firm is neither liable for the proper and complete > > transmission > > of the information contained in this communication nor for any delay in > > its > > receipt. > > > > > > -- > > -- > Thanks, > Raju Bairishetti, > www.lazada.com > -- _ The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
Re: [ANNOUNCE] New Apache Lens committer : Rajitha R
Congrats Rajitha!!! On Fri, Feb 9, 2018 at 11:12 AM, archana h wrote: > Congratulations Rajitha..!! :) > > On Fri, Feb 9, 2018 at 11:10 AM, Sushil Mohanty < > sushil.k.moha...@gmail.com> wrote: > >> Congratulations!! Rajitha. >> >> On Fri, Feb 9, 2018 at 11:02 AM, Amareshwari Sriramdasu < >> amareshw...@apache.org> wrote: >> >>> Congratulations Rajitha ! >>> >>> On Fri, Feb 9, 2018 at 10:58 AM, Puneet Gupta >>> wrote: >>> >>> > The PMC for Apache Lens has asked Rajitha to become Lens Committer. We >>> are >>> > pleased to announce that she has accepted. >>> > >>> > Being a committer enables access to commit to the source repositories >>> > and binding >>> > votes for code reviews. >>> > >>> > Join me in Congratulating Rajitha! >>> > >>> > Congratulations Rajitha! Looking forward for more of your >>> contributions in >>> > Apache Lens. >>> > >>> > Thanks >>> > Puneet >>> > >>> >> >> >> >> -- >> -Sushil >> > > -- _ The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
Re: [ANNOUNCE] New Apache Lens PMC member : Puneet Gupta
Congrats Puneet!!! On Tue, Sep 20, 2016 at 11:37 AM, Raju Bairishetti wrote: > Congratulations Puneet :) > > On Tue, Sep 20, 2016 at 1:43 PM, Raghavendra Singh < > raghavendra.si...@inmobi.com> wrote: > > > Congrats Puneet!! > > > > On Sep 20, 2016 10:50 AM, "Srikanth Sundarrajan" > > wrote: > > > > > Congrats Puneet. > > > RegardsSrikanth Sundarrajan > > > > > > > From: amareshw...@apache.org > > > > Date: Tue, 20 Sep 2016 09:58:54 +0530 > > > > Subject: [ANNOUNCE] New Apache Lens PMC member : Puneet Gupta > > > > To: dev@lens.apache.org; u...@lens.apache.org > > > > > > > > The Apache Lens PMC has asked Puneet Gupta to join Lens PMC. We are > > > pleased > > > > to announce that he has accepted. > > > > > > > > Being a PMC member enables Puneet to guide the direction of the > > project. > > > > > > > > Join me in Congratulating Puneet ! > > > > > > > > Congratulations, Puneet! Looking forward for more of your > contributions > > > in > > > > Apache Lens. > > > > > > > > Thanks > > > > > > > -- > > _ > > The information contained in this communication is intended solely for > the > > use of the individual or entity to whom it is addressed and others > > authorized to receive it. It may contain confidential or legally > privileged > > information. If you are not the intended recipient you are hereby > notified > > that any disclosure, copying, distribution or taking any action in > reliance > > on the contents of this information is strictly prohibited and may be > > unlawful. If you have received this communication in error, please notify > > us immediately by responding to this email and then delete it from your > > system. The firm is neither liable for the proper and complete > transmission > > of the information contained in this communication nor for any delay in > its > > receipt. > > > > > > -- > > -- > Thanks, > Raju Bairishetti, > www.lazada.com > -- _ The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
Re: [ANNOUNCE] New Apache Lens committer : Puneet Gupta
Congrats Puneet :) On Fri, Feb 26, 2016 at 9:36 PM, Ankeet Maini wrote: > Congrats! > > On Fri, Feb 26, 2016, 5:10 PM Deepak Kumar Barr (Tech_BLR) < > deepak.b...@flipkart.com> wrote: > >> Congratulations Puneet. >> >> Regards, >> Deepak Kumar Barr >> Bigfoot-Apps >> >> On Fri, Feb 26, 2016 at 2:51 PM, Amareshwari Sriramdasu < >> amareshw...@apache.org> wrote: >> >>> The PMC for Apache Lens has asked Puneet to become Lens Committer. We >>> are pleased to announce that he has accepted. >>> >>> Being a committer enables access to commit to the source repositories >>> and binding votes for code reviews. >>> >>> Join me in Congratulating Puneet! >>> >>> Congratulations Puneet! Looking forward for more of your contributions >>> in Apache Lens. >>> >>> Thanks >>> Amareshwari >>> >> >> -- _ The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
[jira] [Commented] (LENS-778) Killing JDBC Query is not closing the connection
[
https://issues.apache.org/jira/browse/LENS-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15160486#comment-15160486
]
Arshad Matin commented on LENS-778:
---
We set max connection pool config in jdbcdriver-site.xml
{noformat}
lens.driver.jdbc.pool.max.size
15
Maximum number of concurrent connections allowed in
pool
{noformat}
> Killing JDBC Query is not closing the connection
>
>
> Key: LENS-778
> URL: https://issues.apache.org/jira/browse/LENS-778
> Project: Apache Lens
> Issue Type: Bug
> Components: driver-jdbc
> Reporter: Arshad Matin
>Assignee: Badrinath Kulkarni
> Fix For: 2.6
>
>
> Use Case
> ===
> Set max connection pool to 1.
> Ran a query and killed it.
> Ran another query and it failed throwing following exception
> {noformat}
> 18 Sep 2015 07:18:51 [15e7cb89-5f0c-4741-8da6-69384c94cd01]
> [lens-driver-jdbc-2] ERROR org.apache.lens.driver.jdbc.JDBCDriver - Error
> executing SQL query: 15e7cb89-5f0c-4741-8da6-69384c94cd01 reason: Streaming
> result set com.mysql.jdbc.RowDataDynamic@4651e5c3 is still active. No
> statements may be issued when any streaming result sets are open and in use
> on a given connection. Ensure that you have called .close() on any active
> streaming result sets before attempting more queries.
> java.sql.SQLException: Streaming result set
> com.mysql.jdbc.RowDataDynamic@4651e5c3 is still active. No statements may be
> issued when any streaming result sets are open and in use on a given
> connection. Ensure that you have called .close() on any active streaming
> result sets before attempting more queries.
> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:914)
> ~[mysql-connector-java-5.0.8-bin.jar:na]
> at
> com.mysql.jdbc.MysqlIO.checkForOutstandingStreamingData(MysqlIO.java:2181)
> ~[mysql-connector-java-5.0.8-bin.jar:na]
> at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1542)
> ~[mysql-connector-java-5.0.8-bin.jar:na]
> at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723)
> ~[mysql-connector-java-5.0.8-bin.jar:na]
> at com.mysql.jdbc.Connection.execSQL(Connection.java:3277)
> ~[mysql-connector-java-5.0.8-bin.jar:na]
> at com.mysql.jdbc.Connection.execSQL(Connection.java:3206)
> ~[mysql-connector-java-5.0.8-bin.jar:na]
> at com.mysql.jdbc.Statement.execute(Statement.java:727)
> ~[mysql-connector-java-5.0.8-bin.jar:na]
> at
> com.mchange.v2.c3p0.impl.NewProxyStatement.execute(NewProxyStatement.java:223)
> ~[c3p0-0.9.5.jar:0.9.5]
> at
> org.apache.lens.driver.jdbc.JDBCDriver$QueryCallable.call(JDBCDriver.java:327)
> [lens-driver-jdbc-2.4.0-inm.jar:2.4.0-inm]
> at
> org.apache.lens.driver.jdbc.JDBCDriver$QueryCallable.call(JDBCDriver.java:282)
> [lens-driver-jdbc-2.4.0-inm.jar:2.4.0-inm]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> [na:1.8.0_40]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [na:1.8.0_40]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_40]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: February report
+1 On Sun, Feb 7, 2016 at 8:40 PM, Deepak Kumar Barr (Tech_BLR) < deepak.b...@flipkart.com> wrote: > +1 > > Regards, > Deepak Kumar Barr > Bigfoot-Apps > > On Sun, Feb 7, 2016 at 6:33 PM, Raju Bairishetti wrote: > > > +1 > > On Feb 7, 2016 3:25 PM, "Jean-Baptiste Onofré" wrote: > > > > > +1 > > > > > > Thanks ! > > > Regards > > > JB > > > > > > On 02/07/2016 10:16 AM, Amareshwari Sriramdasu wrote: > > > > > >> Hi all, > > >> > > >> I have drafted February report at > > >> https://cwiki.apache.org/confluence/display/LENS/February%2C2016. > > >> > > >> Let me know your comments. Will update the report Monday, 5pm IST. > > >> > > >> Thanks > > >> Amareshwari > > >> > > >> > > > -- > > > Jean-Baptiste Onofré > > > jbono...@apache.org > > > http://blog.nanthrax.net > > > Talend - http://www.talend.com > > > > > > -- _ The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
Re: [VOTE] Release of Apache Lens 2.4.0-beta RC1
+1 On Mon, Nov 23, 2015 at 7:23 PM, Ajay Yadav wrote: > +1 (non-binding) > > Signature looks good. > Validated Checksum. > Built from source. All tests ran fine. > LICENSE & NOTICE look ok > > > Cheers > Ajay Yadava > > > Cheers > Ajay Yadava > > On Mon, Nov 23, 2015 at 1:50 PM, Deepak Kumar Barr (Tech_BLR) < > deepak.b...@flipkart.com> wrote: > > > Looks good +1. Was able to build from source and run test cases. > > > > Regards, > > Deepak Kumar Barr > > Bigfoot-Apps > > > > On Mon, Nov 23, 2015 at 12:45 PM, Yash Sharma wrote: > > > > > +1 Binding. > > > Verified artifacts, Able to download, build and run sample queries on > > both > > > source and binary distributions. > > > > > > > > > P.S. : I stumbled across this error while building source first time, > but > > > am not able to reproduce it. It might be and env issue with my box. Did > > > anyone else face this ? > > > > > > [ERROR] Failed to execute goal > > > io.wcm.maven.plugins:nodejs-maven-plugin:1.0.0:run (default) on project > > > lens-ui: Result of /bin/sh -c cd > > > /home/yash/Downloads/test/apache-lens-2.4.0-beta/lens-ui && > > > > > > > > > /home/yash/Downloads/test/apache-lens-2.4.0-beta/lens-ui/node/node-v0.10.32-linux-x64/bin/node > > > > > > > > > /home/yash/Downloads/test/apache-lens-2.4.0-beta/lens-ui/node/node-v0.10.32-linux-x64/lib/node_modules/npm/bin/npm-cli.js > > > install execution is: '47'. -> [Help 1] > > > > > > > > > > > > On Mon, Nov 23, 2015 at 11:31 AM, amareshwarisr . < > amareshw...@gmail.com > > > > > > wrote: > > > > > > > +1 (Binding) > > > > > > > > Verified the release candidate : > > > > > > > > - Signature looks good > > > > - Validated checksums > > > > - LICENSE and NOTICE look ok. > > > > - Built from source. > > > > - Ran examples from binary distribution. All queries passed > > > > > > > > Earlier I removed node/node_modules from rat_check, seems it is stuck > > > > there. > > > > > > > > Thanks > > > > Amareshwari > > > > > > > > > > > > On Sun, Nov 22, 2015 at 9:11 AM, amareshwarisr . < > > amareshw...@gmail.com> > > > > wrote: > > > > > > > > > Verified the release candidate : > > > > > > > > > > - Signature looks good > > > > > - Validated checksums > > > > > - LICENSE and NOTICE look ok. > > > > > - Built from source. But facing issues with lens-ui module. > > > > > - Ran examples from binary distribution. All queries passed. > > > > > > > > > > Will put up my vote once i figured out issues with lens-ui module. > > > > > > > > > > Seems lens-ui build is stuck here : > > > > > > > > > > > > > > > > > > > > [INFO] --- maven-site-plugin:3.4:attach-descriptor > > (attach-descriptor) > > > @ > > > > > lens-ui --- > > > > > > > > > > [INFO] > > > > > > > > > > [INFO] --- apache-rat-plugin:0.11:check (rat-check) @ lens-ui --- > > > > > > > > > > [INFO] 51 implicit excludes (use -debug for more details). > > > > > > > > > > [INFO] Exclude: README.* > > > > > > > > > > [INFO] Exclude: DEPENDENCIES > > > > > > > > > > [INFO] Exclude: **/LICENSE* > > > > > > > > > > [INFO] Exclude: .git/** > > > > > > > > > > [INFO] Exclude: .reviewboardrc > > > > > > > > > > [INFO] Exclude: **/patchprocess/** > > > > > > > > > > [INFO] Exclude: .idea/** > > > > > > > > > > [INFO] Exclude: **/*.iml > > > > > > > > > > [INFO] Exclude: **/.classpath > > > > > > > > > > [INFO] Exclude: **/.project > > > > > > > > > > [INFO] Exclude: **/.checkstyle > > > > > > > > > > [INFO] Exclude: **/.settings/** > > > > > > > > > > [INFO] Exclude: **/maven-eclipse.xml > > > > > > > > > > [INFO] Exclude: **/.externalToolBuilders/** > > > > > > > > > > [INFO] Exclude: **/target/** > > > > > > > > > > [INFO] Exclude: **/build/** > > > > > > > > > > [INFO] Exclude: **/*.diff > > > > > > > > > > [INFO] Exclude: *.patch > > > > > > > > > > [INFO] Exclude: **/*.log > > > > > > > > > > [INFO] Exclude: **/*.png > > > > > > > > > > [INFO] Exclude: **/*.pptx > > > > > > > > > > [INFO] Exclude: **/*.data > > > > > > > > > > [INFO] Exclude: **/codemirror.min.* > > > > > > > > > > [INFO] Exclude: **/*.js > > > > > > > > > > [INFO] Exclude: **/*.properties > > > > > > > > > > [INFO] 6549 resources included (use -debug for more details) > > > > > > > > > > Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: > > Property > > > ' > > > > > http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is > > not > > > > > recognized. > > > > > > > > > > Compiler warnings: > > > > > > > > > > WARNING: 'org.apache.xerces.jaxp.SAXParserImpl: Property ' > > > > > http://javax.xml.XMLConstants/property/accessExternalDTD' is not > > > > > recognized.' > > > > > > > > > > Warning: org.apache.xerces.parsers.SAXParser: Feature ' > > > > > http://javax.xml.XMLConstants/feature/secure-processing' is not > > > > > recognized. > > > > > > > > > > Warning: org.apache.xerces.parsers.SAXParser: Property ' > > > > > http://javax.xml.XMLConstants/property/accessExternalDTD' is not > > > > > recognized. > > > > > > > > > > Warning: org.apache.xerces.pars
[jira] [Resolved] (LENS-804) Verify Lens 2.4 issues
[ https://issues.apache.org/jira/browse/LENS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin resolved LENS-804. --- Resolution: Fixed > Verify Lens 2.4 issues > -- > > Key: LENS-804 > URL: https://issues.apache.org/jira/browse/LENS-804 > Project: Apache Lens > Issue Type: Sub-task > Components: build >Reporter: Raju Bairishetti >Assignee: Arshad Matin > Fix For: 2.4 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-762) Partition Created for querystats is not honouring "lens.server.statistics.warehouse.dir"
[ https://issues.apache.org/jira/browse/LENS-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-762. - > Partition Created for querystats is not honouring > "lens.server.statistics.warehouse.dir" > > > Key: LENS-762 > URL: https://issues.apache.org/jira/browse/LENS-762 > Project: Apache Lens > Issue Type: Bug > Components: server >Reporter: Arshad Matin >Assignee: Amareshwari Sriramadasu > Fix For: 2.4 > > > Set "lens.server.statistics.warehouse.dir" to hdfs path > querystats logs were rolled up to the current location > but while running the queries, it was looking for default value of > "lens.server.statistics.warehouse.dir" > seems like the partition is always getting created with default value of > "lens.server.statistics.warehouse.dir" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-753) Queue number for queries
[ https://issues.apache.org/jira/browse/LENS-753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-753. - > Queue number for queries > > > Key: LENS-753 > URL: https://issues.apache.org/jira/browse/LENS-753 > Project: Apache Lens > Issue Type: Improvement > Components: api, client, server >Reporter: Akshay Goyal >Assignee: Akshay Goyal > Fix For: 2.4 > > Attachments: LENS-753.02.patch, LENS-753.03.patch, LENS-753.04.patch > > > This is to add queue number for queries after they were launched, in order to > give users an idea of the sequence in which their queries were launched. Or > in other words, to give them an idea of how many queries were launched before > them which are still competing for resources with their query. > Giving queue numbers from waiting query collection may not be correct as they > are not consistent. When a candidate query is picked up from waiting state, > it is removed from the collection and checked for cost constraints. If it > fails the constraints, the query is added back to the waiting query > collection. This causes inconsistency in terms of indices of queries within > the collection. Because of this inconsistency, user might see their queue > number increasing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-724) Bump version in master to 2.4
[ https://issues.apache.org/jira/browse/LENS-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-724. - > Bump version in master to 2.4 > - > > Key: LENS-724 > URL: https://issues.apache.org/jira/browse/LENS-724 > Project: Apache Lens > Issue Type: Sub-task >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.4 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-739) Generate udf jar for lens-regression
[ https://issues.apache.org/jira/browse/LENS-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-739. - > Generate udf jar for lens-regression > > > Key: LENS-739 > URL: https://issues.apache.org/jira/browse/LENS-739 > Project: Apache Lens > Issue Type: Improvement > Components: regression > Environment: QA >Reporter: Archana H >Assignee: Archana H > Fix For: 2.4 > > Attachments: LENS-739.1.patch, LENS-739.patch, LENS-739.patch > > > Generate UDF jar for regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-777) Query remains in queue even when driver is free
[
https://issues.apache.org/jira/browse/LENS-777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-777.
-
> Query remains in queue even when driver is free
>
>
> Key: LENS-777
> URL: https://issues.apache.org/jira/browse/LENS-777
> Project: Apache Lens
> Issue Type: Bug
> Reporter: Arshad Matin
>Assignee: Akshay Goyal
> Fix For: 2.4
>
> Attachments: LENS-777.01.patch, LENS-777.02.patch
>
>
> Scenario:
> Config
> {noformat}
>
> driver.max.concurrent.launched.queries
> 1
> Maximum queries which can be launched simultaneously on this
> driver. This should be equal to
> lens.driver.jdbc.pool.max.size. This configuration value is only useful
> when MaxConcurrentDriverQueriesConstraint
> is enabled by using
> org.apache.lens.server.api.query.constraint.MaxConcurrentDriverQueriesConstraintFactory
> as
> one of the factories in lens.driver.jdbc.query.constraint.factories
> property.
>
>
> lens.driver.jdbc.pool.max.size
> 1
> Maximum number of concurrent connections allowed in
> pool
>
> {noformat}
> Launched 1st query with user U1
> Launched 2nd query with user U2
> Launched 3rd query with user U1
> Launched 4th query with user U2
> Query Status
> ==
> Q1 -> Running
> Q2 -> Queued(queue number = 1)
> Q3 -> Queued(queue number = 2)
> Q4 -> Queued(queue number = 3)
> When Q1 completes, Query Status
> ==
> Q1 -> Successful
> Q2 -> Queued(queue number = 1)
> Q3 -> Running
> Q4 -> Queued(queue number = 2)
> When Q2 completes, Query Status
> ==
> Q1 -> Successful
> Q2 -> Queued(queue number = 1)
> Q3 -> Successful
> Q4 -> Queued(queue number = 2)
> user "U2" query will never get picked. Another query launched by user "U1"
> will be answered.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (LENS-745) Drop partition is assigning latest=null if latest partition is being dropped
[ https://issues.apache.org/jira/browse/LENS-745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-745. - > Drop partition is assigning latest=null if latest partition is being dropped > > > Key: LENS-745 > URL: https://issues.apache.org/jira/browse/LENS-745 > Project: Apache Lens > Issue Type: Bug >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.4 > > Attachments: LENS-745.03.patch, LENS-745.2015-08-19_18:51:31.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-803) Bump version in master to 2.5
[ https://issues.apache.org/jira/browse/LENS-803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-803. - > Bump version in master to 2.5 > - > > Key: LENS-803 > URL: https://issues.apache.org/jira/browse/LENS-803 > Project: Apache Lens > Issue Type: Sub-task > Components: build >Reporter: Raju Bairishetti >Assignee: Raju Bairishetti > Fix For: 2.4 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-802) Merge master with current-release-line for 2.4
[ https://issues.apache.org/jira/browse/LENS-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-802. - > Merge master with current-release-line for 2.4 > -- > > Key: LENS-802 > URL: https://issues.apache.org/jira/browse/LENS-802 > Project: Apache Lens > Issue Type: Sub-task > Components: build >Reporter: Raju Bairishetti >Assignee: Raju Bairishetti > Fix For: 2.4 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-797) Improve CLI documentation to mention the helpful role of pressing tab while writing commands
[ https://issues.apache.org/jira/browse/LENS-797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-797. - > Improve CLI documentation to mention the helpful role of pressing tab while > writing commands > > > Key: LENS-797 > URL: https://issues.apache.org/jira/browse/LENS-797 > Project: Apache Lens > Issue Type: Improvement >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.4 > > Attachments: LENS-797.03.patch > > > https://lens.apache.org/user/cli.html doesn't mention that pressing can > be interactive. I've seen users looking up commands every time and even > saving commands in text files for quicker access. We should mention that > commands need not be remembered and CLI can help you find the command and its > arguments any time. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-795) Look ahead is failing with partition not found if any process time partitions are absent
[ https://issues.apache.org/jira/browse/LENS-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-795. - > Look ahead is failing with partition not found if any process time partitions > are absent > > > Key: LENS-795 > URL: https://issues.apache.org/jira/browse/LENS-795 > Project: Apache Lens > Issue Type: Bug >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.4 > > Attachments: LENS-795.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-784) setup build job with java8 on jenkins
[ https://issues.apache.org/jira/browse/LENS-784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-784. - > setup build job with java8 on jenkins > - > > Key: LENS-784 > URL: https://issues.apache.org/jira/browse/LENS-784 > Project: Apache Lens > Issue Type: Task > Components: build >Reporter: Raju Bairishetti >Assignee: Amareshwari Sriramadasu > Fix For: 2.4 > > > Right now we have build job only with java7. We need to set up a jenkins > build job with java8 as there are some incompatible changes in java8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-774) Unable to override "lens.server.session.expiry.service.interval.secs" because of spelling mistake
[ https://issues.apache.org/jira/browse/LENS-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-774. - > Unable to override "lens.server.session.expiry.service.interval.secs" because > of spelling mistake > - > > Key: LENS-774 > URL: https://issues.apache.org/jira/browse/LENS-774 > Project: Apache Lens > Issue Type: Bug > Components: server >Reporter: Deepak Barr >Assignee: Deepak Barr >Priority: Minor > Labels: incompatible > Fix For: 2.4 > > Attachments: LENS-774.2.patch, LENS-774.patch > > > Property String in LensConfConstants.java > public static final String SESSION_EXPIRY_SERVICE_INTERVAL_IN_SECS = > SERVER_PFX > + "session.expiry.serivce.interval.secs"; > Property in lensserver-default.xml > > lens.server.session.expiry.service.interval.secs > 3600 > Interval at which lens session expiry service > runs > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-629) A new, improved web client.
[ https://issues.apache.org/jira/browse/LENS-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-629. - > A new, improved web client. > --- > > Key: LENS-629 > URL: https://issues.apache.org/jira/browse/LENS-629 > Project: Apache Lens > Issue Type: Improvement >Reporter: Ankeet Maini >Assignee: Ankeet Maini > Labels: Hackathon-July > Fix For: 2.4 > > Attachments: Data discovery.png, autocomplete-1.png, > autocomplete-2.png, default-view.png, lens-patch.patch, query results.png, > query-status.png, results.png > > > A new web client app to fire queries, discover cubes, native tables and to > view results. > Some of the salient features of the app would be:- > 1. A single page app which is sleek, responsive and async. > 2. Provision to discover cubes, tables in a tree view as well as in detail. > 3. A scalable app which scales well for very large number of tables, cubes > and result sets to give an enriched experience without getting bloated or > introduce considerable lag during continuous use. > 4. A book markable app where in URL reflects the state of the user, and is > easily sharable. e.g a link > [http://localhost:8080/query/schema/cube/sample_cube] > (http://localhost:8080/query/schema/cube/sample_cube) would open and give the > user the same view. > 5. A syntax highlighted code editor. > 6. Autocomplete for cubes, native tables to make the experience of writing > queries as close to SQL clients, bringing it on the browser. > 7. Give a nice, clean and neat look to the data. > 8. Provision to see queries based on the status, e.g. RUNNING, QUEUED, FAILED > etc. > Tech stack > 1. The app is built with ReactJS, Flux architecture from Facebook. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-341) Lens is not building against on JAVA-8
[
https://issues.apache.org/jira/browse/LENS-341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-341.
-
> Lens is not building against on JAVA-8
> --
>
> Key: LENS-341
> URL: https://issues.apache.org/jira/browse/LENS-341
> Project: Apache Lens
> Issue Type: Improvement
> Components: build
>Reporter: Raju Bairishetti
>Assignee: Raju Bairishetti
>Priority: Critical
> Fix For: 2.4
>
> Attachments: LENS-341.patch
>
>
> Right now, lens is successfully compiled with *java6*. But it is failing with
> *java8*.
> *Error stack trace*
> {noformat}
> [ERROR] Failed to execute goal
> org.codehaus.enunciate:maven-enunciate-plugin:1.28:docs (default) on project
> lens-server: Execution default of goal
> org.codehaus.enunciate:maven-enunciate-plugin:1.28:docs failed: A required
> class was missing while executing
> org.codehaus.enunciate:maven-enunciate-plugin:1.28:docs:
> com/sun/mirror/apt/AnnotationProcessorFactory
> [ERROR] -
> [ERROR] realm =plugin>org.codehaus.enunciate:maven-enunciate-plugin:1.28
> [ERROR] strategy = org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy
> [ERROR] urls[0] =
> file:/Users/raju.bairishetti/.m2/repository/org/codehaus/enunciate/maven-enunciate-plugin/1.28/maven-enunciate-plugin-1.28.jar
> [ERROR] urls[1] =
> file:/Users/raju.bairishetti/.m2/repository/org/codehaus/enunciate/maven-enunciate-slim-plugin/1.28/maven-enunciate-slim-plugin-1.28.jar
> [ERROR] urls[2] =
> file:/Users/raju.bairishetti/.m2/repository/org/apache/maven/plugins/maven-install-plugin/2.3.1/maven-install-plugin-2.3.1.jar
> [ERROR] urls[3] =
> file:/Users/raju.bairishetti/.m2/repository/org/codehaus/plexus/plexus-digest/1.0/plexus-digest-1.0.jar
> [ERROR] urls[4] =
> file:/Users/raju.bairishetti/.m2/repository/org/apache/maven/plugins/maven-deploy-plugin/2.7/maven-deploy-plugin-2.7.jar
> [ERROR] urls[5] =
> file:/Users/raju.bairishetti/.m2/repository/org/apache/maven/enforcer/enforcer-api/1.0/enforcer-api-1.0.jar
> [ERROR] urls[6] =
> file:/Users/raju.bairishetti/.m2/repository/junit/junit/3.8.1/junit-3.8.1.jar
> [ERROR] urls[7] =
> file:/Users/raju.bairishetti/.m2/repository/org/apache/maven/shared/maven-filtering/1.0/maven-filtering-1.0.jar
> [ERROR] urls[8] =
> file:/Users/raju.bairishetti/.m2/repository/org/apache/maven/reporting/maven-reporting-api/2.0.6/maven-reporting-api-2.0.6.jar
> [ERROR] urls[9] =
> file:/Users/raju.bairishetti/.m2/repository/org/apache/maven/doxia/doxia-sink-api/1.0-alpha-7/doxia-sink-api-1.0-alpha-7.jar
> [ERROR] urls[10] =
> file:/Users/raju.bairishetti/.m2/repository/commons-cli/commons-cli/1.0/commons-cli-1.0.jar
> [ERROR] urls[11] =
> file:/Users/raju.bairishetti/.m2/repository/org/codehaus/plexus/plexus-interactivity-api/1.0-alpha-4/plexus-interactivity-api-1.0-alpha-4.jar
> [ERROR] urls[12] =
> file:/Users/raju.bairishetti/.m2/repository/org/codehaus/plexus/plexus-interpolation/1.12/plexus-interpolation-1.12.jar
> [ERROR] urls[13] =
> file:/Users/raju.bairishetti/.m2/repository/org/sonatype/plexus/plexus-build-api/0.0.4/plexus-build-api-0.0.4.jar
> [ERROR] urls[14] =
> file:/Users/raju.bairishetti/.m2/repository/org/codehaus/plexus/plexus-utils/3.0/plexus-utils-3.0.jar
> [ERROR] urls[15] =
> file:/Users/raju.bairishetti/.m2/repository/org/codehaus/enunciate/enunciate-core/1.28/enunciate-core-1.28.jar
> [ERROR] urls[16] =
> file:/Users/raju.bairishetti/.m2/repository/org/codehaus/enunciate/enunciate-core-rt/1.28/enunciate-core-rt-1.28.jar
> [ERROR] urls[17] =
> file:/Users/raju.bairishetti/.m2/repository/org/codehaus/enunciate/enunciate-core-annotations/1.28/enunciate-core-annotations-1.28.jar
> [ERROR] urls[18] =
> file:/Users/raju.bairishetti/.m2/repository/javax/annotation/jsr250-api/1.0/jsr250-api-1.0.jar
> [ERROR] urls[19] =
> file:/Users/raju.bairishetti/.m2/repository/javax/ws/rs/jsr311-api/1.1.1/jsr311-api-1.1.1.jar
> [ERROR] urls[20] =
> file:/Users/raju.bairishetti/.m2/repository/javax/servlet/servlet-api/2.3/servlet-api-2.3.jar
> [ERROR] urls[21] =
> file:/Users/raju.bairishetti/.m2/repository/org/freemarker/freemarker/2.3.19/freemarker-2.3.19.jar
> [ERROR] urls[22] =
> file:/Users/raju.bairishetti/.m2/repository/net/sf/apt-jelly/apt-jelly-freemarker/2.15/apt-jelly-freemarker-2.15.jar
> [ERROR] urls[23] =
> file:/Users/raju.bairishetti/.m2/repository/net/sf/apt-jelly/apt-jelly-core/2.15/apt-jelly-core-2.15.jar
> [ERROR] urls[24] =
> file:/Users/raju.bairishetti/.m2/repository/commons-digester/commons-digester
[jira] [Closed] (LENS-816) ThreadSafeEstimatedQueryCollection is ignoring driver argument in getQueries and getQueryCount
[ https://issues.apache.org/jira/browse/LENS-816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-816. - > ThreadSafeEstimatedQueryCollection is ignoring driver argument in getQueries > and getQueryCount > -- > > Key: LENS-816 > URL: https://issues.apache.org/jira/browse/LENS-816 > Project: Apache Lens > Issue Type: Bug > Components: server >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal >Priority: Critical > Fix For: 2.4 > > Attachments: LENS-816.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-392) Look ahead timerange should not look for all finer granularity partitions to be present
[ https://issues.apache.org/jira/browse/LENS-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-392. - > Look ahead timerange should not look for all finer granularity partitions to > be present > --- > > Key: LENS-392 > URL: https://issues.apache.org/jira/browse/LENS-392 > Project: Apache Lens > Issue Type: Improvement > Components: cube >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.4 > > Attachments: LENS-392.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-607) Test Failures on java8
[ https://issues.apache.org/jira/browse/LENS-607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-607. - > Test Failures on java8 > -- > > Key: LENS-607 > URL: https://issues.apache.org/jira/browse/LENS-607 > Project: Apache Lens > Issue Type: Sub-task > Components: test >Reporter: Raju Bairishetti >Assignee: Raju Bairishetti > Fix For: 2.4 > > Attachments: LENS-607.patch > > > There are some test failures on lens-cube test module. Did not verify other > modules yet. > Ex: TestBaseCubeQueries, TestExpressionResolver and few more tests are > failing on java8 > Tests are failing while comparing the expected query with rewritten query. > Rewritten query and expected query are same but the **joining of tables are > not in the same order**. > In some tests, queries are hitting the fact tables form different cube than > expected in the test(i.e. fact tables from multiple cubes can answer the > query). I think we should either fix the tests in comparing with all the > possibilities or fix the order of querying the cube tables. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-399) TestRewriting test is failing with powermock incompatibility with jdk8
[
https://issues.apache.org/jira/browse/LENS-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-399.
-
> TestRewriting test is failing with powermock incompatibility with jdk8
> --
>
> Key: LENS-399
> URL: https://issues.apache.org/jira/browse/LENS-399
> Project: Apache Lens
> Issue Type: Sub-task
> Components: build, test
>Reporter: Raju Bairishetti
>Assignee: Raju Bairishetti
> Fix For: 2.4
>
> Attachments: LENS-399.patch
>
>
> Right now, TestRewriting is failing with the incompatible version of
> pwoermock on jdk8. We need to use latest version which is compatible for jdk8
> Current versions in lens:
> *1.8.5*
> *1.4.12*
> {noformat}
> An error occurred while instantiating class
> org.apache.lens.driver.cube.TestRewriting: Failed to transform class with
> name org.apache.lens.driver.cube.TestRewriting. Reason: java.io.IOException:
> invalid constant type: 18 at 1
> at org.testng.internal.ClassHelper.createInstance1(ClassHelper.java:398)
> at org.testng.internal.ClassHelper.createInstance(ClassHelper.java:299)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (LENS-765) null Error Message on Lens Server logs
[
https://issues.apache.org/jira/browse/LENS-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-765.
-
> null Error Message on Lens Server logs
> --
>
> Key: LENS-765
> URL: https://issues.apache.org/jira/browse/LENS-765
> Project: Apache Lens
> Issue Type: Bug
> Components: api, cube
>Affects Versions: 2.2
>Reporter: Arshad Matin
>Assignee: Sushil Mohanty
> Fix For: 2.4
>
>
> Getting a lot of null error message
> {noformat}
> 28 Aug 2015 09:03:26 [3ad5df03-1d69-4668-ab4b-8c4040038677] [estimate-3] WARN
> org.apache.lens.server.rewrite.RewriteUtil - Driver :
> org.apache.lens.driver.jdbc.JDBCDriver@3e6fd0b9 Skipped for the query
> rewriting due to
> org.apache.lens.server.api.error.LensException: null
> at
> org.apache.lens.cube.parse.CubeQueryContext.pickCandidateDimsToQuery(CubeQueryContext.java:807)
> ~[lens-cube-2.4.0-inm-SNAPSHOT.jar:2.4.0-inm-SNAPSHOT]
> at
> org.apache.lens.cube.parse.CubeQueryContext.toHQL(CubeQueryContext.java:854)
> ~[lens-cube-2.4.0-inm-SNAPSHOT.jar:2.4.0-inm-SNAPSHOT]
> at
> org.apache.lens.server.rewrite.RewriteUtil$DriverRewriterRunnable.run(RewriteUtil.java:325)
> ~[classes/:na]
> at
> org.apache.lens.server.query.QueryExecutionServiceImpl$RewriteEstimateRunnable.run(QueryExecutionServiceImpl.java:1345)
> [classes/:na]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> [na:1.8.0_40-internal]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> [na:1.8.0_40-internal]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [na:1.8.0_40-internal]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_40-internal]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40-internal]
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (LENS-187) Move cube specific error message codes from InMobi's Hive code to Lens
[ https://issues.apache.org/jira/browse/LENS-187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-187. - > Move cube specific error message codes from InMobi's Hive code to Lens > -- > > Key: LENS-187 > URL: https://issues.apache.org/jira/browse/LENS-187 > Project: Apache Lens > Issue Type: Task > Components: cube >Reporter: Jaideep Dhok >Assignee: Sushil Mohanty > Labels: incompatible > Fix For: 2.4 > > Attachments: LENS-187-3.patch > > > Cube code has been moved into Lens, but the error messages used by lens-cube > still remain in the InMobi's Hive fork. This is to track and move all cube > related error messages from (InMobi) Hive to Lens. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: New Committers: Sushil Mohanty, Pranav Kumar Agarwal, Deepak Barr, Amruth S
Congrats On Tue, Nov 3, 2015 at 7:50 PM, Rajat Khandelwal wrote: > With great power comes great responsibility. Go through > http://lens.apache.org/developer/commit.html and use the power > judiciously. > > On Tue, Nov 3, 2015 at 7:06 PM Raghavendra Singh < > raghavendra.si...@inmobi.com> wrote: > > > Congrats All !! :) > > > > On Tue, Nov 3, 2015 at 7:04 PM, Ankeet Maini > > wrote: > > > >> Congratulations! > >> > >> On Tue, Nov 3, 2015 at 6:55 PM, Raju Bairishetti > >> wrote: > >> > >>> Congratulations to all :) > >>> > >>> On Tue, Nov 3, 2015 at 7:36 PM, amareshwarisr . > > >>> wrote: > >>> > >>> > Congratulations to all of you! Welcome on board! > >>> > > >>> > On Tue, Nov 3, 2015 at 5:04 PM, Rajat Khandelwal > >>> > wrote: > >>> > > >>> > > The PMC for Apache Lens has asked Sushil, Pranav, Deepak and Amruth > >>> to > >>> > > become Lens Committers. We are pleased to announce that they have > >>> > accepted. > >>> > > Being a committer enables access to commit to the source > >>> repositories and > >>> > > binding votes for code reviews. > >>> > > Join me in Congratulating them. > >>> > > > >>> > > Congratulations to all of you! Looking forward for more of your > >>> > > contributions in Apache Lens. > >>> > > > >>> > > > >>> > > Thanks > >>> > > > >>> > > >>> > >>> > >>> > >>> -- > >>> Thanks > >>> Raju Bairishetti, > >>> > >>> www.inmobi.com > >>> > >>> > >>> > >>> > >>> *2012 ME Best Mobile Ad Network Award Winner > >>> > >>> [image: http://www.inmobi.com/press-releases/files/2013/02/MIT.png] > >>> > >> > >> > >> > >> -- > >> *Ankeet Maini* > >> *"Just when the caterpillar thought the world was over, it became a > >> butterfly!"* > >> > > > > > > _ > > The information contained in this communication is intended solely for > the > > use of the individual or entity to whom it is addressed and others > > authorized to receive it. It may contain confidential or legally > privileged > > information. If you are not the intended recipient you are hereby > notified > > that any disclosure, copying, distribution or taking any action in > reliance > > on the contents of this information is strictly prohibited and may be > > unlawful. If you have received this communication in error, please notify > > us immediately by responding to this email and then delete it from your > > system. The firm is neither liable for the proper and complete > transmission > > of the information contained in this communication nor for any delay in > its > > receipt. > -- _ The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
[jira] [Commented] (LENS-804) Verify Lens 2.4 issues
[ https://issues.apache.org/jira/browse/LENS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986913#comment-14986913 ] Arshad Matin commented on LENS-804: --- Started Testing. Will try to finish by tom EOD > Verify Lens 2.4 issues > -- > > Key: LENS-804 > URL: https://issues.apache.org/jira/browse/LENS-804 > Project: Apache Lens > Issue Type: Sub-task > Components: build >Reporter: Raju Bairishetti >Assignee: Arshad Matin > Fix For: 2.4 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Work started] (LENS-804) Verify Lens 2.4 issues
[ https://issues.apache.org/jira/browse/LENS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on LENS-804 started by Arshad Matin. - > Verify Lens 2.4 issues > -- > > Key: LENS-804 > URL: https://issues.apache.org/jira/browse/LENS-804 > Project: Apache Lens > Issue Type: Sub-task > Components: build >Reporter: Raju Bairishetti >Assignee: Arshad Matin > Fix For: 2.4 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (LENS-739) Generate udf jar for lens-regression
[ https://issues.apache.org/jira/browse/LENS-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin resolved LENS-739. --- Resolution: Fixed Thanks [~archana.h] > Generate udf jar for lens-regression > > > Key: LENS-739 > URL: https://issues.apache.org/jira/browse/LENS-739 > Project: Apache Lens > Issue Type: Improvement > Components: regression > Environment: QA >Reporter: Archana H >Assignee: Archana H > Fix For: 2.4 > > Attachments: LENS-739.patch, LENS-739.patch > > > Generate UDF jar for regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 39082: LENS-739 Generate udf jar for lens-regression
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/39082/#review101886 --- Ship it! Ship It! - Arshad Matin On Oct. 7, 2015, 12:18 p.m., Archana H wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/39082/ > --- > > (Updated Oct. 7, 2015, 12:18 p.m.) > > > Review request for lens. > > > Repository: lens > > > Description > --- > > Generate UDF jar for regression. > > > Diffs > - > > lens-regression/pom.xml 560b4df > lens-regression/src/additional/java/SampleUdf.java PRE-CREATION > > Diff: https://reviews.apache.org/r/39082/diff/ > > > Testing > --- > > [INFO] > > [INFO] Reactor Summary: > [INFO] > [INFO] Lens Checkstyle Rules . SUCCESS [5.065s] > [INFO] Lens .. SUCCESS [6.233s] > [INFO] Lens API .. SUCCESS [39.366s] > [INFO] Lens API for server and extensions SUCCESS [56.514s] > [INFO] Lens Cube . SUCCESS [1:41.836s] > [INFO] Lens DB storage ... SUCCESS [24.091s] > [INFO] Lens Query Library SUCCESS [24.025s] > [INFO] Lens Hive Driver .. SUCCESS [27.552s] > [INFO] Lens Driver for JDBC .. SUCCESS [32.958s] > [INFO] Lens Elastic Search Driver SUCCESS [25.145s] > [INFO] Lens Server ... SUCCESS [1:38.393s] > [INFO] Lens client ... SUCCESS [32.584s] > [INFO] Lens CLI .. SUCCESS [33.478s] > [INFO] Lens Examples . SUCCESS [15.103s] > [INFO] Lens Distribution . SUCCESS [15.695s] > [INFO] Lens ML Lib ... SUCCESS [38.854s] > [INFO] Lens ML Ext Distribution .. SUCCESS [10.089s] > [INFO] Lens Regression ... SUCCESS [23.547s] > [INFO] Lens UI ... FAILURE [0.195s] > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 10:12.093s > [INFO] Finished at: Wed Oct 07 17:41:27 IST 2015 > [INFO] Final Memory: 174M/899M > [INFO] > > > > Thanks, > > Archana H > >
Re: October report
+1 On Thu, Oct 8, 2015 at 12:45 PM, Rajat Khandelwal wrote: > +1 > > > On Mon, Oct 5, 2015 at 3:58 PM amareshwarisr . > wrote: > > > Hi all, > > > > I have put up report for the month of October - > > https://cwiki.apache.org/confluence/display/LENS/October%2C2015. Let me > > know if you have any comments. > > > > Will submit report to the board tomorrow. > > > > Thanks > > Amareshwari > > > -- _ The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
[jira] [Created] (LENS-786) Provide Secondary Storage to store lens query results
Arshad Matin created LENS-786: - Summary: Provide Secondary Storage to store lens query results Key: LENS-786 URL: https://issues.apache.org/jira/browse/LENS-786 Project: Apache Lens Issue Type: Improvement Reporter: Arshad Matin We should provide one more secondary storage for lens result in case primary one is down. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (LENS-785) Add REST API to fetch Explain logs
Arshad Matin created LENS-785: - Summary: Add REST API to fetch Explain logs Key: LENS-785 URL: https://issues.apache.org/jira/browse/LENS-785 Project: Apache Lens Issue Type: New Feature Reporter: Arshad Matin -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-776) Lens Server not Starting if there is a failure in creating "saved query" table
[
https://issues.apache.org/jira/browse/LENS-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14900414#comment-14900414
]
Arshad Matin commented on LENS-776:
---
Thanks [~amrk7]
> Lens Server not Starting if there is a failure in creating "saved query" table
> --
>
> Key: LENS-776
> URL: https://issues.apache.org/jira/browse/LENS-776
> Project: Apache Lens
> Issue Type: Bug
>Reporter: Arshad Matin
>Assignee: Amruth S
> Attachments: LENS-776.patch
>
>
> This is coming with the default config and i was using MySql db
> {noformat}
>
>lens.server.savedquery.jdbc.dialectclass
>org.apache.lens.server.query.save.SavedQueryDao$HSQLDialect
>Dialect of the target DB, Default is HSQL. Override with the
> target DB used.
>
> {noformat}
> Even with HSQL, saved_query table creation failure shouldnt stop lens server
> from coming up.
> Exception
> {noformat}
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] ERROR
> org.apache.lens.server.LensServer - Error while creating Lens server
> java.lang.RuntimeException: Cannot initialize saved query service
> at
> org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:69)
> ~[classes/:na]
> at
> org.apache.hive.service.CompositeService.init(CompositeService.java:59)
> ~[hive-service-0.13.3-inm.jar:0.13.3-inm]
> at org.apache.lens.server.LensServices.init(LensServices.java:235)
> ~[classes/:na]
> at
> org.apache.lens.server.LensServer.startServices(LensServer.java:135)
> ~[classes/:na]
> at org.apache.lens.server.LensServer.(LensServer.java:85)
> ~[classes/:na]
> at
> org.apache.lens.server.LensServer.createLensServer(LensServer.java:74)
> ~[classes/:na]
> at org.apache.lens.server.LensServer.main(LensServer.java:191)
> ~[classes/:na]
> Caused by: org.apache.lens.server.api.error.LensException: Error initializing
> saved query dao
> at
> org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:72)
> ~[classes/:na]
> at
> org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:64)
> ~[classes/:na]
> ... 6 common frames omitted
> Caused by: org.apache.lens.server.api.error.LensException: Cannot create
> saved query table!
> at
> org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:85)
> ~[classes/:na]
> at
> org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:70)
> ~[classes/:na]
> ... 7 common frames omitted
> Caused by: java.sql.SQLException: You have an error in your SQL syntax; check
> the manual that corresponds to your MySQL server version for the right syntax
> to use near 'GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
> description var' at line 1 Query: CREATE TABLE if not exists saved_query (id
> int GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
> description varchar(255), query varchar(255), params_json varchar(255),
> created_at timestamp, updated_at timestamp) Parameters: []
> at
> org.apache.commons.dbutils.AbstractQueryRunner.rethrow(AbstractQueryRunner.java:363)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:490)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:420)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:83)
> ~[classes/:na]
> ... 8 common frames omitted
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.lens.server.LensServices - Stopping lens server
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.lens.server.LensServices - Server restart is not enabled. Not
> persisting the server state
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.hive.service.CompositeService - Error stopping query
> java.lang.NullPointerException: null
> at
> org.apache.lens.server.query.QueryExecutionServiceImpl.stop(QueryExecutionServiceImpl.java:1129)
> ~[classes/:na]
> at
> org.apache.hive.service.CompositeService.stop(CompositeService.java:102)
> [hive-service-0.13.3-inm.jar:0.13.3-inm]
> a
[jira] [Updated] (LENS-776) Lens Server not Starting if there is a failure in creating "saved query" table
[
https://issues.apache.org/jira/browse/LENS-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin updated LENS-776:
--
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Lens Server not Starting if there is a failure in creating "saved query" table
> --
>
> Key: LENS-776
> URL: https://issues.apache.org/jira/browse/LENS-776
> Project: Apache Lens
> Issue Type: Bug
>Reporter: Arshad Matin
>Assignee: Amruth S
> Attachments: LENS-776.patch
>
>
> This is coming with the default config and i was using MySql db
> {noformat}
>
>lens.server.savedquery.jdbc.dialectclass
>org.apache.lens.server.query.save.SavedQueryDao$HSQLDialect
>Dialect of the target DB, Default is HSQL. Override with the
> target DB used.
>
> {noformat}
> Even with HSQL, saved_query table creation failure shouldnt stop lens server
> from coming up.
> Exception
> {noformat}
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] ERROR
> org.apache.lens.server.LensServer - Error while creating Lens server
> java.lang.RuntimeException: Cannot initialize saved query service
> at
> org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:69)
> ~[classes/:na]
> at
> org.apache.hive.service.CompositeService.init(CompositeService.java:59)
> ~[hive-service-0.13.3-inm.jar:0.13.3-inm]
> at org.apache.lens.server.LensServices.init(LensServices.java:235)
> ~[classes/:na]
> at
> org.apache.lens.server.LensServer.startServices(LensServer.java:135)
> ~[classes/:na]
> at org.apache.lens.server.LensServer.(LensServer.java:85)
> ~[classes/:na]
> at
> org.apache.lens.server.LensServer.createLensServer(LensServer.java:74)
> ~[classes/:na]
> at org.apache.lens.server.LensServer.main(LensServer.java:191)
> ~[classes/:na]
> Caused by: org.apache.lens.server.api.error.LensException: Error initializing
> saved query dao
> at
> org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:72)
> ~[classes/:na]
> at
> org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:64)
> ~[classes/:na]
> ... 6 common frames omitted
> Caused by: org.apache.lens.server.api.error.LensException: Cannot create
> saved query table!
> at
> org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:85)
> ~[classes/:na]
> at
> org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:70)
> ~[classes/:na]
> ... 7 common frames omitted
> Caused by: java.sql.SQLException: You have an error in your SQL syntax; check
> the manual that corresponds to your MySQL server version for the right syntax
> to use near 'GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
> description var' at line 1 Query: CREATE TABLE if not exists saved_query (id
> int GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
> description varchar(255), query varchar(255), params_json varchar(255),
> created_at timestamp, updated_at timestamp) Parameters: []
> at
> org.apache.commons.dbutils.AbstractQueryRunner.rethrow(AbstractQueryRunner.java:363)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:490)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:420)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:83)
> ~[classes/:na]
> ... 8 common frames omitted
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.lens.server.LensServices - Stopping lens server
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.lens.server.LensServices - Server restart is not enabled. Not
> persisting the server state
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.hive.service.CompositeService - Error stopping query
> java.lang.NullPointerException: null
> at
> org.apache.lens.server.query.QueryExecutionServiceImpl.stop(QueryExecutionServiceImpl.java:1129)
> ~[classes/:na]
> at
> org.apache.hive.service.CompositeService.stop(CompositeService.java:102)
> [hive-service-0.13.3-inm.jar:0.13.3-inm]
> at
>
Re: Review Request 38446: LENS-776 Lens Server not Starting if there is a failure in creating "saved query" table
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38446/#review99511 --- Ship it! Ship It! - Arshad Matin On Sept. 17, 2015, 4:42 a.m., Amruth Sampath wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/38446/ > --- > > (Updated Sept. 17, 2015, 4:42 a.m.) > > > Review request for lens, Amareshwari Sriramadasu, Arshad Matin, and Rajat > Khandelwal. > > > Repository: lens > > > Description > --- > > Removing saved query service and resource from lensserver-default.xml. > > This is to avoid start up failures when there is a failure in starting saved > query service. > > > Diffs > - > > lens-server/src/main/resources/lensserver-default.xml 6a1ac7f > > Diff: https://reviews.apache.org/r/38446/diff/ > > > Testing > --- > > All test cases running fine. > > [INFO] > > [INFO] Reactor Summary: > [INFO] > [INFO] Lens Checkstyle Rules .. SUCCESS [ 2.750 > s] > [INFO] Lens ... SUCCESS [ 3.725 > s] > [INFO] Lens API ... SUCCESS [ 31.822 > s] > [INFO] Lens API for server and extensions . SUCCESS [ 33.170 > s] > [INFO] Lens Cube .. SUCCESS [06:20 > min] > [INFO] Lens DB storage SUCCESS [ 22.835 > s] > [INFO] Lens Query Library . SUCCESS [ 23.094 > s] > [INFO] Lens Hive Driver ... SUCCESS [03:22 > min] > [INFO] Lens Driver for JDBC ... SUCCESS [ 48.352 > s] > [INFO] Lens Elastic Search Driver . SUCCESS [ 24.133 > s] > [INFO] Lens Server SUCCESS [08:58 > min] > [INFO] Lens client SUCCESS [ 45.832 > s] > [INFO] Lens CLI ... SUCCESS [03:56 > min] > [INFO] Lens Examples .. SUCCESS [ 13.695 > s] > [INFO] Lens Distribution .. SUCCESS [ 14.773 > s] > [INFO] Lens ML Lib SUCCESS [02:01 > min] > [INFO] Lens ML Ext Distribution ... SUCCESS [ 5.419 > s] > [INFO] Lens Regression SUCCESS [ 18.560 > s] > [INFO] > > [INFO] BUILD SUCCESS > [INFO] > > [INFO] Total time: 29:28 min > [INFO] Finished at: 2015-09-17T10:11:49+05:30 > [INFO] Final Memory: 179M/809M > [INFO] > > > > Thanks, > > Amruth Sampath > >
[jira] [Created] (LENS-780) Fail Estimate if query is running UDF and its jar is not loaded in the session
Arshad Matin created LENS-780: - Summary: Fail Estimate if query is running UDF and its jar is not loaded in the session Key: LENS-780 URL: https://issues.apache.org/jira/browse/LENS-780 Project: Apache Lens Issue Type: Improvement Reporter: Arshad Matin -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (LENS-778) Killing JDBC Query is not closing the connection
Arshad Matin created LENS-778:
-
Summary: Killing JDBC Query is not closing the connection
Key: LENS-778
URL: https://issues.apache.org/jira/browse/LENS-778
Project: Apache Lens
Issue Type: Bug
Reporter: Arshad Matin
Use Case
===
Set max connection pool to 1.
Ran a query and killed it.
Ran another query and it failed throwing following exception
{noformat}
18 Sep 2015 07:18:51 [15e7cb89-5f0c-4741-8da6-69384c94cd01]
[lens-driver-jdbc-2] ERROR org.apache.lens.driver.jdbc.JDBCDriver - Error
executing SQL query: 15e7cb89-5f0c-4741-8da6-69384c94cd01 reason: Streaming
result set com.mysql.jdbc.RowDataDynamic@4651e5c3 is still active. No
statements may be issued when any streaming result sets are open and in use on
a given connection. Ensure that you have called .close() on any active
streaming result sets before attempting more queries.
java.sql.SQLException: Streaming result set
com.mysql.jdbc.RowDataDynamic@4651e5c3 is still active. No statements may be
issued when any streaming result sets are open and in use on a given
connection. Ensure that you have called .close() on any active streaming result
sets before attempting more queries.
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:914)
~[mysql-connector-java-5.0.8-bin.jar:na]
at
com.mysql.jdbc.MysqlIO.checkForOutstandingStreamingData(MysqlIO.java:2181)
~[mysql-connector-java-5.0.8-bin.jar:na]
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1542)
~[mysql-connector-java-5.0.8-bin.jar:na]
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723)
~[mysql-connector-java-5.0.8-bin.jar:na]
at com.mysql.jdbc.Connection.execSQL(Connection.java:3277)
~[mysql-connector-java-5.0.8-bin.jar:na]
at com.mysql.jdbc.Connection.execSQL(Connection.java:3206)
~[mysql-connector-java-5.0.8-bin.jar:na]
at com.mysql.jdbc.Statement.execute(Statement.java:727)
~[mysql-connector-java-5.0.8-bin.jar:na]
at
com.mchange.v2.c3p0.impl.NewProxyStatement.execute(NewProxyStatement.java:223)
~[c3p0-0.9.5.jar:0.9.5]
at
org.apache.lens.driver.jdbc.JDBCDriver$QueryCallable.call(JDBCDriver.java:327)
[lens-driver-jdbc-2.4.0-inm.jar:2.4.0-inm]
at
org.apache.lens.driver.jdbc.JDBCDriver$QueryCallable.call(JDBCDriver.java:282)
[lens-driver-jdbc-2.4.0-inm.jar:2.4.0-inm]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[na:1.8.0_40]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_40]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_40]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (LENS-777) Query remains in queue even when driver is free
Arshad Matin created LENS-777:
-
Summary: Query remains in queue even when driver is free
Key: LENS-777
URL: https://issues.apache.org/jira/browse/LENS-777
Project: Apache Lens
Issue Type: Bug
Reporter: Arshad Matin
Scenario:
Config
{noformat}
driver.max.concurrent.launched.queries
1
Maximum queries which can be launched simultaneously on this
driver. This should be equal to
lens.driver.jdbc.pool.max.size. This configuration value is only useful
when MaxConcurrentDriverQueriesConstraint
is enabled by using
org.apache.lens.server.api.query.constraint.MaxConcurrentDriverQueriesConstraintFactory
as
one of the factories in lens.driver.jdbc.query.constraint.factories
property.
lens.driver.jdbc.pool.max.size
1
Maximum number of concurrent connections allowed in
pool
{noformat}
Launched 1st query with user U1
Launched 2nd query with user U2
Launched 3rd query with user U1
Launched 4th query with user U2
Query Status
==
Q1 -> Running
Q2 -> Queued(queue number = 1)
Q3 -> Queued(queue number = 2)
Q4 -> Queued(queue number = 3)
When Q1 completes, Query Status
==
Q1 -> Successful
Q2 -> Queued(queue number = 1)
Q3 -> Running
Q4 -> Queued(queue number = 2)
When Q2 completes, Query Status
==
Q1 -> Successful
Q2 -> Queued(queue number = 1)
Q3 -> Successful
Q4 -> Queued(queue number = 2)
user "U2" query will never get picked. Another query launched by user "U1" will
be answered.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: Review Request 37526: LENS-733 : Add library for lens regression
> On Sept. 15, 2015, 2:12 p.m., Rajat Khandelwal wrote: > > lens-regression/src/main/java/org/apache/lens/regression/core/helpers/QueryHelper.java, > > line 95 > > <https://reviews.apache.org/r/37526/diff/5/?file=1072534#file1072534line95> > > > > `LensAPIResult` is a generic class. Is it possible to return > > `LensAPIResult`? Return type is generic, so that it can handle both success and failure scenario > On Sept. 15, 2015, 2:12 p.m., Rajat Khandelwal wrote: > > lens-regression/src/main/java/org/apache/lens/regression/core/helpers/QueryHelper.java, > > line 98 > > <https://reviews.apache.org/r/37526/diff/5/?file=1072534#file1072534line98> > > > > instead of string version of LensConf, is it possible to take a > > LensConf isntance? We have method for both string and LensConf - Arshad --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37526/#review99026 ------- On Sept. 14, 2015, 1:10 p.m., Arshad Matin wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/37526/ > --- > > (Updated Sept. 14, 2015, 1:10 p.m.) > > > Review request for lens. > > > Repository: lens > > > Description > --- > > LENS-733 : Add library for lens regression > > > LENS-733 : Add library for lens regression > > > LENS-733 : Add library for lens regression > > > LENS-733 : Add library for lens regression > > > LENS-733 : Add Helper Method for lens-regression > > > Diffs > - > > lens-regression/pom.xml 48c5b0c8887f5210cccdc6dccb078f90a7398509 > > lens-regression/src/main/java/org/apache/lens/regression/core/constants/QueryInventory.java > PRE-CREATION > > lens-regression/src/main/java/org/apache/lens/regression/core/helpers/LensServerHelper.java > 8b41dbae3a31fcc86794b751c324609da1c3ac92 > > lens-regression/src/main/java/org/apache/lens/regression/core/helpers/MetastoreHelper.java > aff0e8ea48fc6cb5d6edb31428ab32ef53ab870d > > lens-regression/src/main/java/org/apache/lens/regression/core/helpers/QueryHelper.java > 70cad28fbf0722c34b2fe8c041d0570e86bbabf6 > > lens-regression/src/main/java/org/apache/lens/regression/core/helpers/ServiceManagerHelper.java > b14b00bda417830a50b48c81e5f2cbe2735896b6 > > lens-regression/src/main/java/org/apache/lens/regression/core/helpers/SessionHelper.java > e7bc700c063e914d5c305d6f468f4d7f4ff9cbd4 > > lens-regression/src/main/java/org/apache/lens/regression/core/testHelper/BaseTestClass.java > 2985af46374606bef388e876c28fbcaaa43adc22 > > lens-regression/src/main/java/org/apache/lens/regression/util/AssertUtil.java > 62bd1608dbd1ffcbdc931a1f024b5d73a696bb25 > > lens-regression/src/main/java/org/apache/lens/regression/util/HadoopUtil.java > PRE-CREATION > lens-regression/src/main/java/org/apache/lens/regression/util/Util.java > 0e531e02718ba553868c52d0c0c4ad25a4498e48 > > Diff: https://reviews.apache.org/r/37526/diff/ > > > Testing > --- > > [INFO] > > [INFO] Reactor Summary: > [INFO] > [INFO] Lens Checkstyle Rules .. SUCCESS [ 2.903 > s] > [INFO] Lens ... SUCCESS [ 3.844 > s] > [INFO] Lens API ... SUCCESS [ 29.872 > s] > [INFO] Lens API for server and extensions . SUCCESS [ 30.727 > s] > [INFO] Lens Cube .. SUCCESS [ 52.871 > s] > [INFO] Lens DB storage SUCCESS [ 12.098 > s] > [INFO] Lens Query Library . SUCCESS [ 16.444 > s] > [INFO] Lens Hive Driver ... SUCCESS [ 23.530 > s] > [INFO] Lens Driver for JDBC ... SUCCESS [ 25.832 > s] > [INFO] Lens Elastic Search Driver . SUCCESS [ 20.170 > s] > [INFO] Lens Server SUCCESS [01:14 > min] > [INFO] Lens client SUCCESS [ 27.819 > s] > [INFO] Lens CLI ... SUCCESS [ 26.542 > s] > [INFO] Lens Examples .. SUCCESS [ 21.779 > s] > [INFO] Lens Distribution
[jira] [Commented] (LENS-776) Lens Server not Starting if there is a failure in creating "saved query" table
[
https://issues.apache.org/jira/browse/LENS-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14747235#comment-14747235
]
Arshad Matin commented on LENS-776:
---
Yes, its better to disable it by default. When it is enabled, then we can throw
this error.
> Lens Server not Starting if there is a failure in creating "saved query" table
> --
>
> Key: LENS-776
> URL: https://issues.apache.org/jira/browse/LENS-776
> Project: Apache Lens
> Issue Type: Bug
>Reporter: Arshad Matin
>Assignee: Amruth S
>
> This is coming with the default config and i was using MySql db
> {noformat}
>
>lens.server.savedquery.jdbc.dialectclass
>org.apache.lens.server.query.save.SavedQueryDao$HSQLDialect
>Dialect of the target DB, Default is HSQL. Override with the
> target DB used.
>
> {noformat}
> Even with HSQL, saved_query table creation failure shouldnt stop lens server
> from coming up.
> Exception
> {noformat}
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] ERROR
> org.apache.lens.server.LensServer - Error while creating Lens server
> java.lang.RuntimeException: Cannot initialize saved query service
> at
> org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:69)
> ~[classes/:na]
> at
> org.apache.hive.service.CompositeService.init(CompositeService.java:59)
> ~[hive-service-0.13.3-inm.jar:0.13.3-inm]
> at org.apache.lens.server.LensServices.init(LensServices.java:235)
> ~[classes/:na]
> at
> org.apache.lens.server.LensServer.startServices(LensServer.java:135)
> ~[classes/:na]
> at org.apache.lens.server.LensServer.(LensServer.java:85)
> ~[classes/:na]
> at
> org.apache.lens.server.LensServer.createLensServer(LensServer.java:74)
> ~[classes/:na]
> at org.apache.lens.server.LensServer.main(LensServer.java:191)
> ~[classes/:na]
> Caused by: org.apache.lens.server.api.error.LensException: Error initializing
> saved query dao
> at
> org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:72)
> ~[classes/:na]
> at
> org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:64)
> ~[classes/:na]
> ... 6 common frames omitted
> Caused by: org.apache.lens.server.api.error.LensException: Cannot create
> saved query table!
> at
> org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:85)
> ~[classes/:na]
> at
> org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:70)
> ~[classes/:na]
> ... 7 common frames omitted
> Caused by: java.sql.SQLException: You have an error in your SQL syntax; check
> the manual that corresponds to your MySQL server version for the right syntax
> to use near 'GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
> description var' at line 1 Query: CREATE TABLE if not exists saved_query (id
> int GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
> description varchar(255), query varchar(255), params_json varchar(255),
> created_at timestamp, updated_at timestamp) Parameters: []
> at
> org.apache.commons.dbutils.AbstractQueryRunner.rethrow(AbstractQueryRunner.java:363)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:490)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:420)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:83)
> ~[classes/:na]
> ... 8 common frames omitted
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.lens.server.LensServices - Stopping lens server
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.lens.server.LensServices - Server restart is not enabled. Not
> persisting the server state
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.hive.service.CompositeService - Error stopping query
> java.lang.NullPointerException: null
> at
> org.apache.lens.server.query.QueryExecutionServiceImpl.stop(QueryExecutionServiceImpl.java:1129)
> ~[classes/:na]
> at
> org.apache.hive.service.CompositeService.stop(CompositeService.java:102)
> [hive-service-0.13.3-inm.j
[jira] [Updated] (LENS-776) Lens Server not Starting if there is a failure in creating "saved query" table
[
https://issues.apache.org/jira/browse/LENS-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin updated LENS-776:
--
Description:
This is coming with the default config and i was using MySql db
{noformat}
lens.server.savedquery.jdbc.dialectclass
org.apache.lens.server.query.save.SavedQueryDao$HSQLDialect
Dialect of the target DB, Default is HSQL. Override with the
target DB used.
{noformat}
Even with HSQL, saved_query table creation failure shouldnt stop lens server
from coming up.
Exception
{noformat}
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] ERROR
org.apache.lens.server.LensServer - Error while creating Lens server
java.lang.RuntimeException: Cannot initialize saved query service
at
org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:69)
~[classes/:na]
at
org.apache.hive.service.CompositeService.init(CompositeService.java:59)
~[hive-service-0.13.3-inm.jar:0.13.3-inm]
at org.apache.lens.server.LensServices.init(LensServices.java:235)
~[classes/:na]
at org.apache.lens.server.LensServer.startServices(LensServer.java:135)
~[classes/:na]
at org.apache.lens.server.LensServer.(LensServer.java:85)
~[classes/:na]
at
org.apache.lens.server.LensServer.createLensServer(LensServer.java:74)
~[classes/:na]
at org.apache.lens.server.LensServer.main(LensServer.java:191)
~[classes/:na]
Caused by: org.apache.lens.server.api.error.LensException: Error initializing
saved query dao
at
org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:72)
~[classes/:na]
at
org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:64)
~[classes/:na]
... 6 common frames omitted
Caused by: org.apache.lens.server.api.error.LensException: Cannot create saved
query table!
at
org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:85)
~[classes/:na]
at
org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:70)
~[classes/:na]
... 7 common frames omitted
Caused by: java.sql.SQLException: You have an error in your SQL syntax; check
the manual that corresponds to your MySQL server version for the right syntax
to use near 'GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
description var' at line 1 Query: CREATE TABLE if not exists saved_query (id
int GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
description varchar(255), query varchar(255), params_json varchar(255),
created_at timestamp, updated_at timestamp) Parameters: []
at
org.apache.commons.dbutils.AbstractQueryRunner.rethrow(AbstractQueryRunner.java:363)
~[commons-dbutils-1.5.jar:1.5]
at org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:490)
~[commons-dbutils-1.5.jar:1.5]
at org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:420)
~[commons-dbutils-1.5.jar:1.5]
at
org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:83)
~[classes/:na]
... 8 common frames omitted
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.LensServices - Stopping lens server
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.LensServices - Server restart is not enabled. Not
persisting the server state
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.hive.service.CompositeService - Error stopping query
java.lang.NullPointerException: null
at
org.apache.lens.server.query.QueryExecutionServiceImpl.stop(QueryExecutionServiceImpl.java:1129)
~[classes/:na]
at
org.apache.hive.service.CompositeService.stop(CompositeService.java:102)
[hive-service-0.13.3-inm.jar:0.13.3-inm]
at
org.apache.hive.service.CompositeService.stop(CompositeService.java:92)
[hive-service-0.13.3-inm.jar:0.13.3-inm]
at org.apache.lens.server.LensServices.stop(LensServices.java:402)
[classes/:na]
at org.apache.lens.server.LensServer.main(LensServer.java:201)
[classes/:na]
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.EventServiceImpl - Removed listener
org.apache.lens.server.metrics.MetricsServiceImpl$AsyncQueryStatusListener@3ddc6915
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.metrics.MetricsServiceImpl - Stopped metrics service
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.EventServiceImpl - Event service stopped
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] ERROR
org.apache.lens.server.LensServer - Error stopping services
java.lang.NullPointerException: null
[jira] [Updated] (LENS-776) Lens Server not Starting if there is a failure in creating "saved query" table
[
https://issues.apache.org/jira/browse/LENS-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin updated LENS-776:
--
Description:
This is coming with the default config
{noformat}
lens.server.savedquery.jdbc.dialectclass
org.apache.lens.server.query.save.SavedQueryDao$HSQLDialect
Dialect of the target DB, Default is HSQL. Override with the
target DB used.
{noformat}
Even with HSQL, saved_query table creation failure shouldnt stop lens server
from coming up.
Exception
{noformat}
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] ERROR
org.apache.lens.server.LensServer - Error while creating Lens server
java.lang.RuntimeException: Cannot initialize saved query service
at
org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:69)
~[classes/:na]
at
org.apache.hive.service.CompositeService.init(CompositeService.java:59)
~[hive-service-0.13.3-inm.jar:0.13.3-inm]
at org.apache.lens.server.LensServices.init(LensServices.java:235)
~[classes/:na]
at org.apache.lens.server.LensServer.startServices(LensServer.java:135)
~[classes/:na]
at org.apache.lens.server.LensServer.(LensServer.java:85)
~[classes/:na]
at
org.apache.lens.server.LensServer.createLensServer(LensServer.java:74)
~[classes/:na]
at org.apache.lens.server.LensServer.main(LensServer.java:191)
~[classes/:na]
Caused by: org.apache.lens.server.api.error.LensException: Error initializing
saved query dao
at
org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:72)
~[classes/:na]
at
org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:64)
~[classes/:na]
... 6 common frames omitted
Caused by: org.apache.lens.server.api.error.LensException: Cannot create saved
query table!
at
org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:85)
~[classes/:na]
at
org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:70)
~[classes/:na]
... 7 common frames omitted
Caused by: java.sql.SQLException: You have an error in your SQL syntax; check
the manual that corresponds to your MySQL server version for the right syntax
to use near 'GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
description var' at line 1 Query: CREATE TABLE if not exists saved_query (id
int GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
description varchar(255), query varchar(255), params_json varchar(255),
created_at timestamp, updated_at timestamp) Parameters: []
at
org.apache.commons.dbutils.AbstractQueryRunner.rethrow(AbstractQueryRunner.java:363)
~[commons-dbutils-1.5.jar:1.5]
at org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:490)
~[commons-dbutils-1.5.jar:1.5]
at org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:420)
~[commons-dbutils-1.5.jar:1.5]
at
org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:83)
~[classes/:na]
... 8 common frames omitted
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.LensServices - Stopping lens server
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.LensServices - Server restart is not enabled. Not
persisting the server state
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.hive.service.CompositeService - Error stopping query
java.lang.NullPointerException: null
at
org.apache.lens.server.query.QueryExecutionServiceImpl.stop(QueryExecutionServiceImpl.java:1129)
~[classes/:na]
at
org.apache.hive.service.CompositeService.stop(CompositeService.java:102)
[hive-service-0.13.3-inm.jar:0.13.3-inm]
at
org.apache.hive.service.CompositeService.stop(CompositeService.java:92)
[hive-service-0.13.3-inm.jar:0.13.3-inm]
at org.apache.lens.server.LensServices.stop(LensServices.java:402)
[classes/:na]
at org.apache.lens.server.LensServer.main(LensServer.java:201)
[classes/:na]
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.EventServiceImpl - Removed listener
org.apache.lens.server.metrics.MetricsServiceImpl$AsyncQueryStatusListener@3ddc6915
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.metrics.MetricsServiceImpl - Stopped metrics service
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
org.apache.lens.server.EventServiceImpl - Event service stopped
16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] ERROR
org.apache.lens.server.LensServer - Error stopping services
java.lang.NullPointerException: null
[jira] [Updated] (LENS-776) Lens Server not Starting if there is a failure in creating "saved query" table
[
https://issues.apache.org/jira/browse/LENS-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin updated LENS-776:
--
Assignee: Amruth S
> Lens Server not Starting if there is a failure in creating "saved query" table
> --
>
> Key: LENS-776
> URL: https://issues.apache.org/jira/browse/LENS-776
> Project: Apache Lens
> Issue Type: Bug
>Reporter: Arshad Matin
>Assignee: Amruth S
>
> This is coming with the default config
> {noformat}
>
>lens.server.savedquery.jdbc.dialectclass
>org.apache.lens.server.query.save.SavedQueryDao$HSQLDialect
>Dialect of the target DB, Default is HSQL. Override with the
> target DB used.
>
> {noformat}
> Even with HSQL, saved_query table creation failure shouldnt stop lens server
> from coming up.
> Exception
> {noformat}
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] ERROR
> org.apache.lens.server.LensServer - Error while creating Lens server
> java.lang.RuntimeException: Cannot initialize saved query service
> at
> org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:69)
> ~[classes/:na]
> at
> org.apache.hive.service.CompositeService.init(CompositeService.java:59)
> ~[hive-service-0.13.3-inm.jar:0.13.3-inm]
> at org.apache.lens.server.LensServices.init(LensServices.java:235)
> ~[classes/:na]
> at
> org.apache.lens.server.LensServer.startServices(LensServer.java:135)
> ~[classes/:na]
> at org.apache.lens.server.LensServer.(LensServer.java:85)
> ~[classes/:na]
> at
> org.apache.lens.server.LensServer.createLensServer(LensServer.java:74)
> ~[classes/:na]
> at org.apache.lens.server.LensServer.main(LensServer.java:191)
> ~[classes/:na]
> Caused by: org.apache.lens.server.api.error.LensException: Error initializing
> saved query dao
> at
> org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:72)
> ~[classes/:na]
> at
> org.apache.lens.server.query.save.SavedQueryServiceImpl.init(SavedQueryServiceImpl.java:64)
> ~[classes/:na]
> ... 6 common frames omitted
> Caused by: org.apache.lens.server.api.error.LensException: Cannot create
> saved query table!
> at
> org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:85)
> ~[classes/:na]
> at
> org.apache.lens.server.query.save.SavedQueryDao.(SavedQueryDao.java:70)
> ~[classes/:na]
> ... 7 common frames omitted
> Caused by: java.sql.SQLException: You have an error in your SQL syntax; check
> the manual that corresponds to your MySQL server version for the right syntax
> to use near 'GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
> description var' at line 1 Query: CREATE TABLE if not exists saved_query (id
> int GENERATED BY DEFAULT AS IDENTITY PRIMARY KEY, name varchar(255),
> description varchar(255), query varchar(255), params_json varchar(255),
> created_at timestamp, updated_at timestamp) Parameters: []
> at
> org.apache.commons.dbutils.AbstractQueryRunner.rethrow(AbstractQueryRunner.java:363)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:490)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.commons.dbutils.QueryRunner.update(QueryRunner.java:420)
> ~[commons-dbutils-1.5.jar:1.5]
> at
> org.apache.lens.server.query.save.SavedQueryDao.createSavedQueryTableIfNotExists(SavedQueryDao.java:83)
> ~[classes/:na]
> ... 8 common frames omitted
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.lens.server.LensServices - Stopping lens server
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.lens.server.LensServices - Server restart is not enabled. Not
> persisting the server state
> 16 Sep 2015 08:17:34 [0bd00660-d2d0-42a6-bdc6-e8b31e895da6] [main] INFO
> org.apache.hive.service.CompositeService - Error stopping query
> java.lang.NullPointerException: null
> at
> org.apache.lens.server.query.QueryExecutionServiceImpl.stop(QueryExecutionServiceImpl.java:1129)
> ~[classes/:na]
> at
> org.apache.hive.service.CompositeService.stop(CompositeService.java:102)
> [hive-service-0.13.3-inm.jar:0.13.3-inm]
> at
> org.apache.hive.service.CompositeService.stop(CompositeService.java:92)
> [hive-service-0.13.3-inm.jar:0.13.3
[jira] [Created] (LENS-776) Lens Server not Starting if there is a failure in creating "saved query" table
Arshad Matin created LENS-776: - Summary: Lens Server not Starting if there is a failure in creating "saved query" table Key: LENS-776 URL: https://issues.apache.org/jira/browse/LENS-776 Project: Apache Lens Issue Type: Bug Reporter: Arshad Matin -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-733) Add Helper Method for lens-regression
[ https://issues.apache.org/jira/browse/LENS-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin updated LENS-733: -- Attachment: rb37526.patch > Add Helper Method for lens-regression > - > > Key: LENS-733 > URL: https://issues.apache.org/jira/browse/LENS-733 > Project: Apache Lens > Issue Type: Sub-task > Components: regression > Reporter: Arshad Matin > Attachments: rb37526.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-733) Add Helper Method for lens-regression
[ https://issues.apache.org/jira/browse/LENS-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin updated LENS-733: -- Status: Patch Available (was: Open) > Add Helper Method for lens-regression > - > > Key: LENS-733 > URL: https://issues.apache.org/jira/browse/LENS-733 > Project: Apache Lens > Issue Type: Sub-task > Components: regression > Reporter: Arshad Matin > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 37526: LENS-733 : Add library for lens regression
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37526/ --- (Updated Sept. 14, 2015, 1:10 p.m.) Review request for lens. Summary (updated) - LENS-733 : Add library for lens regression Repository: lens Description (updated) --- LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression LENS-733 : Add Helper Method for lens-regression Diffs (updated) - lens-regression/pom.xml 48c5b0c8887f5210cccdc6dccb078f90a7398509 lens-regression/src/main/java/org/apache/lens/regression/core/constants/QueryInventory.java PRE-CREATION lens-regression/src/main/java/org/apache/lens/regression/core/helpers/LensServerHelper.java 8b41dbae3a31fcc86794b751c324609da1c3ac92 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/MetastoreHelper.java aff0e8ea48fc6cb5d6edb31428ab32ef53ab870d lens-regression/src/main/java/org/apache/lens/regression/core/helpers/QueryHelper.java 70cad28fbf0722c34b2fe8c041d0570e86bbabf6 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/ServiceManagerHelper.java b14b00bda417830a50b48c81e5f2cbe2735896b6 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/SessionHelper.java e7bc700c063e914d5c305d6f468f4d7f4ff9cbd4 lens-regression/src/main/java/org/apache/lens/regression/core/testHelper/BaseTestClass.java 2985af46374606bef388e876c28fbcaaa43adc22 lens-regression/src/main/java/org/apache/lens/regression/util/AssertUtil.java 62bd1608dbd1ffcbdc931a1f024b5d73a696bb25 lens-regression/src/main/java/org/apache/lens/regression/util/HadoopUtil.java PRE-CREATION lens-regression/src/main/java/org/apache/lens/regression/util/Util.java 0e531e02718ba553868c52d0c0c4ad25a4498e48 Diff: https://reviews.apache.org/r/37526/diff/ Testing --- [INFO] [INFO] Reactor Summary: [INFO] [INFO] Lens Checkstyle Rules .. SUCCESS [ 2.903 s] [INFO] Lens ... SUCCESS [ 3.844 s] [INFO] Lens API ... SUCCESS [ 29.872 s] [INFO] Lens API for server and extensions . SUCCESS [ 30.727 s] [INFO] Lens Cube .. SUCCESS [ 52.871 s] [INFO] Lens DB storage SUCCESS [ 12.098 s] [INFO] Lens Query Library . SUCCESS [ 16.444 s] [INFO] Lens Hive Driver ... SUCCESS [ 23.530 s] [INFO] Lens Driver for JDBC ... SUCCESS [ 25.832 s] [INFO] Lens Elastic Search Driver . SUCCESS [ 20.170 s] [INFO] Lens Server SUCCESS [01:14 min] [INFO] Lens client SUCCESS [ 27.819 s] [INFO] Lens CLI ... SUCCESS [ 26.542 s] [INFO] Lens Examples .. SUCCESS [ 21.779 s] [INFO] Lens Distribution .. SUCCESS [ 16.608 s] [INFO] Lens ML Lib SUCCESS [ 35.379 s] [INFO] Lens ML Ext Distribution ... SUCCESS [ 5.195 s] [INFO] Lens Regression SUCCESS [ 23.066 s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 07:29 min [INFO] Finished at: 2015-09-14T16:14:22+05:30 [INFO] Final Memory: 191M/1455M [INFO] Thanks, Arshad Matin
[jira] [Updated] (LENS-773) Wrong Cost Calculation in case of HIVE Dimension Query
[
https://issues.apache.org/jira/browse/LENS-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin updated LENS-773:
--
Description:
Query : cube select id,name from sample_dim2 where name != 'first'
This should be answerable from hive and hence its cost should be non-zero.
But getting the cost as zero.
{noformat}
580cf6df-35b3-4f73-9013-c304418a3904http://www.w3.org/2001/XMLSchema-instance";
xsi:type="queryCostTO">0.0LOW
{noformat}
was:
Query : cube select id,name from sample_dim2 where name != 'first'
This should be answerable from hive and hence its cost should be non-zero.
But getting the cost as zero.
{noformat}
580cf6df-35b3-4f73-9013-c304418a3904http://www.w3.org/2001/XMLSchema-instance";
xsi:type="queryCostTO">0.0LOW
{noformat]
> Wrong Cost Calculation in case of HIVE Dimension Query
> --
>
> Key: LENS-773
> URL: https://issues.apache.org/jira/browse/LENS-773
> Project: Apache Lens
> Issue Type: Bug
>Reporter: Arshad Matin
>
> Query : cube select id,name from sample_dim2 where name != 'first'
> This should be answerable from hive and hence its cost should be non-zero.
> But getting the cost as zero.
> {noformat}
> 580cf6df-35b3-4f73-9013-c304418a3904 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
> xsi:type="queryCostTO">0.0LOW
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (LENS-773) Wrong Cost Calculation in case of HIVE Dimension Query
Arshad Matin created LENS-773:
-
Summary: Wrong Cost Calculation in case of HIVE Dimension Query
Key: LENS-773
URL: https://issues.apache.org/jira/browse/LENS-773
Project: Apache Lens
Issue Type: Bug
Reporter: Arshad Matin
Query : cube select id,name from sample_dim2 where name != 'first'
This should be answerable from hive and hence its cost should be non-zero.
But getting the cost as zero.
{noformat}
580cf6df-35b3-4f73-9013-c304418a3904http://www.w3.org/2001/XMLSchema-instance";
xsi:type="queryCostTO">0.0LOW
{noformat]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (LENS-733) Add Helper Method for lens-regression
[ https://issues.apache.org/jira/browse/LENS-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin updated LENS-733: -- Summary: Add Helper Method for lens-regression (was: Add library for lens regression) > Add Helper Method for lens-regression > - > > Key: LENS-733 > URL: https://issues.apache.org/jira/browse/LENS-733 > Project: Apache Lens > Issue Type: Sub-task > Components: regression > Reporter: Arshad Matin > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 37526: LENS-733 : Add Helper Method for lens-regression
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37526/ --- (Updated Sept. 14, 2015, 12:15 p.m.) Review request for lens. Summary (updated) - LENS-733 : Add Helper Method for lens-regression Repository: lens Description --- LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression Diffs - lens-regression/pom.xml 48c5b0c8887f5210cccdc6dccb078f90a7398509 lens-regression/src/main/java/org/apache/lens/regression/core/constants/QueryInventory.java PRE-CREATION lens-regression/src/main/java/org/apache/lens/regression/core/helpers/LensServerHelper.java 8b41dbae3a31fcc86794b751c324609da1c3ac92 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/MetastoreHelper.java aff0e8ea48fc6cb5d6edb31428ab32ef53ab870d lens-regression/src/main/java/org/apache/lens/regression/core/helpers/QueryHelper.java 70cad28fbf0722c34b2fe8c041d0570e86bbabf6 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/ServiceManagerHelper.java b14b00bda417830a50b48c81e5f2cbe2735896b6 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/SessionHelper.java e7bc700c063e914d5c305d6f468f4d7f4ff9cbd4 lens-regression/src/main/java/org/apache/lens/regression/core/testHelper/BaseTestClass.java 2985af46374606bef388e876c28fbcaaa43adc22 lens-regression/src/main/java/org/apache/lens/regression/util/AssertUtil.java 62bd1608dbd1ffcbdc931a1f024b5d73a696bb25 lens-regression/src/main/java/org/apache/lens/regression/util/HadoopUtil.java PRE-CREATION lens-regression/src/main/java/org/apache/lens/regression/util/Util.java 0e531e02718ba553868c52d0c0c4ad25a4498e48 Diff: https://reviews.apache.org/r/37526/diff/ Testing --- [INFO] [INFO] Reactor Summary: [INFO] [INFO] Lens Checkstyle Rules .. SUCCESS [ 2.903 s] [INFO] Lens ... SUCCESS [ 3.844 s] [INFO] Lens API ... SUCCESS [ 29.872 s] [INFO] Lens API for server and extensions . SUCCESS [ 30.727 s] [INFO] Lens Cube .. SUCCESS [ 52.871 s] [INFO] Lens DB storage SUCCESS [ 12.098 s] [INFO] Lens Query Library . SUCCESS [ 16.444 s] [INFO] Lens Hive Driver ... SUCCESS [ 23.530 s] [INFO] Lens Driver for JDBC ... SUCCESS [ 25.832 s] [INFO] Lens Elastic Search Driver . SUCCESS [ 20.170 s] [INFO] Lens Server SUCCESS [01:14 min] [INFO] Lens client SUCCESS [ 27.819 s] [INFO] Lens CLI ... SUCCESS [ 26.542 s] [INFO] Lens Examples .. SUCCESS [ 21.779 s] [INFO] Lens Distribution .. SUCCESS [ 16.608 s] [INFO] Lens ML Lib SUCCESS [ 35.379 s] [INFO] Lens ML Ext Distribution ... SUCCESS [ 5.195 s] [INFO] Lens Regression SUCCESS [ 23.066 s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 07:29 min [INFO] Finished at: 2015-09-14T16:14:22+05:30 [INFO] Final Memory: 191M/1455M [INFO] Thanks, Arshad Matin
Re: Review Request 37526: LENS-733 : Add library for lens regression
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37526/ --- (Updated Sept. 14, 2015, 10:48 a.m.) Review request for lens. Repository: lens Description --- LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression Diffs - lens-regression/pom.xml 48c5b0c8887f5210cccdc6dccb078f90a7398509 lens-regression/src/main/java/org/apache/lens/regression/core/constants/QueryInventory.java PRE-CREATION lens-regression/src/main/java/org/apache/lens/regression/core/helpers/LensServerHelper.java 8b41dbae3a31fcc86794b751c324609da1c3ac92 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/MetastoreHelper.java aff0e8ea48fc6cb5d6edb31428ab32ef53ab870d lens-regression/src/main/java/org/apache/lens/regression/core/helpers/QueryHelper.java 70cad28fbf0722c34b2fe8c041d0570e86bbabf6 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/ServiceManagerHelper.java b14b00bda417830a50b48c81e5f2cbe2735896b6 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/SessionHelper.java e7bc700c063e914d5c305d6f468f4d7f4ff9cbd4 lens-regression/src/main/java/org/apache/lens/regression/core/testHelper/BaseTestClass.java 2985af46374606bef388e876c28fbcaaa43adc22 lens-regression/src/main/java/org/apache/lens/regression/util/AssertUtil.java 62bd1608dbd1ffcbdc931a1f024b5d73a696bb25 lens-regression/src/main/java/org/apache/lens/regression/util/HadoopUtil.java PRE-CREATION lens-regression/src/main/java/org/apache/lens/regression/util/Util.java 0e531e02718ba553868c52d0c0c4ad25a4498e48 Diff: https://reviews.apache.org/r/37526/diff/ Testing (updated) --- [INFO] [INFO] Reactor Summary: [INFO] [INFO] Lens Checkstyle Rules .. SUCCESS [ 2.903 s] [INFO] Lens ... SUCCESS [ 3.844 s] [INFO] Lens API ... SUCCESS [ 29.872 s] [INFO] Lens API for server and extensions . SUCCESS [ 30.727 s] [INFO] Lens Cube .. SUCCESS [ 52.871 s] [INFO] Lens DB storage SUCCESS [ 12.098 s] [INFO] Lens Query Library . SUCCESS [ 16.444 s] [INFO] Lens Hive Driver ... SUCCESS [ 23.530 s] [INFO] Lens Driver for JDBC ... SUCCESS [ 25.832 s] [INFO] Lens Elastic Search Driver . SUCCESS [ 20.170 s] [INFO] Lens Server SUCCESS [01:14 min] [INFO] Lens client SUCCESS [ 27.819 s] [INFO] Lens CLI ... SUCCESS [ 26.542 s] [INFO] Lens Examples .. SUCCESS [ 21.779 s] [INFO] Lens Distribution .. SUCCESS [ 16.608 s] [INFO] Lens ML Lib SUCCESS [ 35.379 s] [INFO] Lens ML Ext Distribution ... SUCCESS [ 5.195 s] [INFO] Lens Regression SUCCESS [ 23.066 s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 07:29 min [INFO] Finished at: 2015-09-14T16:14:22+05:30 [INFO] Final Memory: 191M/1455M [INFO] Thanks, Arshad Matin
Re: Review Request 37526: LENS-733 : Add library for lens regression
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37526/ --- (Updated Sept. 14, 2015, 10:47 a.m.) Review request for lens. Repository: lens Description (updated) --- LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression LENS-733 : Add library for lens regression Diffs (updated) - lens-regression/pom.xml 48c5b0c8887f5210cccdc6dccb078f90a7398509 lens-regression/src/main/java/org/apache/lens/regression/core/constants/QueryInventory.java PRE-CREATION lens-regression/src/main/java/org/apache/lens/regression/core/helpers/LensServerHelper.java 8b41dbae3a31fcc86794b751c324609da1c3ac92 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/MetastoreHelper.java aff0e8ea48fc6cb5d6edb31428ab32ef53ab870d lens-regression/src/main/java/org/apache/lens/regression/core/helpers/QueryHelper.java 70cad28fbf0722c34b2fe8c041d0570e86bbabf6 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/ServiceManagerHelper.java b14b00bda417830a50b48c81e5f2cbe2735896b6 lens-regression/src/main/java/org/apache/lens/regression/core/helpers/SessionHelper.java e7bc700c063e914d5c305d6f468f4d7f4ff9cbd4 lens-regression/src/main/java/org/apache/lens/regression/core/testHelper/BaseTestClass.java 2985af46374606bef388e876c28fbcaaa43adc22 lens-regression/src/main/java/org/apache/lens/regression/util/AssertUtil.java 62bd1608dbd1ffcbdc931a1f024b5d73a696bb25 lens-regression/src/main/java/org/apache/lens/regression/util/HadoopUtil.java PRE-CREATION lens-regression/src/main/java/org/apache/lens/regression/util/Util.java 0e531e02718ba553868c52d0c0c4ad25a4498e48 Diff: https://reviews.apache.org/r/37526/diff/ Testing --- Thanks, Arshad Matin
[jira] [Created] (LENS-767) Lens-cli should list results in order
Arshad Matin created LENS-767: - Summary: Lens-cli should list results in order Key: LENS-767 URL: https://issues.apache.org/jira/browse/LENS-767 Project: Apache Lens Issue Type: Improvement Reporter: Arshad Matin For example, "show dimension" is listing result in random order while "show dimtables" is listing in increasing order. It is easier to find something when results are in order. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (LENS-766) Alter on dim/dimtable needs lens server restart
Arshad Matin created LENS-766: - Summary: Alter on dim/dimtable needs lens server restart Key: LENS-766 URL: https://issues.apache.org/jira/browse/LENS-766 Project: Apache Lens Issue Type: Bug Reporter: Arshad Matin Faced this issue, when we altered dimtables and query in fields of altered table was failing. Had to restart lens server to solve this issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (LENS-765) null Error Message on Lens Server
Arshad Matin created LENS-765:
-
Summary: null Error Message on Lens Server
Key: LENS-765
URL: https://issues.apache.org/jira/browse/LENS-765
Project: Apache Lens
Issue Type: Bug
Reporter: Arshad Matin
Getting a lot of null error message
{noformat}
28 Aug 2015 09:03:26 [3ad5df03-1d69-4668-ab4b-8c4040038677] [estimate-3] WARN
org.apache.lens.server.rewrite.RewriteUtil - Driver :
org.apache.lens.driver.jdbc.JDBCDriver@3e6fd0b9 Skipped for the query
rewriting due to
org.apache.lens.server.api.error.LensException: null
at
org.apache.lens.cube.parse.CubeQueryContext.pickCandidateDimsToQuery(CubeQueryContext.java:807)
~[lens-cube-2.4.0-inm-SNAPSHOT.jar:2.4.0-inm-SNAPSHOT]
at
org.apache.lens.cube.parse.CubeQueryContext.toHQL(CubeQueryContext.java:854)
~[lens-cube-2.4.0-inm-SNAPSHOT.jar:2.4.0-inm-SNAPSHOT]
at
org.apache.lens.server.rewrite.RewriteUtil$DriverRewriterRunnable.run(RewriteUtil.java:325)
~[classes/:na]
at
org.apache.lens.server.query.QueryExecutionServiceImpl$RewriteEstimateRunnable.run(QueryExecutionServiceImpl.java:1345)
[classes/:na]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[na:1.8.0_40-internal]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[na:1.8.0_40-internal]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_40-internal]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_40-internal]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40-internal]
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (LENS-763) Update on DDL should Create DDL if it is not present
Arshad Matin created LENS-763: - Summary: Update on DDL should Create DDL if it is not present Key: LENS-763 URL: https://issues.apache.org/jira/browse/LENS-763 Project: Apache Lens Issue Type: Improvement Reporter: Arshad Matin Currently, Update on cube/fact/storage/dimension/dimensiontable fails if it is not created already. We should not fail it and instead create it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-762) Partition Created for querystats is not honouring "lens.server.statistics.warehouse.dir"
[ https://issues.apache.org/jira/browse/LENS-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin updated LENS-762: -- Summary: Partition Created for querystats is not honouring "lens.server.statistics.warehouse.dir" (was: While running query on querystatistics, it is always hitting default value of "lens.server.statistics.warehouse.dir") > Partition Created for querystats is not honouring > "lens.server.statistics.warehouse.dir" > > > Key: LENS-762 > URL: https://issues.apache.org/jira/browse/LENS-762 > Project: Apache Lens > Issue Type: Bug >Reporter: Arshad Matin > > Set "lens.server.statistics.warehouse.dir" to hdfs path > querystats logs were rolled up to the current location > but while running the queries, it was looking for default value of > "lens.server.statistics.warehouse.dir" > seems like the partition is always getting created with default value of > "lens.server.statistics.warehouse.dir" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-762) While running query on querystatistics, it is always hitting default value of "lens.server.statistics.warehouse.dir"
[ https://issues.apache.org/jira/browse/LENS-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin updated LENS-762: -- Description: Set "lens.server.statistics.warehouse.dir" to hdfs path querystats logs were rolled up to the current location but while running the queries, it was looking for default value of "lens.server.statistics.warehouse.dir" seems like the partition is always getting created with default value of "lens.server.statistics.warehouse.dir" > While running query on querystatistics, it is always hitting default value of > "lens.server.statistics.warehouse.dir" > > > Key: LENS-762 > URL: https://issues.apache.org/jira/browse/LENS-762 > Project: Apache Lens > Issue Type: Bug >Reporter: Arshad Matin > > Set "lens.server.statistics.warehouse.dir" to hdfs path > querystats logs were rolled up to the current location > but while running the queries, it was looking for default value of > "lens.server.statistics.warehouse.dir" > seems like the partition is always getting created with default value of > "lens.server.statistics.warehouse.dir" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (LENS-762) While running query on querystatistics, it is always hitting default value of "lens.server.statistics.warehouse.dir"
Arshad Matin created LENS-762: - Summary: While running query on querystatistics, it is always hitting default value of "lens.server.statistics.warehouse.dir" Key: LENS-762 URL: https://issues.apache.org/jira/browse/LENS-762 Project: Apache Lens Issue Type: Bug Reporter: Arshad Matin -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-666) Replace log4j.properties with logback.xml
[ https://issues.apache.org/jira/browse/LENS-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14718307#comment-14718307 ] Arshad Matin commented on LENS-666: --- Now it is creating log file for each query and these log files are not getting purged and piling up. As of now, we are manually deleting it, but need to add the retention for these files in logback.xml > Replace log4j.properties with logback.xml > - > > Key: LENS-666 > URL: https://issues.apache.org/jira/browse/LENS-666 > Project: Apache Lens > Issue Type: Sub-task > Components: build, operations >Reporter: Amareshwari Sriramadasu >Assignee: Amareshwari Sriramadasu > Labels: incompatible > Fix For: 2.3 > > Attachments: LENS-666.3.patch > > > This task is to convert existing log4j.properties to logback.xml files. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: [VOTE] Release of Apache Lens 2.3.0-beta
+1 On Thu, Aug 27, 2015 at 12:38 PM, Yash Sharma wrote: > +1 Binding. > > - Able to download and extract artifacts > - Verified README, NOTICE & LICENSE files > - Able to build from Source distribution and launch Lens > - Able to launch Lens Server/Client and launch sample queries from Source > and Binary Distribution > > Kind Regards > > On Wed, Aug 26, 2015 at 11:49 AM, Amareshwari Sriramdasu < > amareshw...@apache.org> wrote: > > > +1 (binding) > > > > - Signature looks good > > - Validated checksums > > - LICENSE and NOTICE look ok. Found one issue as put below. > > - Built from source. > > - Ran examples from binary distribution. > > > > > > LICENSE : > > > > The file > > ./apache-lens-2.3.0-beta/src/site/resources/images/apache-feather-tm.gif > - > > contains "Copyright (c) 1998 Hewlett-Packard Company", not sure from > where > > we copied the file from. We should remove the copyright, I'm not blocking > > the release for this, we should remove it in next release. > > > > Thanks > > Amareshwari > > > > On Tue, Aug 25, 2015 at 7:47 PM, Rajat Khandelwal > > wrote: > > > > > Hi everyone > > > > > > I propose the following RC to be released as official Apache Lens > > > 2.3.0-beta. > > > > > > Commit id: d3ba5a3845fdd1a90596f04ac979ab54bc1e65ad > > > < > > > > > > https://git-wip-us.apache.org/repos/asf?p=lens.git;a=commit;h=d3ba5a3845fdd1a90596f04ac979ab54bc1e65ad > > > > > > > Tag: apache-lens-2.3.0-beta > > > < > > > > > > https://git-wip-us.apache.org/repos/asf?p=lens.git;a=tag;h=refs/tags/apache-lens-2.3.0-beta > > > > > > > > > > Release archive available at > > > > https://dist.apache.org/repos/dist/dev/lens/apache-lens-2.3.0-beta-rc0/ > > > > > > KEYS available in the dist repo: > > > https://dist.apache.org/repos/dist/release/lens/KEYS > > > > > > > > > The release candidate consists of the following source distribution > > > archive: > > > apache-lens-2.3.0-beta-source-release.zip > > > < > > > > > > https://dist.apache.org/repos/dist/dev/lens/apache-lens-2.3.0-beta-rc0/apache-lens-2.3.0-beta-source-release.zip > > > > > > > > > > In addition, the following supplementary binary distributions are > > > provided for user convenience at the same location: > > > apache-lens-2.3.0-beta-bin.tar.gz > > > < > > > > > > https://dist.apache.org/repos/dist/dev/lens/apache-lens-2.3.0-beta-rc0/apache-lens-2.3.0-beta-bin.tar.gz > > > > > > > > > > The licensing has slight changes from previous release, two logback > > modules > > > have been included in the binary. The change has been mentioned in > > > bin-dist-files/LICENSE and > > > > > > https://cwiki.apache.org/confluence/display/LENS/Licensing+in+Apache+Lens > > > > > > Nexus staging URL: > > > https://repository.apache.org/content/repositories/orgapachelens-1006 > > > > > > > > > Release Notes available here: > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12332350&projectId=12315923 > > > > > > Vote will be open for at least 72 hours. > > > > > > [ ] +1 approve > > > [ ] 0 no opinion > > > [ ] -1 disapprove (and reason why) > > > > > > +1 from my side for the release. > > > > > > If you haven't done this before, here's a how to for release > > verification: > > > > > > http://incubator.apache.org/guides/releasemanagement.html#check-list > > > > > > > > > Regards > > > > > > -- _ The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
[jira] [Resolved] (LENS-725) Verify Lens 2.3 issues
[ https://issues.apache.org/jira/browse/LENS-725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin resolved LENS-725. --- Resolution: Fixed > Verify Lens 2.3 issues > -- > > Key: LENS-725 > URL: https://issues.apache.org/jira/browse/LENS-725 > Project: Apache Lens > Issue Type: Sub-task >Reporter: Rajat Khandelwal > Assignee: Arshad Matin > Fix For: 2.3 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Work started] (LENS-725) Verify Lens 2.3 issues
[ https://issues.apache.org/jira/browse/LENS-725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on LENS-725 started by Arshad Matin. - > Verify Lens 2.3 issues > -- > > Key: LENS-725 > URL: https://issues.apache.org/jira/browse/LENS-725 > Project: Apache Lens > Issue Type: Sub-task >Reporter: Rajat Khandelwal > Assignee: Arshad Matin > Fix For: 2.3 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-711) Allow chain ref columns to have multiple chain destinations
[ https://issues.apache.org/jira/browse/LENS-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-711. - > Allow chain ref columns to have multiple chain destinations > --- > > Key: LENS-711 > URL: https://issues.apache.org/jira/browse/LENS-711 > Project: Apache Lens > Issue Type: Improvement > Components: cube >Reporter: Amareshwari Sriramadasu >Assignee: Amareshwari Sriramadasu > Fix For: 2.3 > > Attachments: LENS-711.3.patch > > > Right now, we allow ReferenceDimAttribute to be a chain ref column which > specifies chain_name, and ref_col from the chain. This improvement proposed > is to allow different chain_name, ref_col pair to be accepted. > Usecase : > We have multiple time dimension tables : say HourDim, DayDim and MonthDim. > All of them have timestamp as field which can be mapped to a time field on > cube. So, there will be three different chains associated with this reference > attribute and optionally the referring column can be different as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-647) Query involving multi fact query with expression fails in some cases
[ https://issues.apache.org/jira/browse/LENS-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-647. - > Query involving multi fact query with expression fails in some cases > > > Key: LENS-647 > URL: https://issues.apache.org/jira/browse/LENS-647 > Project: Apache Lens > Issue Type: Bug > Components: cube >Affects Versions: 2.2 >Reporter: Amareshwari Sriramadasu >Assignee: Amareshwari Sriramadasu > Fix For: 2.3 > > Attachments: LENS-647.2.patch > > > We saw that when user query results in multi fact query and the expression > chosen is not evaluable in one of the facts, the query is failing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-687) LauchTime is intermittently set to 0 in response of getStatus API for a successful finished query
[ https://issues.apache.org/jira/browse/LENS-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-687. - > LauchTime is intermittently set to 0 in response of getStatus API for a > successful finished query > - > > Key: LENS-687 > URL: https://issues.apache.org/jira/browse/LENS-687 > Project: Apache Lens > Issue Type: Sub-task > Components: api >Reporter: Himanshu Gahlaut >Assignee: Himanshu Gahlaut > Fix For: 2.3 > > > getQueryContext method at line[1] converts finished lens query to > QueryContext object using toQueryContext method in FinishedLensQuery.class. > toQueryContext method at line[2] does not set launch time in QueryContext > object, due to which it defaults to 0. > If a test case calls getStatus API on a already purged successful query, it > gets a LensQuery object in which launch time is set to 0. > This results in intermittent test failures. If query is not purged to Db, > then test case gets proper launch time. If the query is already purged to Db, > then test case gets launch time as 0 and fails. > [1]: > https://github.com/apache/incubator-lens/blob/apache-lens-2.2.0-beta-incubating/lens-server/src/main/java/org/apache/lens/server/query/QueryExecutionServiceImpl.java#L1643 > [2]: > https://github.com/apache/incubator-lens/blob/apache-lens-2.2.0-beta-incubating/lens-server-api/src/main/java/org/apache/lens/server/api/query/FinishedLensQuery.java#L188 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-681) Add XML validation on server side and error propagation to client
[ https://issues.apache.org/jira/browse/LENS-681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-681. - > Add XML validation on server side and error propagation to client > - > > Key: LENS-681 > URL: https://issues.apache.org/jira/browse/LENS-681 > Project: Apache Lens > Issue Type: Sub-task >Affects Versions: 2.1 >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-681_04.patch, LENS-681_05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-251) Support to query streaming data sources
[ https://issues.apache.org/jira/browse/LENS-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-251. - > Support to query streaming data sources > --- > > Key: LENS-251 > URL: https://issues.apache.org/jira/browse/LENS-251 > Project: Apache Lens > Issue Type: New Feature > Components: cube >Reporter: Sharad Agarwal >Assignee: Sharad Agarwal > Labels: Hackathon-July > Fix For: 2.3 > > Attachments: lens-251.1.patch > > > For certain stores that allows streaming ingestion, to make the data > available immediately for querying, we need the notion of streaming update > period or some such. > Describing by example: > - lets say there are two drivers - D1 and D2. > - D1 queries storage S1 > - D2 queries storage S2 > S1 and S2 are part of the same Cube. > In S1 data is in hourly granularity loaded every hour, while S2 has data > being ingested continuously in streaming fashion and maintains last 5 hours > window of data. > Now based on the query time range we want to select the right driver. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-24) Add support for User Query Rewriter chain before Cube Rewrites
[ https://issues.apache.org/jira/browse/LENS-24?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-24. > Add support for User Query Rewriter chain before Cube Rewrites > - > > Key: LENS-24 > URL: https://issues.apache.org/jira/browse/LENS-24 > Project: Apache Lens > Issue Type: New Feature > Components: server >Affects Versions: 2.0 >Reporter: Suma Shivaprasad >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-24_06.patch > > > Need to add support for configurable Query rewriters to be plugged in before > Cube Rewrites are invoked. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-648) NPE in CandidateTableResolver
[
https://issues.apache.org/jira/browse/LENS-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-648.
-
> NPE in CandidateTableResolver
> -
>
> Key: LENS-648
> URL: https://issues.apache.org/jira/browse/LENS-648
> Project: Apache Lens
> Issue Type: Bug
> Components: cube
>Affects Versions: 2.2
>Reporter: Amareshwari Sriramadasu
>Assignee: Amareshwari Sriramadasu
> Fix For: 2.3
>
> Attachments: LENS-648.2.patch, LENS-648.patch
>
>
> Here is a NPE we saw :
> {noformat}
> 30 Jun 2015 09:53:46,287 [estimate-2] WARN
> org.apache.lens.driver.cube.RewriteUtil - Driver :
> org.apache.lens.driver.jdbc.JDBCDriver@5da9a418 Skipped for the query
> rewriting due to
> java.lang.NullPointerException
> at
> org.apache.lens.cube.parse.CandidateTableResolver.checkForSourceReachabilityForDenormCandidates(CandidateTableResolver.java:547)
> at
> org.apache.lens.cube.parse.CandidateTableResolver.rewriteContext(CandidateTableResolver.java:81)
> at
> org.apache.lens.cube.parse.CubeQueryRewriter.rewrite(CubeQueryRewriter.java:217)
> at
> org.apache.lens.cube.parse.CubeQueryRewriter.rewrite(CubeQueryRewriter.java:192)
> at
> org.apache.lens.cube.parse.CubeQueryRewriter.rewrite(CubeQueryRewriter.java:203)
> at
> org.apache.lens.driver.cube.RewriteUtil$DriverRewriterRunnable.run(RewriteUtil.java:320)
> at
> org.apache.lens.server.query.QueryExecutionServiceImpl$RewriteEstimateRunnable.run(QueryExecutionServiceImpl.java:1223)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (LENS-721) Test addLocalStorageToFact1 failing due to data created in tmp dir
[ https://issues.apache.org/jira/browse/LENS-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-721. - > Test addLocalStorageToFact1 failing due to data created in tmp dir > -- > > Key: LENS-721 > URL: https://issues.apache.org/jira/browse/LENS-721 > Project: Apache Lens > Issue Type: Bug > Components: test >Affects Versions: 2.2 >Reporter: Yash Sharma >Assignee: Rajat Khandelwal > Labels: newbie > Fix For: 2.3 > > Attachments: LENS-721.06.patch, LENS-721.06.patch > > > There are build issues if one of last build has failed un-exxpectedly and > they failed to delete the local data created by them. > For this case here (addLocalStorageToFact1) the local data is created at : > table_location="/tmp/examples/local" > All the tests should have their data in the target dir rather than tmp. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-651) result file size in the /resultset api response in case of persistent resultset
[
https://issues.apache.org/jira/browse/LENS-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-651.
-
> result file size in the /resultset api response in case of persistent
> resultset
> ---
>
> Key: LENS-651
> URL: https://issues.apache.org/jira/browse/LENS-651
> Project: Apache Lens
> Issue Type: Improvement
>Reporter: Deepak Barr
>Assignee: Deepak Barr
>Priority: Minor
> Labels: incompatible, newbie
> Fix For: 2.3
>
> Attachments: LENS-651.03.patch, LENS-651.04.patch
>
>
> In case of persistent resultset, /queryapi/queries/{queryHandle}/resultset
> response contains the resultset HDFS path and the number of rows in the
> resultset.
> We would also include the size of hdfs resultset file in the
> response. The information on the size of the file can be obtained from hadoop
> FileSystem APIs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (LENS-692) getJoinChains() on AbstractBaseTable should return from cached value
[ https://issues.apache.org/jira/browse/LENS-692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-692. - > getJoinChains() on AbstractBaseTable should return from cached value > > > Key: LENS-692 > URL: https://issues.apache.org/jira/browse/LENS-692 > Project: Apache Lens > Issue Type: Improvement > Components: cube >Reporter: Amareshwari Sriramadasu >Assignee: Amareshwari Sriramadasu >Priority: Minor > Fix For: 2.3 > > Attachments: LENS-692.patch > > > Right now AbstractBaseTable.getJoinChains() is always creating new chains and > returning, instead it should return the member variable as Getter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-682) XML marshalling errors not descriptive enough on CLI
[ https://issues.apache.org/jira/browse/LENS-682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-682. - > XML marshalling errors not descriptive enough on CLI > > > Key: LENS-682 > URL: https://issues.apache.org/jira/browse/LENS-682 > Project: Apache Lens > Issue Type: Bug >Affects Versions: 2.0 >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-682.incremental.patch, LENS-682_01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-684) Assertion on phase 1 rewritten query will fail intermittently
[
https://issues.apache.org/jira/browse/LENS-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-684.
-
> Assertion on phase 1 rewritten query will fail intermittently
> -
>
> Key: LENS-684
> URL: https://issues.apache.org/jira/browse/LENS-684
> Project: Apache Lens
> Issue Type: Sub-task
> Components: server, test
>Reporter: Himanshu Gahlaut
>Assignee: Rajat Khandelwal
> Fix For: 2.3
>
> Attachments: LENS-684.03.patch
>
>
> TestQueryService#testExecuteAsync:
> Below asserts will fail, if the query context is removed by QueryPurger
> thread before the test running test case could retrieve it from allQueries
> collection using queryService. Provided lens.server.max.finished.queries=0 in
> lens-site.xml
> {code}
> QueryContext ctx =
> queryService.getQueryContext(lensQuery.getQueryHandle());
> assertNotNull(ctx.getPhase1RewrittenQuery());
> assertEquals(ctx.getPhase1RewrittenQuery(), ctx.getUserQuery());
>
> {code}
> These were added in LENS-24 Commit:
> https://github.com/apache/incubator-lens/commit/689c9a99b112b21e9ecba9a8461cf9672b88ba2f
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (LENS-686) Repetitive add partition with same specs should fail after first time.
[ https://issues.apache.org/jira/browse/LENS-686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-686. - > Repetitive add partition with same specs should fail after first time. > --- > > Key: LENS-686 > URL: https://issues.apache.org/jira/browse/LENS-686 > Project: Apache Lens > Issue Type: Bug > Components: cube >Affects Versions: 2.0 >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-686_06.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-688) Assert on driverQuery fails intermittently
[ https://issues.apache.org/jira/browse/LENS-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-688. - > Assert on driverQuery fails intermittently > -- > > Key: LENS-688 > URL: https://issues.apache.org/jira/browse/LENS-688 > Project: Apache Lens > Issue Type: Sub-task > Components: test >Reporter: Himanshu Gahlaut >Assignee: Himanshu Gahlaut > Fix For: 2.3 > > > TestLensQueryCommands#testExecuteAsyncQuery > This test case submits a query for asynchronous execution at line[1]. After > that it asserts for the presence of driverQuery at line[2]. This assert will > pass when submitted query is re-written and moved to launched state by > background query submitter thread. However if the assert is executed before > the query the has been processed by query submitter thread then this assert > will fail. > [1] > https://github.com/apache/incubator-lens/blob/apache-lens-2.2.0-beta-incubating/lens-cli/src/test/java/org/apache/lens/cli/TestLensQueryCommands.java#L227 > [2] > https://github.com/apache/incubator-lens/blob/apache-lens-2.2.0-beta-incubating/lens-cli/src/test/java/org/apache/lens/cli/TestLensQueryCommands.java#L238 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-619) Applying Query Launching Constraints before allowing a query to be launched
[ https://issues.apache.org/jira/browse/LENS-619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-619. - > Applying Query Launching Constraints before allowing a query to be launched > --- > > Key: LENS-619 > URL: https://issues.apache.org/jira/browse/LENS-619 > Project: Apache Lens > Issue Type: New Feature > Components: api, docs, driver-hive, driver-jdbc, server >Reporter: Himanshu Gahlaut >Assignee: Himanshu Gahlaut > Fix For: 2.3 > > Attachments: LENS-619.01.patch > > > Lens will always accept a new query from a user and put it in a scheduling > queue for processing. > Next candidate query picked up from scheduling queue for processing will be > launched only if all query constraints evaluated on candidate query and > launched queries allows the candidate query to be launched, otherwise the > candidate query will be added to waiting queries. > When any launched query is finished, a waiting query selector will select > waiting queries for rescheduling using a list of waiting queries selection > policy. Every waiting query selection policy will return a list of eligible > waiting queries to be rescheduled. Query Selector will calculate intersection > of multiple list of eligible waiting queries and add the result of > intersection to scheduling queue for reprocessing. > At initialization, Query Constraints and Waiting Query Selection Policies > will be configured using configuration values. > New Query Constraints and Waiting Query Selection Policies can be added at > runtime, without rebuilding and deploying lens module. Drivers should be > allowed to add more Query Constraints and Waiting Queries Selection policies. > Waiting Queries will be persisted across server restarts. > Query Constraint 1: Allow a candidate query to be launched, only if, > cumulative query cost of all current queries launched by the user, who > submitted candidate query, is less than a cumulative query cost ceiling for > launching a new query. > Waiting Query Selection Policy 1: Select all waiting queries of the user > whose query has finished. > Query Constraint 2: Allow a candidate query to be launched, only if, current > concurrent queries launched on the selected driver are less than max > concurrent queries allowed on the driver. > Waiting Query Selection Policy 2: Select all waiting queries of the driver > whose query has finished. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-426) Review logging in estimate path
[ https://issues.apache.org/jira/browse/LENS-426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-426. - > Review logging in estimate path > --- > > Key: LENS-426 > URL: https://issues.apache.org/jira/browse/LENS-426 > Project: Apache Lens > Issue Type: Improvement > Components: cube, server >Reporter: Jaideep Dhok >Assignee: Amareshwari Sriramadasu > Fix For: 2.3 > > Attachments: LENS-426.patch > > > # Review logs which might be doing expensive toString computations > # Review logs inside big loops > # Check log levels > # Use parameterised logging wherever possible -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-260) All tests should use project workspace for test data and clean up all the test data even in case of failures
[ https://issues.apache.org/jira/browse/LENS-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-260. - > All tests should use project workspace for test data and clean up all the > test data even in case of failures > -- > > Key: LENS-260 > URL: https://issues.apache.org/jira/browse/LENS-260 > Project: Apache Lens > Issue Type: Improvement > Components: test >Reporter: Raju Bairishetti >Assignee: Rajat Khandelwal > Labels: newbie > Fix For: 2.3 > > > Right now, some of the tests are using "/tmp" location for test data. It > would be better if it uses project workspace for test data. > We should make sure cleanup the test data incase of test failures. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-726) Update 2.3 release documentation
[ https://issues.apache.org/jira/browse/LENS-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin updated LENS-726: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Update 2.3 release documentation > - > > Key: LENS-726 > URL: https://issues.apache.org/jira/browse/LENS-726 > Project: Apache Lens > Issue Type: Sub-task >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-726.2015-08-25_12:56:34.patch, > LENS-726.2015-08-25_15:46:21.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-726) Update 2.3 release documentation
[ https://issues.apache.org/jira/browse/LENS-726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711059#comment-14711059 ] Arshad Matin commented on LENS-726: --- Thanks [~prongs] > Update 2.3 release documentation > - > > Key: LENS-726 > URL: https://issues.apache.org/jira/browse/LENS-726 > Project: Apache Lens > Issue Type: Sub-task >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-726.2015-08-25_12:56:34.patch, > LENS-726.2015-08-25_15:46:21.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-717) Incorrect data type assigned for LensResultSetMetaData for elastic search driver
[ https://issues.apache.org/jira/browse/LENS-717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711038#comment-14711038 ] Arshad Matin commented on LENS-717: --- [~amrk7] Can you please do validation from your side as we dont have required setup. > Incorrect data type assigned for LensResultSetMetaData for elastic search > driver > > > Key: LENS-717 > URL: https://issues.apache.org/jira/browse/LENS-717 > Project: Apache Lens > Issue Type: Bug >Reporter: Amruth S >Assignee: Amruth S > Fix For: 2.3 > > Attachments: LENS-717.patch, m_c_i_717 > > > The data type is always defaulting to string currently. Have to add a > resolver which identifies the proper data set from the result set. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-714) Replace dimension tables with subquery in Columnar Rewriter
[ https://issues.apache.org/jira/browse/LENS-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-714. - > Replace dimension tables with subquery in Columnar Rewriter > --- > > Key: LENS-714 > URL: https://issues.apache.org/jira/browse/LENS-714 > Project: Apache Lens > Issue Type: Improvement > Components: driver-jdbc >Reporter: Sushil Mohanty >Assignee: Sushil Mohanty > Fix For: 2.3 > > Attachments: LENS-714-2.patch > > > In order to optimise the JDBC sql queries, we can skip directly joining with > the dimension tables. Instead we can create a subquery with only required > column for a table used in the query. For eg. If column id and name are > queried from table dim1 the query can be rewritten as > ... inner join (select id,name from dim1) as d1 instead of ...inner join dim1 > as d1. > For dimension tables with descent size this helps in improving performance to > a great extent. Planning to add this in ColumnarRewriter so that columnar DBs > can leverage this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-706) Intermittent failure in QueryAPIErrorResponseTest
[ https://issues.apache.org/jira/browse/LENS-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-706. - > Intermittent failure in QueryAPIErrorResponseTest > - > > Key: LENS-706 > URL: https://issues.apache.org/jira/browse/LENS-706 > Project: Apache Lens > Issue Type: Bug >Reporter: Rajat Khandelwal >Assignee: Himanshu Gahlaut > Fix For: 2.3 > > > https://builds.apache.org/job/Lens-Commit/851/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-726) Update 2.3 release documentation
[ https://issues.apache.org/jira/browse/LENS-726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711029#comment-14711029 ] Arshad Matin commented on LENS-726: --- Alter table command should be like this Alter table finished_queries ADD filesize bigint AFTER rows; > Update 2.3 release documentation > - > > Key: LENS-726 > URL: https://issues.apache.org/jira/browse/LENS-726 > Project: Apache Lens > Issue Type: Sub-task >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-726.2015-08-25_12:56:34.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-632) Proper alias name in sql rewriter
[ https://issues.apache.org/jira/browse/LENS-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-632. - > Proper alias name in sql rewriter > - > > Key: LENS-632 > URL: https://issues.apache.org/jira/browse/LENS-632 > Project: Apache Lens > Issue Type: Bug >Reporter: Sushil Mohanty >Assignee: Sushil Mohanty > Fix For: 2.3 > > Attachments: LENS-632-1.patch > > > Currently sql rewriter derive alias name form the expressions in fact > subquery. For complex case statements the alias name becoming lengthy with > special character and sometimes unreadable. In this ticket will put changes > to give proper alias name like alias1, alias2, which will be passed to the > outer query. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-645) Server state persistence error when any query fails with conflicting fields exception
[
https://issues.apache.org/jira/browse/LENS-645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-645.
-
> Server state persistence error when any query fails with conflicting fields
> exception
> -
>
> Key: LENS-645
> URL: https://issues.apache.org/jira/browse/LENS-645
> Project: Apache Lens
> Issue Type: Bug
>Affects Versions: 2.2
>Reporter: Raghavendra Singh
>Assignee: Himanshu Gahlaut
> Fix For: 2.3
>
> Attachments: LENS-645.01.patch
>
>
> {CODE}
> 03 Jul 2015 05:48:54,249 [3b460424-01cf-4885-a074-d3304da88597]
> [lens-server-snapshotter] INFO org.apache.lens.driver.hive.HiveDriver -
> HiveDriver persisted 48 queries
> 03 Jul 2015 05:48:54,249 [3b460424-01cf-4885-a074-d3304da88597]
> [lens-server-snapshotter] INFO org.apache.lens.driver.hive.HiveDriver -
> HiveDriver persisted 2 sessions
> 03 Jul 2015 05:48:54,259 [3b460424-01cf-4885-a074-d3304da88597]
> [lens-server-snapshotter] WARN org.apache.lens.server.LensServices - Unable
> to persist lens server state
> java.io.NotSerializableException: org.apache.lens.cube.error.ConflictingFields
> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
> at
> java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
> at
> java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
> at
> java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
> at
> java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
> at
> java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
> at
> java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
> at
> java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
> at
> java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
> at
> java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
> at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
> at
> org.apache.lens.server.query.QueryExecutionServiceImpl.writeExternal(QueryExecutionServiceImpl.java:2267)
> at
> org.apache.lens.server.LensServices.persistLensServiceState(LensServices.java:343)
> at org.apache.lens.server.LensServices.access$100(LensServices.java:61)
> at org.apache.lens.server.LensServices$1.run(LensServices.java:284)
> at java.util.TimerThread.mainLoop(Timer.java:555)
> at java.util.TimerThread.run(Timer.java:505)
> {CODE}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (LENS-574) NPE in TestLensDAO
[
https://issues.apache.org/jira/browse/LENS-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-574.
-
> NPE in TestLensDAO
> --
>
> Key: LENS-574
> URL: https://issues.apache.org/jira/browse/LENS-574
> Project: Apache Lens
> Issue Type: Bug
>Affects Versions: 2.1
>Reporter: Sushil Mohanty
>Assignee: Yash Sharma
> Fix For: 2.3
>
> Attachments: LENS-574.01.patch
>
>
> org.apache.lens.server.query.TestLensDAO.testLensServerDAO (from TestSuite)
> {CODE}
> org.apache.lens.server.api.error.LensException: null
> at org.hsqldb.jdbc.Util.notSupported(Unknown Source)
> at org.hsqldb.jdbc.JDBCResultSet.checkNotForwardOnly(Unknown Source)
> at org.hsqldb.jdbc.JDBCResultSet.beforeFirst(Unknown Source)
> at
> org.apache.commons.dbcp.DelegatingResultSet.beforeFirst(DelegatingResultSet.java:358)
> at
> org.apache.commons.dbcp.DelegatingResultSet.beforeFirst(DelegatingResultSet.java:358)
> at
> org.apache.lens.driver.jdbc.JDBCResultSet.seekToStart(JDBCResultSet.java:302)
> at
> org.apache.lens.driver.jdbc.JDBCResultSet.(JDBCResultSet.java:83)
> at
> org.apache.lens.server.query.TestLensDAO.testLensServerDAO(TestLensDAO.java:82)
> {CODE}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (LENS-676) pass cli's extra arguments to Bootstrap
[ https://issues.apache.org/jira/browse/LENS-676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-676. - > pass cli's extra arguments to Bootstrap > --- > > Key: LENS-676 > URL: https://issues.apache.org/jira/browse/LENS-676 > Project: Apache Lens > Issue Type: Improvement > Components: client >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-676_2015-07-20_19:41:31.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-655) Explain Lens Examples
[ https://issues.apache.org/jira/browse/LENS-655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-655. - > Explain Lens Examples > -- > > Key: LENS-655 > URL: https://issues.apache.org/jira/browse/LENS-655 > Project: Apache Lens > Issue Type: Improvement >Reporter: Rajat Khandelwal > Labels: Hackathon-July > Fix For: 2.3 > > > http://lens.incubator.apache.org/user/olap-cube.html is pretty old and needs > to be updated. > A ramp up is required with lens examples where user doesn't have to look at > code. A crisp definition for all the metastore entities is needed and > demonstrated through CLI. > The motivation behind this is to make lens more adaptable for users without > needing help from developers. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-729) Add apache license header in es driver's json files
[ https://issues.apache.org/jira/browse/LENS-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-729. - > Add apache license header in es driver's json files > --- > > Key: LENS-729 > URL: https://issues.apache.org/jira/browse/LENS-729 > Project: Apache Lens > Issue Type: Task >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-729.patch, LENS-729.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-712) Seeing Exception while initializing PathScanner
[
https://issues.apache.org/jira/browse/LENS-712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-712.
-
> Seeing Exception while initializing PathScanner
> ---
>
> Key: LENS-712
> URL: https://issues.apache.org/jira/browse/LENS-712
> Project: Apache Lens
> Issue Type: Bug
> Components: server
>Affects Versions: 2.2
>Reporter: Amareshwari Sriramadasu
>Assignee: Yash Sharma
> Fix For: 2.3
>
> Attachments: LENS-712.08.patch
>
>
> Seeing the following in logs:
> {noformat}
> 04 Aug 2015 05:34:22 [a96fcceb-88ce-46f4-9cb3-b43cf2a46db2]
> [Grizzly-worker(4)] ERROR org.apache.lens.server.util.ScannedPaths -
> Exception while initializing PathScanner.
> java.lang.NullPointerException: null
> at
> org.apache.lens.server.util.ScannedPaths.getMatchedPaths(ScannedPaths.java:138)
> [classes/:na]
> at
> org.apache.lens.server.util.ScannedPaths.getFinalPaths(ScannedPaths.java:48)
> [classes/:na]
> at org.apache.lens.server.util.ScannedPaths.iterator(ScannedPaths.java:60)
> [classes/:na]
> at
> org.apache.lens.server.session.SessionResource.addResource(SessionResource.java:146)
> [classes/:na]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[na:1.7.0_17]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ~[na:1.7.0_17]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[na:1.7.0_17]
> at java.lang.reflect.Method.invoke(Method.java:601) ~[na:1.7.0_17]
> at
> org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
> [jersey-server-2.3.1.jar:na]
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
> [jersey-server-2.3.1.jar:na]
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
> [jersey-server-2.3.1.jar:na]
> at
> org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
> [jersey-server-2.3.1.jar:na]
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
> [jersey-server-2.3.1.jar:na]
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:353)
> [jersey-server-2.3.1.jar:na]
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:343)
> [jersey-server-2.3.1.jar:na]
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)
> [jersey-server-2.3.1.jar:na]
> at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
> [jersey-server-2.3.1.jar:na]
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
> [jersey-common-2.3.1.jar:na]
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
> [jersey-common-2.3.1.jar:na]
> at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
> [jersey-common-2.3.1.jar:na]
> at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
> [jersey-common-2.3.1.jar:na]
> at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
> [jersey-common-2.3.1.jar:na]
> at
> org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:318)
> [jersey-common-2.3.1.jar:na]
> at
> org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
> [jersey-server-2.3.1.jar:na]
> at
> org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:983)
> [jersey-server-2.3.1.jar:na]
> at
> org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:330)
> [jersey-container-grizzly2-http-2.3.1.jar:na]
> at
> org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:212)
> [grizzly-http-server-2.3.6.jar:2.3.6]
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:565)
> [grizzly-framework-2.3.6.jar:2.3.6]
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:545)
> [grizzly-framework-2.3.6.jar:2.3.6]
> at java.lang.Thread.run(Thread.java:722) [na:1.7.0_17]
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (LENS-720) DB resources should also be able to handle regex paths
[ https://issues.apache.org/jira/browse/LENS-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-720. - > DB resources should also be able to handle regex paths > -- > > Key: LENS-720 > URL: https://issues.apache.org/jira/browse/LENS-720 > Project: Apache Lens > Issue Type: Improvement > Components: server >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.3 > > Attachments: LENS-720.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (LENS-708) Improve "how to commit" doc.
[ https://issues.apache.org/jira/browse/LENS-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arshad Matin closed LENS-708. - > Improve "how to commit" doc. > > > Key: LENS-708 > URL: https://issues.apache.org/jira/browse/LENS-708 > Project: Apache Lens > Issue Type: Improvement > Components: docs >Reporter: Amareshwari Sriramadasu >Assignee: Yash Sharma >Priority: Minor > Fix For: 2.3 > > Attachments: LENS-708.04.patch > > > We can do the following improvements in how to commit doc. > - Remove "contributor via committer" in commit message, and make passing > --author as mandatory with actual contributor. > - Update new committers section to do first commit wrt adding his name in > pom.xml > - Update doc wrt reverting a commit. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
