[jira] [Commented] (SPARK-31817) Pass-through of Kerberos credentials from Spark SQL to a jdbc source
[ https://issues.apache.org/jira/browse/SPARK-31817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126622#comment-17126622 ] Luis Lozano Coira commented on SPARK-31817: --- I am not aware of the implementation details of this Microsoft gateway. Maybe this documentation will help: https://docs.microsoft.com/en-us/power-bi/connect-data/service-gateway-sso-overview https://docs.microsoft.com/en-us/power-bi/connect-data/service-gateway-sso-kerberos > Pass-through of Kerberos credentials from Spark SQL to a jdbc source > > > Key: SPARK-31817 > URL: https://issues.apache.org/jira/browse/SPARK-31817 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 2.4.5 >Reporter: Luis Lozano Coira >Priority: Major > > I am connecting to Spark SQL through the Thrift JDBC/ODBC server using > kerberos. From Spark SQL I have connected to a JDBC source using basic > authentication but I am interested in doing a pass-through of kerberos > credentials to this JDBC source. > Would it be possible to do something like that? If not possible, could you > consider adding this functionality? > Anyway I would like to start testing this pass-through and try to develop an > approach by myself. How could this functionality be added? Could you give me > any indication to start this development? -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31817) Pass-through of Kerberos credentials from Spark SQL to a jdbc source
[ https://issues.apache.org/jira/browse/SPARK-31817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126083#comment-17126083 ] Gabor Somogyi commented on SPARK-31817: --- >From architectural point of view I know what's going on but to implement it we >need the details. What exactly passed through and how? That's my question. I think it worth to investigate how on-prem connection made up and we can get back to this... > Pass-through of Kerberos credentials from Spark SQL to a jdbc source > > > Key: SPARK-31817 > URL: https://issues.apache.org/jira/browse/SPARK-31817 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 2.4.5 >Reporter: Luis Lozano Coira >Priority: Major > > I am connecting to Spark SQL through the Thrift JDBC/ODBC server using > kerberos. From Spark SQL I have connected to a JDBC source using basic > authentication but I am interested in doing a pass-through of kerberos > credentials to this JDBC source. > Would it be possible to do something like that? If not possible, could you > consider adding this functionality? > Anyway I would like to start testing this pass-through and try to develop an > approach by myself. How could this functionality be added? Could you give me > any indication to start this development? -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31817) Pass-through of Kerberos credentials from Spark SQL to a jdbc source
[ https://issues.apache.org/jira/browse/SPARK-31817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126053#comment-17126053 ] Luis Lozano Coira commented on SPARK-31817: --- Power BI Cloud is part of the Microsoft Azure cloud infrastructure and is integrated with Azure Active Directory. It can also connect to on-premise sources trough the Microsoft Power BI Gateway that runs in the Windows domain. > Pass-through of Kerberos credentials from Spark SQL to a jdbc source > > > Key: SPARK-31817 > URL: https://issues.apache.org/jira/browse/SPARK-31817 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 2.4.5 >Reporter: Luis Lozano Coira >Priority: Major > > I am connecting to Spark SQL through the Thrift JDBC/ODBC server using > kerberos. From Spark SQL I have connected to a JDBC source using basic > authentication but I am interested in doing a pass-through of kerberos > credentials to this JDBC source. > Would it be possible to do something like that? If not possible, could you > consider adding this functionality? > Anyway I would like to start testing this pass-through and try to develop an > approach by myself. How could this functionality be added? Could you give me > any indication to start this development? -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31817) Pass-through of Kerberos credentials from Spark SQL to a jdbc source
[ https://issues.apache.org/jira/browse/SPARK-31817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125875#comment-17125875 ] Gabor Somogyi commented on SPARK-31817: --- Aaaand where does this Power BI stores authentication information now? :) This is a must to know to pass it through (if it's possible). > Pass-through of Kerberos credentials from Spark SQL to a jdbc source > > > Key: SPARK-31817 > URL: https://issues.apache.org/jira/browse/SPARK-31817 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 2.4.5 >Reporter: Luis Lozano Coira >Priority: Major > > I am connecting to Spark SQL through the Thrift JDBC/ODBC server using > kerberos. From Spark SQL I have connected to a JDBC source using basic > authentication but I am interested in doing a pass-through of kerberos > credentials to this JDBC source. > Would it be possible to do something like that? If not possible, could you > consider adding this functionality? > Anyway I would like to start testing this pass-through and try to develop an > approach by myself. How could this functionality be added? Could you give me > any indication to start this development? -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31817) Pass-through of Kerberos credentials from Spark SQL to a jdbc source
[ https://issues.apache.org/jira/browse/SPARK-31817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120890#comment-17120890 ] Luis Lozano Coira commented on SPARK-31817: --- For example, this would allow to pass-through Kerberos SSO from Power BI cloud to jdbc sources using Spark as the query engine. > Pass-through of Kerberos credentials from Spark SQL to a jdbc source > > > Key: SPARK-31817 > URL: https://issues.apache.org/jira/browse/SPARK-31817 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 2.4.5 >Reporter: Luis Lozano Coira >Priority: Major > > I am connecting to Spark SQL through the Thrift JDBC/ODBC server using > kerberos. From Spark SQL I have connected to a JDBC source using basic > authentication but I am interested in doing a pass-through of kerberos > credentials to this JDBC source. > Would it be possible to do something like that? If not possible, could you > consider adding this functionality? > Anyway I would like to start testing this pass-through and try to develop an > approach by myself. How could this functionality be added? Could you give me > any indication to start this development? -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31817) Pass-through of Kerberos credentials from Spark SQL to a jdbc source
[ https://issues.apache.org/jira/browse/SPARK-31817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119609#comment-17119609 ] Gabor Somogyi commented on SPARK-31817: --- Thanks [~hyukjin.kwon] pinging me! Interesting topic and happy to take a look at the approach. Now I'm going to have a week off but probably this won't be so super fast :) >From my perspective it would be good to have some sort of document which >describes the use-case(s) what we would like to solve. It would be easyer to >speak the same language. When we have that we'll see hopefully obviously >whether it's possible or not. As an initial thought. A JDBC source needs deployed keytab files on all nodes to do authentication (databases don't support delegation tokens) and I personally don't see any other option at the moment. > Pass-through of Kerberos credentials from Spark SQL to a jdbc source > > > Key: SPARK-31817 > URL: https://issues.apache.org/jira/browse/SPARK-31817 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 2.4.5 >Reporter: Luis Lozano Coira >Priority: Major > > I am connecting to Spark SQL through the Thrift JDBC/ODBC server using > kerberos. From Spark SQL I have connected to a JDBC source using basic > authentication but I am interested in doing a pass-through of kerberos > credentials to this JDBC source. > Would it be possible to do something like that? If not possible, could you > consider adding this functionality? > Anyway I would like to start testing this pass-through and try to develop an > approach by myself. How could this functionality be added? Could you give me > any indication to start this development? -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31817) Pass-through of Kerberos credentials from Spark SQL to a jdbc source
[ https://issues.apache.org/jira/browse/SPARK-31817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119548#comment-17119548 ] Hyukjin Kwon commented on SPARK-31817: -- cc [~gsomogyi] FYI > Pass-through of Kerberos credentials from Spark SQL to a jdbc source > > > Key: SPARK-31817 > URL: https://issues.apache.org/jira/browse/SPARK-31817 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 2.4.5 >Reporter: Luis Lozano Coira >Priority: Major > > I am connecting to Spark SQL through the Thrift JDBC/ODBC server using > kerberos. From Spark SQL I have connected to a JDBC source using basic > authentication but I am interested in doing a pass-through of kerberos > credentials to this JDBC source. > Would it be possible to do something like that? If not possible, could you > consider adding this functionality? > Anyway I would like to start testing this pass-through and try to develop an > approach by myself. How could this functionality be added? Could you give me > any indication to start this development? -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org