How to make livy2.spark find jar
Hi,
I am trying to use oracle jdbc to read oracle database table. I have added
below property in custom zeppelin-env:
SPARK_SUBMIT_OPTIONS="--jars /my/path/to/ojdbc8.jar"
But
val df = spark.read.format("jdbc").option("url", "jdbc:oracle:thin:@
(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.9.44.99)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=
myservice.mydns.com)))").option("user","myuser").option("password","mypassword").option("driver",
"oracle.jdbc.driver.OracleDriver").option("dbtable",
"myuser.mytable").load()
throws:
java.lang.ClassNotFoundException: oracle.jdbc.driver.OracleDriver at
scala.reflect.internal.util.AbstractFileClassLoader.findClass(AbstractFileClassLoader.scala:62)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at
java.lang.ClassLoader.loadClass(ClassLoader.java:357) at
org.apache.spark.sql.execution.datasources.jdbc.DriverRegistry$.register(DriverRegistry.scala:45)
at
org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions$$anonfun$6.apply(JDBCOptions.scala:79)
at
org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions$$anonfun$6.apply(JDBCOptions.scala:79)
at scala.Option.foreach(Option.scala:257) at
org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.(JDBCOptions.scala:79)
at
org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.(JDBCOptions.scala:35)
at
org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation(JdbcRelationProvider.scala:34)
at
org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:340)
at
org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:239)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:227) at
org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:164)
How to make livy2.spark interpreter find ojdbc8.jar? Thanks.
Zeppelin auth with AD
Hello Community, I'm working to authniticate Zeppelin login with the AD and below is my shiro conf. My issue that the groupRolesMap is working me fine where zeppelin_admin group are able to login and restart and see the interpreter page and the member group not and that's fine. But any user in the other AD trees are able to login to zeppelin, i think i'm missing some conf in the urls or roles. Anyone who can help here? activeDirectoryRealm = org.apache.zeppelin.realm.ActiveDirectoryGroupRealm activeDirectoryRealm.systemUsername = zeppelin_bind activeDirectoryRealm.systemPassword = activeDirectoryRealm.searchBase = "OU=Zeppelin,DC=X,DC=com" activeDirectoryRealm.url = ldap://XXX.XX.com activeDirectoryRealm.groupRolesMap = "CN=zeppelin_admins,OU=Zeppelin,DC=XX,DC=com":"admin","CN=zeppelin_members,OU=Zeppelin,DC=XXX,DC=com":"member" activeDirectoryRealm.authorizationCachingEnabled = true activeDirectoryRealm.principalSuffix=@X.com securityManager.realms = $activeDirectoryRealm shiro.loginUrl = /api/login [roles] role1 = * role2 = * role3 = * admin = * [urls] /api/version = anon # Allow all authenticated users to restart interpreters on a notebook page. # Comment out the following line if you would like to authorize only admin users to restart interpreters. /api/interpreter/setting/restart/** = authc /api/interpreter/** = authc, roles[admin] /api/configurations/** = authc, roles[admin] /api/credential/** = authc, roles[admin] #/** = anon /** = authc -- Take Care Fawze Abujaber
Re: Impala queries through impala JDBC is running with empty user
Any help here is so much appreciated.
I’m over few days with no success.
On Sun, 21 Oct 2018 at 17:19 Fawze Abujaber wrote:
>
> Hi Community,
>
> I'm struggling getting Impala to work with Zeppelin, I'm trying to pass
> the user in the impala JDBC url.
>
> My issue that when i configure the impala JDBC url with AuthMech=0 which
> works without authentication i get it work and the query ran without user.
>
> When i'm changing to AuthMech=2, the query is hanging at the UI.
>
> Zeppelin version: 0.8.0
> Impala JDBC: 2.6.3
>
> My Url : jdbc:impala://node1.example.com:21050;AuthMech=2; UID=fawzea
>
> [image: Screen Shot 2018-10-21 at 5.17.19 PM.png]
>
>
> Log:
>
> ERROR [2018-10-21 10:16:20,388] ({pool-2-thread-2}
> JDBCInterpreter.java[open]:197) - zeppelin will be ignored. driver.zeppelin
> and zeppelin.url is mandatory.
>
> Any help is much appreciated.
>
> Take Care
> Fawze Abujaber
>
--
Take Care
Fawze Abujaber
