Looks good Moon
Is there a specific reason why you needed the pyspark interpreter to
access the spark interpreter? Could not the spark interpreter
programmatically access itself (and the same for the pyspark interpreter)
Would the issue be to expose the z.interpret() method?
Best regards
Carlos
On Tue, Mar 9, 2021 at 5:10 PM moon soo Lee <m...@apache.org> wrote:
> I see. If you want to specify a file, precode might not the best option.
> I found a hacky way to do it. Accessing SparkInterpreter instance object
> from PysparkInterpreter.
>
> %pyspark
> sparkIntpField = intp.getClass().getDeclaredField("sparkInterpreter")
> sparkIntpField.setAccessible(True)
> sparkIntp = sparkIntpField.get(intp)
> # run my scala code
> sparkIntp.interpret("val a=10", z.getInterpreterContext())
>
>
> See attached screenshot.
>
> [image: image.png]
>
> This is accessing internal variables outside the official API. So it may
> break at any time.
>
> I think it's better to expose interpret() method through
> 'ZeppelinContext'. So inside Note,
>
> z.interpret(any_string)
>
> can work without accessing this method in a hacky way.
> Please feel free to file an issue.
>
> Thanks,
> moon
>
>
>
>
> On Mon, Mar 8, 2021 at 10:23 PM Carlos Diogo <cdi...@gmail.com> wrote:
>
>> Are you able to specify a file on the precode?
>> For now my work around is from within the note and with the rest api , to
>> add a paragraph with the code I want to inject ( which can come from a file
>> )
>> It works ok , but with run all or schedule the code gets updated in the
>> note , but the old Code still executes . Only on the next run it will take
>> effect
>>
>> On Mon 8. Mar 2021 at 22:48, moon soo Lee <m...@apache.org> wrote:
>>
>>> Hi,
>>>
>>> How about precode
>>> <http://zeppelin.apache.org/docs/0.9.0/usage/interpreter/overview.html#precode>?
>>> "zeppelin.SparkInterpreter.precode"
>>> can run scala code.
>>>
>>> Thanks,
>>> moon
>>>
>>>
>>> On Sat, Mar 6, 2021 at 4:51 AM Carlos Diogo <cdi...@gmail.com> wrote:
>>>
>>>> That does not work if you want to have Scala code in a file ( common
>>>> functions) which you want to invoke in the note
>>>> The alternative is to compile the code and then add the jar which would
>>>> be normal for an application.
>>>> But zeppelin is about scripting so this is a request I get very often
>>>> from the users.
>>>> Specially because the z.run does not work properly most of the times
>>>> Carlos
>>>>
>>>> On Sat 6. Mar 2021 at 11:36, Jeff Zhang <zjf...@gmail.com> wrote:
>>>>
>>>>> Why not copying scala code in zeppelin and run the notebook directly ?
>>>>>
>>>>> Carlos Diogo <cdi...@gmail.com> 于2021年3月6日周六 下午3:51写道：
>>>>>
>>>>>> Dear all
>>>>>> I have been trying to find a was to inject scala Code ( from
>>>>>> String) into the spark interpreter
>>>>>> In pyspark is easy with the exec function
>>>>>> It should not be very difficult to access from the Note scala repl
>>>>>> interpreter but i could not find a way . I was even able to create a new
>>>>>> repl session but then I could not bind the objects
>>>>>> Any tips ?
>>>>>> Thanks
>>>>>> --
>>>>>> Os meus cumprimentos / Best regards / Mit freundlichen Grüße
>>>>>> Carlos Diogo
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Best Regards
>>>>>
>>>>> Jeff Zhang
>>>>>
>>>> --
>>>> Os meus cumprimentos / Best regards / Mit freundlichen Grüße
>>>> Carlos Diogo
>>>>
>>> --
>> Os meus cumprimentos / Best regards / Mit freundlichen Grüße
>> Carlos Diogo
>>
>
--
Os meus cumprimentos / Best regards / Mit freundlichen Grüße
Carlos Diogo
