Re: Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ruslan Dautkhanov
Your example works fine for me too. We're on Zeppelin snapshot ~2 months old. -- Ruslan Dautkhanov On Tue, Jul 11, 2017 at 3:11 PM, Ben Vogan wrote: > Here is the specific example that is failing: > > import pandas > z.show(pandas.DataFrame([u'Jalape\xf1os.'],[1],['Menu'])) > > On Tue, Jul

Re: Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ben Vogan
Here is the specific example that is failing: import pandas z.show(pandas.DataFrame([u'Jalape\xf1os.'],[1],['Menu'])) On Tue, Jul 11, 2017 at 2:32 PM, Ruslan Dautkhanov wrote: > Hi Ben, > > I can't reproduce this > > from pyspark.sql.types import * >> rdd = sc.parallelize([[u'El Niño']]) >> df

Re: Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ruslan Dautkhanov
Hi Ben, I can't reproduce this from pyspark.sql.types import * > rdd = sc.parallelize([[u'El Niño']]) > df = sqlc.createDataFrame( > rdd, schema=StructType([StructField("unicode data", > StringType(), True)]) > ) > df.show() > z.show(df) shows unicode character fine.

Re: Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ben Vogan
Hi Ruslan, I tried adding: export LC_ALL="en_US.utf8" To my zeppelin-env.sh script and restarted Zeppelin, but I still have the same problem. The print statement: python -c "print (u'\xf1')" works from the note. I think the problem is the use of the str function. Looking at the stack you ca

Re: Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ruslan Dautkhanov
> > $ env | grep LC > $ > $ python -c "print (u'\xf1')" > ñ > > $ export LC_ALL="C" > $ python -c "print (u'\xf1')" > Traceback (most recent call last): > File "", line 1, in > UnicodeEncodeError: 'ascii' codec can't encode character u'\xf1' in > position 0: ordinal not in range(128) > > $ e

Showing pandas dataframe with utf8 strings

2017-07-11 Thread Ben Vogan
Hi all, I am trying to use the zeppelin context to show the contents of a pandas DataFrame and getting the following error: Traceback (most recent call last): File "/tmp/zeppelin_python-7554503996532642522.py", line 278, in raise Exception(traceback.format_exc()) Exception: Traceback (most