Unsubscribe

2024-01-13 Thread Andrew Redd
Unsubscribe

Re: Troubleshooting ArrayIndexOutOfBoundsException in long running Spark application

2023-04-09 Thread Andrew Redd
remove On Wed, Apr 5, 2023 at 8:06 AM Mich Talebzadeh wrote: > OK Spark Structured Streaming. > > How are you getting messages into Spark? Is it Kafka? > > This to me index that the message is incomplete or having another value in > Json > > HTH > > Mich Talebzadeh, > Lead Solutions

Re: Recover RFormula Column Names

2019-10-29 Thread Andrew Redd
ng("idx") -> m.getString("name")) >> ).toMap > > } > > > It looks like there is some support now for achieving this, but I have > never tried it: > https://spark.apache.org/docs/latest/api/java/org/apache/spark/ml/r/RWrapperUtils.html > > Be

Fwd: Recover RFormula Column Names

2019-10-28 Thread Andrew Redd
Hi All! I'm performing an econometric analysis over several billion rows of data and would like to use the Pyspark SparkML implementation of linear regression. In the example below I'm trying to interact hour of day and month of year indicators. The StringIndexer documentation tells you what it's