Fwd: Add row IDs column to data frame

[Josh Levy-Kramer]

Hi,

Iv created a simple example using the withColumn method but throws an
error. Try:

val df = List(
  (1,1),
  (1,1),
  (1,2),
  (2,2)
).toDF("col1", "col2")

val index_col = sqlContext.range( df.count() ).col("id")
val df_with_index = df.withColumn("index", index_col)

The error I get is:

org.apache.spark.sql.AnalysisException: resolved attribute(s) id#76L
missing from col1#69,col2#70 in operator !Project [col1#69,col2#70,id#76L
AS index#77L];

Is this the right to add an ID column or is this a bug?

Many thanks.
Josh