I’m trying to iterate through a list of Columns and create new Columns based on a condition. However, the when method keeps giving me errors that don’t quite make sense.
If I do `when(col === “abc”, 1).otherwise(0)` I get the following error at compile time: [error] not found: value when However, this works in the REPL just fine after I import org.apache.spark.sql.Column. On the other hand, if I do `col.when(col === “abc”, 1).otherwise(0)`, it will compile successfully, but then at runtime, I get this error: java.lang.IllegalArgumentException: when() can only be applied on a Column previously generated by when() function This appears to be pretty circular logic. How can `when` only be applied to a Column previously generated by `when`? How would I call `when` in the first place?
