[ https://issues.apache.org/jira/browse/SPARK-43892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Beishao Cao updated SPARK-43892: -------------------------------- Description: We don't have a keys method for pyspark dataframe, even though we support df['column name'] And when we want to get a suggestion for {{{}df[|]{}}}, we can't get anything. So this could be an improvement for autocomplete engine that uses {{keys()}} to generate autocomplete suggestions (e.g. IPython kernel, Databricks Notebooks) will suggest column names on the completion df[|] However, for those using IPython, they don't check keys, it only support pandas & numpy & dict type. So we need to add _ipython_key_completions_ to our object to make it work. was: We don't have a keys method for pyspark dataframe, even though we support df['column name'] And when we want to get a suggestion for {{{}df[|]{}}}, we can't get anything. So this could be an improvement for autocomplete engine that uses {{keys()}} to generate autocomplete suggestions (e.g. IPython kernel, Databricks Notebooks) will suggest column names on the completion df[|] > Add support for df[|] suggest column > ------------------------------------ > > Key: SPARK-43892 > URL: https://issues.apache.org/jira/browse/SPARK-43892 > Project: Spark > Issue Type: Improvement > Components: PySpark > Affects Versions: 3.5.0 > Reporter: Beishao Cao > Priority: Major > > We don't have a keys method for pyspark dataframe, even though we support > df['column name'] > And when we want to get a suggestion for {{{}df[|]{}}}, we can't get > anything. So this could be an improvement for autocomplete engine that uses > {{keys()}} to generate autocomplete suggestions (e.g. IPython kernel, > Databricks Notebooks) will suggest column names on the completion df[|] > However, for those using IPython, they don't check keys, it only support > pandas & numpy & dict type. So we need to add _ipython_key_completions_ to > our object to make it work. > -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org