[ https://issues.apache.org/jira/browse/SPARK-38601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567705#comment-17567705 ]
Prakhar Sandhu commented on SPARK-38601: ---------------------------------------- Any idea how to make DateOffset work in pyspark.pandas > AttributeError: module 'pyspark.pandas' has no attribute 'DateOffset' > --------------------------------------------------------------------- > > Key: SPARK-38601 > URL: https://issues.apache.org/jira/browse/SPARK-38601 > Project: Spark > Issue Type: Bug > Components: PySpark > Affects Versions: 3.2.1 > Reporter: Prakhar Sandhu > Priority: Major > > I am working on replacing Pandas library to pyspark.pandas Library in my > python repo in VS Code. But pyspark.pandas module does not seem to have > DateOffset() module similar to what pandas has. > I tried this : > {code:java} > import pyspark.pandas as pd > clean_df[self._config.general["info_col"]] = (clean_df["cycle_dt"] - > pd.DateOffset(months=cycle_info_gap) > ).fillna(clean_df[self._config.general["time_col"]]) {code} > It results in the below error : > {code:java} > Un unanticipated error occurred: module 'pyspark.pandas' has no attribute > 'DateOffset'{code} > Is there any alternative for this in pyspark.pandas? -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org