srowen commented on a change in pull request #31880: URL: https://github.com/apache/spark/pull/31880#discussion_r597372248
########## File path: dev/change-scala-version.sh ########## @@ -60,14 +60,13 @@ BASEDIR=$(dirname $0)/.. find "$BASEDIR" -name 'pom.xml' -not -path '*target*' -print \ -exec bash -c "sed_i 's/\(artifactId.*\)_'$FROM_VERSION'/\1_'$TO_VERSION'/g' {}" \; -# dependency:get is workaround for SPARK-34762 to download the JAR file of commons-cli. -# Without this, build with Scala 2.13 using SBT will fail because the help plugin used below downloads only the POM file. -COMMONS_CLI_VERSION=`build/mvn help:evaluate -Dexpression=commons-cli.version -q -DforceStdout` -build/mvn dependency:get -Dartifact=commons-cli:commons-cli:${COMMONS_CLI_VERSION} -q - # Update <scala.version> in parent POM # First find the right full version from the profile's build -SCALA_VERSION=`build/mvn help:evaluate -Pscala-${TO_VERSION} -Dexpression=scala.version -q -DforceStdout` +# NOTE: We used mvn help:evaluate to fetch the value of scala.version before but sed is used now. +# This is a workaround for SPARK-34762. +ESCAPED_TO_VERSION=$(echo $TO_VERSION | sed -n "s/\./\\\\./gp") +SCALA_VERSION=$(sed -n "/<id>scala-$ESCAPED_TO_VERSION<\/id>/,/<\/profile>/ \ + s;^.*<scala\.version>\(.*\)</scala\.version>.*$;\1;p" pom.xml) Review comment: I still don't see why this part is necessary. Can we fix this without breaking other parts of the build script that depend on scala.version? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org