Thank you for the reply !
At 2022-05-18 20:27:27, "Wenchen Fan" wrote:
A view is essentially a SQL query. It's fragile to share views between Spark
and Hive because different systems have different SQL dialects. They may
interpret the view SQL query differently and introduce unexpected
A view is essentially a SQL query. It's fragile to share views between
Spark and Hive because different systems have different SQL dialects. They
may interpret the view SQL query differently and introduce unexpected
behaviors.
In this case, Spark returns decimal type for gender * 0.3 - 0.1 but
During the migration from hive to spark, there was a problem with the SQL used
to create views in hive. The problem is that the SQL that legally creates a
view in hive will make an error when executed in spark SQL.
The SQL is as follows:
CREATE VIEW test_db.my_view AS
select
case
when age > 12
During the migration from Hive to spark, there was a problem when the view
created in Hive was used in Spark SQL.
The origin Hive SQL show below:
CREATE VIEW myView AS
SELECT
CASE WHEN age > 12 THEN CAST(gender * 0.3 - 0.1 AS double) END AS TT, gender,
age
FROM myTable;
Users use Spark SQL
During the migration from hive to spark, there was a problem with the SQL used
to create views in hive. The problem is that the SQL that legally creates a
view in hive will make an error when executed in spark SQL.
The SQL is as follows:
CREATE VIEW myView AS
SELECT
CASE WHEN age > 12 THEN
