Hi,
I believe spark writes datetime fields as INT96. What are the implications
of https://issues.apache.org/jira/browse/SPARK-10364(Support Parquet
logical type TIMESTAMP_MILLIS) which is part of 2.2.0?
I am having issues while reading spark generated parquet dates using Apache
Drill (Drill
I am unable to retrieve the state and Id of a submitted application on a
Standalone cluster. The job gets executed successfully on the cluster.
The state was checked using:
while(!handle.getState().isFinal()){
//print handle.getState()
}
When run as local, state gets reported correctly.