Thank you Alessandro :)
On Tue, Mar 3, 2015 at 10:03 AM, whitebread [via Apache Spark User List] <
ml-node+s1001560n2188...@n3.nabble.com> wrote:
> Anu,
>
> 1) I defined my class Header as it follows:
>
> case class Header(timestamp: java.sql.Timestamp, c_ip: String,
> cs_username: String, s_ip: String, s_port: String, cs_method: String,
> cs_uri_stem: String, cs_query: String, sc_status: Int, sc_bytes: Int,
> cs_bytes: Int, time_taken: Int, User_Agent: String, Referrer: String)
>
> 2) Defined a function to transform date to timestamp:
>
> implicit def date2timestamp(date: java.util.Date) = new
> java.sql.Timestamp(date.getTime)
>
> 3) Defined the format of my timestamp
>
> val formatTime = new java.text.SimpleDateFormat("yyyy-MM-dd hh:mm:ss")
>
> 4) Finally, I was able to parse my data:
>
> val tableMod = toProcessLogs.map(_.split(" ")).map(p =>
> (Header(date2timestamp(formatTime3.parse(p(0)+" "+p(1))),p(2), p(3), p(4),
> p(5), p(6), p(7), p(8), p(9).trim.toInt, p(10).trim.toInt,
> p(11).trim.toInt, p(12).trim.toInt, p(13), p(14))))
>
> Hope this helps,
>
> Alessandro
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-Timestamp-query-failure-tp19502p21884.html
> To unsubscribe from SparkSQL Timestamp query failure, click here
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=19502&code=YW5hbWlrYS5ndW9wdGFAZ21haWwuY29tfDE5NTAyfDE1MjUxMDc5MQ==>
> .
> NAML
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-Timestamp-query-failure-tp19502p21885.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
