Re: How to get the data url

2017-11-03 Thread 小野圭二
Thank you for your reply, jgp. The URL in my question was just a sample. Whatever it is. I mean, let's image multi user environment spark. This is just a case model. -I am a watcher on a spark system. -Some users run their applications on my spark and ,I need to know what URL running on my spark

Re: How to get the data url

2017-11-03 Thread Jean Georges Perrin
I am a little confused by your question… Are you trying to ingest a file from S3? If so… look for net.jgp.labs.spark on GitHub and look for net.jgp.labs.spark.l000_ingestion.l001_csv_in_progress.S3CsvToDataset You can modify the file as the keys are yours… If you want to download first: look

How to get the data url

2017-10-29 Thread onoke
Hi, I am searching a useful API for getting a data URL that is accessed by a application on Spark. For example, when this URL is in a application new URL("https://s3.amazonaws.com/apache-zeppelin/tutorial/bank/bank.csv";) How to get this url from using Spark API? I looked in org.apach.api