Hi Bo, +1 for your project. I come from the world of data warehouses, ETL, and reporting analytics. There are many individuals who do not know or want to do any coding. They are content with ANSI SQL and stick to it. ETL workflows are also done without any coding using a drag-and-drop user interface, such as Talend, SSIS, etc. There is a small amount of scripting involved but not too much. I looked at what you are trying to do, and I welcome it. This could open up Spark to the masses and shorten development times.
Cheers, Ben > On Jun 12, 2017, at 10:14 PM, bo yang <bobyan...@gmail.com> wrote: > > Hi Aakash, > > Thanks for your willing to help :) It will be great if I could get more > feedback on my project. For example, is there any other people feeling the > need of using a script to write Spark job easily? Also, I would explore > whether it is possible that the Spark project takes some work to build such a > script based high level DSL. > > Best, > Bo > > > On Mon, Jun 12, 2017 at 12:14 PM, Aakash Basu <aakash.spark....@gmail.com > <mailto:aakash.spark....@gmail.com>> wrote: > Hey, > > I work on Spark SQL and would pretty much be able to help you in this. Let me > know your requirement. > > Thanks, > Aakash. > > On 12-Jun-2017 11:00 AM, "bo yang" <bobyan...@gmail.com > <mailto:bobyan...@gmail.com>> wrote: > Hi Guys, > > I am writing a small open source project > <https://github.com/uber/uberscriptquery> to use SQL Script to write Spark > Jobs. Want to see if there are other people interested to use or contribute > to this project. > > The project is called UberScriptQuery > (https://github.com/uber/uberscriptquery > <https://github.com/uber/uberscriptquery>). Sorry for the dumb name to avoid > conflict with many other names (Spark is registered trademark, thus I could > not use Spark in my project name). > > In short, it is a high level SQL-like DSL (Domain Specific Language) on top > of Spark. People can use that DSL to write Spark jobs without worrying about > Spark internal details. Please check README > <https://github.com/uber/uberscriptquery> in the project to get more details. > > It will be great if I could get any feedback or suggestions! > > Best, > Bo > >
