Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
alamb commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-3015973967 > Moved, it's already on https://github.com/datafusion-contrib/datafusion-fiddle. I made a small revamp before moving it, so it should look a bit better now. Nice! it is also at DataFusion 48 > Note: deployments won't work unless a datafusion-contrib owner accepts linking datafusion-contrib/datafusion-fiddle to my vercel account (a request should have already been sent) or a new vercel account is created and linked to the project. I'd be happy to still host the project in my vercel account, but if you think there's a better way that also works. Done! Thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
gabotechs commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-3015777584 Moved, it's already on https://github.com/datafusion-contrib/datafusion-fiddle. I made a small revamp before moving it, so it should look a bit better now. Note: deployments won't work unless a datafusion-contrib owner accepts linking datafusion-contrib/datafusion-fiddle to my vercel account (a request should have already been sent) or a new vercel account is created and linked to the project. I'd be happy to still host the project in my vercel account, but if you think there's a better way that also works. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
alamb commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-3006003936 > https://datafusion-fiddle.vercel.app/ exists and is awesome. I am closing the issue. > > Note the site currently features v45.0.0. Would be great to have new fusion versions auto-deployed there. However, I think it's not something DF project has currently bandwidth to take responsibility for. Looks like @gabotechs is the owner ❤ If you want to move the app into the `datafusion-contrib` organization https://github.com/datafusion-contrib @gabotechs I would be happy to give you the permissions to do so Moving it into that organization might make it easier for other people to find and contribute to -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
findepi commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-3005981466 https://datafusion-fiddle.vercel.app/ exists and is awesome. I am closing the issue. Note the site currently features v45.0.0. Would be great to have new fusion versions auto-deployed there. However, I think it's not something DF project has currently bandwidth to take responsibility for. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
findepi closed issue #13818: Browser-accessible official DataFusion playground / DataFusion fiddle URL: https://github.com/apache/datafusion/issues/13818 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
qstommyshu commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-2790492785 Hi everyone, I've opened a [discussion](https://github.com/apache/datafusion/discussions/15660) to gather ideas on the design and features we’d like to see in the official DataFusion playground. Would love to hear your thoughts—feel free to jump in and share your ideas. Thanks in advance! 😊 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
XiangpengHao commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-2725518898 > Thanks a lot I will look into the implementation of [parquet-viewer](https://parquet-viewer.xiangpeng.systems/) about how the caching is done. This is the in-memory cache implementation: https://github.com/XiangpengHao/parquet-viewer/blob/main/src/object_store_cache.rs Disk cache is done automatically by the browser, so it may or may not work depends on many things (request size, range, browser settings, freshness, etc) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
pranavJibhakate commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-2725509197 Thanks a lot I will look into the implementation of [parquet-viewer](https://parquet-viewer.xiangpeng.systems/) about how the caching is done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
XiangpengHao commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-2725268714 > Hi [@XiangpengHao](https://github.com/XiangpengHao) and [@waynexia](https://github.com/waynexia) is there a way to make the a website like in [parquet-viewer](https://parquet-viewer.xiangpeng.systems/) without reading the whole file from s3 like you implemented into the memory or are you saving it into filesystem? because as far as I know its not possible to read and write to filesystem in wasm as of yet? Parquet viewer does not read the whole file; it only reads the metadata and data relevant to your query. Try this example: https://parquet-viewer.xiangpeng.systems/?url=https%3A%2F%2Fhuggingface.co%2Fdatasets%2FHuggingFaceFW%2Ffineweb%2Fresolve%2Fmain%2Fdata%2FCC-MAIN-2014-42%2F000_5.parquet You almost instantly get the query results even if the parquet file is a few GBs large. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
pranavJibhakate commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-2725258319 Hi @XiangpengHao and @waynexia is there a way to make the a website like in [parquet-viewer](https://parquet-viewer.xiangpeng.systems/) without reading the whole file from s3 like you implemented into the memory or are you saving it into filesystem? because as far as I know its not possible to read and write to filesystem in wasm as of yet? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
waynexia commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-2680102365 I'm imaging a highly encapsulated JS component like ```tsx ``` and the user who wants an interactive terminal can render a DataFusion webpage with one line, who wants to use DataFusion WASM to do computation can invoke it as a JS function -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
findepi commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-2636087000 This looks very cool, @gabotechs! And even better than the CLI itself (https://github.com/apache/datafusion/issues/13286) :) I took the privilege to file the first enhancement idea - https://github.com/gabotechs/datafusion-fiddle/issues/1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
gabotechs commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-2635854786 Made it a while ago and still use it for quickly trying out stuff, there are lots of low hanging fruits for improving it (local storage based query history, syntax/error highlighting, a proper open source table component, etc...). If there's something I can do to help please let me know. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] Browser-accessible official DataFusion playground / DataFusion fiddle [datafusion]
alamb commented on issue #13818: URL: https://github.com/apache/datafusion/issues/13818#issuecomment-2635134931 I just game across one from @gabotechs : https://datafusion-fiddle.vercel.app/ Repo: https://github.com/gabotechs/datafusion-fiddle -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
