Re: Operation and robustness of iotDB

2019-03-04 Thread Xiangdong Huang
Hi, If so, I think I need to add a new API to allow you continue to write data in an existing but not closed correctly TsFile. Then everything is fine for you :D Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Julian Feinauer

Re: Operation and robustness of iotDB

2019-03-04 Thread Julian Feinauer
Hey Xiangdong, thanks for the great explanation. And in fact, I agree with you that it would be best if we start to play around with it and reply all our findings or wishes back to this list (in fact that proved to be beneficial in plc4x as well). You confirm my thoughts about the two

Re: Operation and robustness of iotDB

2019-03-04 Thread Xiangdong Huang
Hi, TsFile API is not deprecated. In fact, it is designed for this scenario and MapReduce/Spark computing. If you just use Reader and Writer API, there is something you need to know: Let's suppose your block size is x Bytes, (tsfile-format.properties: group_size_in_byte). 1. If you write data

Re: Operation and robustness of iotDB

2019-03-04 Thread Julian Feinauer
Hi Xiangdong, thanks for the info. How is it in the case when you use the Reader / Writer API for the tsfiles directly (or should this be considered "deprecated")? Can these files come to corrupted state? One Situation where we have to deal with these situations is "at the edge" when we have

Re: Operation and robustness of iotDB

2019-03-04 Thread Xiangdong Huang
Hi, IoTDB can support either on a server with 7*24 or a RaspberryPi. We have tested both the two scenario. When you shutdown an IoTDB instance in force (e.g., power off) and restart it again, no data loses ( if you enable the WAL). However, currently we do not optimize the time cost of the

Operation and robustness of iotDB

2019-03-04 Thread Tim Mitsch
Hello development-team First of all thanks for developing this kind of interesting project and bringing it into apache incubator. I have a question regarding the place of operation and robustness: * Is iotDB concepted as application on a server which is running 24/7 or * Is it also

Re: Confluence Access Rights

2019-03-04 Thread Julian Feinauer
Hi Xiangdong, thanks for the hint. We should definetly try to keep it similar, yes. I already pushed a minimal working example based on a tsfile [1]. And I would be happy to cooperate with Tianan and Wangminhao (we already had some mail exchanges). Julian [1]

Re: Confluence Access Rights

2019-03-04 Thread Xiangdong Huang
Hi Julian, Great to hear that you are working on Calcite integration. I think, we can consider how the SparkSQL-IoTDB adapter is designed, which is mainly developed by Jialin Qiao and Lei Rui. In summary, a Storage Group is a table, and there are two types of column mappings: 1. the columns

Revive Edgent with some new (and cool) features

2019-03-04 Thread Julian Feinauer
Hi community, as I finished some private projects, I feel like I have some time and new energy to spend more efforts to edgent. I have several ideas on how we can kick off the project again and would like to share / discuss them with you guys. * First, I suggest that we add adapters

Re: Confluence Access Rights

2019-03-04 Thread Justin Mclean
Hi, > So I wanted to create a confluence page for the design documentation on [1]. > But it seems that I’m missing the permissions. What’s your user name? Thanks, Justin

Revive Edgent with some new (and cool) features

2019-03-04 Thread Julian Feinauer
Hi community, as I finished some private projects, I feel like I have some time and new energy to spend more efforts to edgent. I have several ideas on how we can kick off the project again and would like to share / discuss them with you guys. * First, I suggest that we add adapters

Confluence Access Rights

2019-03-04 Thread Julian Feinauer
Hi all, I wanted to start with a design page for the Calcite integration on the confluence. Parallel to the technical things we should have a discussion how we map the iotdb notions and elements to standard sql (e.g. what is a table? A device? A node in the tree? …). So I wanted to create a