Thanks for the response.
The API solution helps to create schema and tables, but what if we
have lost the machines due to some network or hardware issues?
1. In case we have to build a new Zookeeper and Pinot cluster setup on
different servers -- what is the recommended approach of restoring data ?
What should be the cluster configuration for production scale?
2. Is there a recovery option available for the pinot data store (segments)
?
3. If there is a requirement to upgrade pinot version from Version X to
Version Y, we have to generally login to machine and change it on the same
cluster, but due to lack fo access to the hosts on AWS, we are forced to
deploy new servers and data loss is imminent. Any suggestions would be
appreciated.
Please let me know if there is any help or documentation that i have missed.
Thanks,
Veera
On Sun, Aug 13, 2023 at 1:52 AM kishore g <[email protected]> wrote:
> Hi,
>
> That’s probably not the right way to operate Pinot cluster. You should be
> able to add/delete tables or modify schema of existing table without having
> to login to the server. Pinot has the rest apis that allow you to perform
> these operations.
>
> Recommend posting this question in Pinot slack channel as well in case
> others have similar issues
>
> Thanks,
> Kishore G
>
> On Sat, Aug 12, 2023 at 12:11 PM Veera <[email protected]> wrote:
>
>> Dear users,
>>
>> We are using pinot to generate dynamic dashboards.
>> We have a tricky problem.
>>
>> Current Installation setup.
>> Server 1: Zookeeper, Pinot, Presto
>> Once we setup these components, our access to the hosts is revoked.
>> If we have to change scheme or table changes etc, then we have to create
>> a new setup again on Server 2.
>>
>> We are not allowed to login to server 1 due to AWS policies enforced.
>> the Zookeeper metadata and the pinot data store files are stored on AWS
>> EFS, just as a storage, which is accessible both from Server 1 and Server 2
>> as a mount point.
>>
>> When I setup by Server2 with new schema and the same set of components
>> Zookeeper, Pinot and Presto, how do I copy/restore the segments from
>> Server1 to Server2.
>>
>> Hope i have made myself clear. Please let me know if you need any
>> other details.
>>
>> Thanks,
>> Veera
>>
>
