Re: Help needed with Production Configurations

2019-08-15 Thread Ashutosh Mestry
: Verdan Mahmood Date: Wednesday, August 14, 2019 at 10:39 AM To: "dev@atlas.apache.org" , Ashutosh Mestry Cc: "u...@atlas.apache.org" Subject: Re: Help needed with Production Configurations We are using Atlas 2.0 We do have following relations: Table(DataSet): hive_ta

Re: Help needed with Production Configurations

2019-08-14 Thread Verdan Mahmood
We are using Atlas 2.0 We do have following relations: *Table(DataSet):* *hive_table(Table):* metadata = Metadata *Metadata:* popularityScore and one of our query is FROM Table SELECT metadata.__guid ORDERBY popularityScore desc LIMIT 10 Another one is for the wildcard search Table from Tab

Re: Help needed with Production Configurations

2019-08-14 Thread Ashutosh Mestry
What version are you using? DSL queries mostly not use indexes, hence having good configuration of Solr may not be of much value. The pre-1.0 version of DSL is not very efficient in terms of performance. What kind of queries do you have? Can you post some examples? Few things you could try: -

Help needed with Production Configurations

2019-08-14 Thread Verdan Mahmood
Hello Community, We have deployed the Atlas-Solr in our production environment recently, and have around 30k hive tables, with a couple of custom entity types. The DSL queries are pretty slow and taking an average of 15 seconds each time. Our Solr is pretty efficient and works pretty well with all