Ashutosh Mestry created ATLAS-2063: -------------------------------------- Summary: Compressed HiveHook Messages Key: ATLAS-2063 URL: https://issues.apache.org/jira/browse/ATLAS-2063 Project: Atlas Issue Type: Improvement Components: atlas-intg Affects Versions: 0.8-incubating Reporter: Ashutosh Mestry Assignee: Ashutosh Mestry Fix For: trunk
*Background* Messages posted by hooks to Atlas Kafka topics are JSON format. Kafka imposes a 1MB limit on the message size. Occasionally, depending on operations performed, this threshold is reached. This results in messages being dropped. The entities are thus not reflected in Atlas. *Solution* Applying compression to these message will alleviate the problem. -- This message was sent by Atlassian JIRA (v6.4.14#64029)