Question #637073 on Graphite changed: https://answers.launchpad.net/graphite/+question/637073
Piotr Popieluch posted a new comment: IIRC I've sent about 10 million random metrics in two seconds over the line protocol with: https://github.com/Civil/graphite_perf_test_go There was no file processing involved, just wanted to indicate that you don't need pickle protocol to send many metrics. You will have to find out what the bottleneck is in your script and optimize that, is it file processing or does carbon block? Did a simple test, this runs on my laptop in 0.09 seconds (wall-time) #!/usr/bin/python3 import socket with open('metrics', 'w') as f: for i in range(10000): f.write("metricname.{} 42 1496179248\n".format(i)) sock = socket.socket() sock.connect(('127.0.0.1', 2003)) with open('metrics', 'r') as f: for line in f: sock.sendall(line.encode('ascii')) -- You received this question notification because your team graphite-dev is an answer contact for Graphite. _______________________________________________ Mailing list: https://launchpad.net/~graphite-dev Post to : [email protected] Unsubscribe : https://launchpad.net/~graphite-dev More help : https://help.launchpad.net/ListHelp
