<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">I’m going to try to run multiple curl processes. The libuv code that i wrote is not of a very good quality (even though it’s really simple).<div class=""><br class=""></div><div class="">thanks!</div><div class="">—zahar<br class=""><div><blockquote type="cite" class=""><div class="">On Jun 10, 2016, at 2:43 PM, Alejandro <<a href="mailto:cdgraff@gmail.com" class="">cdgraff@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">In the past, i had used this method:<div class=""><br class=""></div><div class=""><a href="http://icecast.org/loadtest/1/" class="">http://icecast.org/loadtest/1/</a><br class=""></div><div class=""><br class=""></div><div class="">But to be honest, nothing be compared with real use case, we found many issues when the connections arrive from many differents IPs, the stress test open all from small set of IPs, but almost this test case is used for many others, and present good results.</div></div><div class="gmail_extra"><br class=""><div class="gmail_quote">2016-06-10 2:40 GMT-03:00 Popov, Zahar <span dir="ltr" class=""><<a href="mailto:zahar.popov1978@yandex.com" target="_blank" class="">zahar.popov1978@yandex.com</a>></span>:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word" class="">I wrote a test application which is based on libuv. iptables is disabled.<div class="">I’m running the test application from two other machines.</div><div class=""><br class=""></div><div class="">Do you have any suggestions for testing?</div><div class=""><br class=""></div><div class="">thanks!</div><div class=""><span class="HOEnZb"><font color="#888888" class="">—zahar</font></span><div class=""><div class="h5"><br class=""><div class=""><br class=""></div><div class=""><br class=""><div class=""><blockquote type="cite" class=""><div class="">On Jun 10, 2016, at 2:38 PM, Alejandro <<a href="mailto:cdgraff@gmail.com" target="_blank" class="">cdgraff@gmail.com</a>> wrote:</div><br class=""><div class=""><div dir="ltr" class="">Zahar, how are you testing? with some CURL stress test? BTW, IPTABLES is enabled?<div class=""><br class=""></div><div class="">I was running most time in VMWARE, but i run 10k users in medium size box in AWS, just move out for the high transfer cost.</div></div><div class="gmail_extra"><br class=""><div class="gmail_quote">2016-06-10 2:36 GMT-03:00 Zahar Popov <span dir="ltr" class=""><<a href="mailto:zahar.popov1978@yandex.com" target="_blank" class="">zahar.popov1978@yandex.com</a>></span>:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="">Hi Alejandro,</div><div class="">Here is mine:</div><div class=""><p class=""><limits><br class=""> <workers>4</workers><br class=""> <clients>100000</clients><br class=""> <sources>2000</sources><br class=""> <queue-size>102400</queue-size><span class=""><br class=""> <client-timeout>30</client-timeout><br class=""> <header-timeout>15</header-timeout><br class=""> <source-timeout>10</source-timeout><br class=""></span> <burst-on-connect>1</burst-on-connect><br class=""> <burst-size>65536</burst-size><br class=""></limits></p></div><div class="">Your queue-size is larger, i will try to increase that.</div><div class=""> </div><div class="">thanks!</div><div class="">--zahar</div><div class=""> </div><div class="">10.06.2016, 14:31, "Alejandro" <<a href="mailto:cdgraff@gmail.com" target="_blank" class="">cdgraff@gmail.com</a>>:</div><div class=""><div class=""><blockquote type="cite" class=""><div class=""><div class="">Please share your config, almost the LIMITS part, this is my setup</div><div class=""> </div><div class=""><div style="font-size:12.8px" class=""> <limits></div><div style="font-size:12.8px" class=""> <workers>8</workers></div><div style="font-size:12.8px" class=""> <clients>100000</clients></div><div style="font-size:12.8px" class=""> <sources>700</sources></div><div style="font-size:12.8px" class=""> <queue-size>524288</queue-size></div><div style="font-size:12.8px" class=""> <client-timeout>30</client-timeout></div><div style="font-size:12.8px" class=""> <header-timeout>15</header-timeout></div><div style="font-size:12.8px" class=""> <source-timeout>10</source-timeout></div><div style="font-size:12.8px" class=""> <span style="font-size:12.8px" class=""><burst-size>65535</burst-size></span></div><div style="font-size:12.8px" class=""> </limits></div></div></div><div class=""><br class=""><div class=""><span class="">2016-06-10 2</span>:28 GMT-03:00 Popov, Zahar <span class=""><<a href="mailto:zahar.popov1978@yandex.com" target="_blank" class="">zahar.popov1978@yandex.com</a>></span>:<br class=""><blockquote style="margin:0 0 0 0.8ex;border-left:1px #ccc solid;padding-left:1ex" class=""><div class="">Hi Alejandro,<div class="">Many thanks for your message.</div><div class=""> </div><div class="">I changed it to 4 (i have 4 cores), but it didn’t really help. I see that all 4 cores are now working, but the connections are still being dropped.</div><div class=""> </div><div class="">Which VM type are you using? Or it’s not running on AWS?</div><div class=""> </div><div class="">thanks!</div><div class="">—zahar</div><div class=""><div class=""><div class=""><br class=""><div class=""><blockquote type="cite" class=""><div class="">On Jun 10, 2016, at 1:29 PM, Alejandro <<a href="mailto:cdgraff@gmail.com" target="_blank" class="">cdgraff@gmail.com</a>> wrote:</div><br class=""><div class=""><div class="">Sorry, 35K concurrent with 8 workers at 60% cpu</div><div class=""><br class=""><div class=""><span class="">2016-06-10 1</span>:28 GMT-03:00 Alejandro <span class=""><<a href="mailto:cdgraff@gmail.com" target="_blank" class="">cdgraff@gmail.com</a>></span>:<br class=""><blockquote style="margin:0 0 0 0.8ex;border-left:1px #ccc solid;padding-left:1ex" class=""><div class="">Hi Zahar, what value has into <div class=""> </div><div class=""><div style="font-size:12.8px" class=""> <workers>8</workers></div></div><div class=""> </div><div class="">This value is recommended to set at 1 by virtual core.</div><div class=""> </div><div class="">I 'm using for some years, KH branch with 35 concurrent listeners into 8 core vm.</div><div class=""> </div><div class="">Regards, </div><div class="">Alejandro</div></div><div class=""><br class=""><div class=""><div class=""><div class=""><span class="">2016-06-10 0</span>:50 GMT-03:00 Zahar Popov <span class=""><<a href="mailto:zahar.popov1978@yandex.com" target="_blank" class="">zahar.popov1978@yandex.com</a>></span>:</div></div><blockquote style="margin:0 0 0 0.8ex;border-left:1px #ccc solid;padding-left:1ex" class=""><div class=""><div class=""><div class="">Hello</div><div class="">I'm trying to measure the performance of the icecast relay server on 64kbps streams.</div><div class=""> </div><div class="">The server is running in AWS (i've tried various instance types) and the test clients are running on other machines in AWS. The test client is a very simple libuv application that sends a GET request and basically ignores everything it receives in the response. I'm using the icecast-kh fork.</div><div class=""> </div><div class="">I'm able to go up to around 9K simultaneous connections to the server (from two machines). The CPU usage is low, about 15% or so (on one core). However connections are starting to be dropped. Checking netstat i see many frames being lost. Increasing the transmit queue length helped, but still i can't go beyond around 9K connections. I have increased the file descriptor limits and configured IRQ balancing (even though the problem doesn't seem to be CPU bound)</div><div class=""> </div><div class="">It doesn't matter if i run one or more instances of the relay server, the limit seems to be OS global so when one instance is running with 5K connections and the other instance is getting close to 4K connections they both start dropping connections.</div><div class=""> </div><div class="">I assume that there is some other setting of the stack that i didn't configure so i was wondering if anybody was able to run a few dozens of thousands of connections on one server. </div><div class=""> </div><div class="">thanks!</div><div class="">--zahar</div></div></div>_______________________________________________<br class=""> Icecast-dev mailing list<br class=""> <a href="mailto:Icecast-dev@xiph.org" target="_blank" class="">Icecast-dev@xiph.org</a><br class=""> <a href="http://lists.xiph.org/mailman/listinfo/icecast-dev" target="_blank" class="">http://lists.xiph.org/mailman/listinfo/icecast-dev</a><br class=""> </blockquote></div></div></blockquote></div></div></div></blockquote></div></div></div></div></div></blockquote></div></div></blockquote></div></div></blockquote></div><br class=""></div>
</div></blockquote></div><br class=""></div></div></div></div></div></blockquote></div><br class=""></div>
</div></blockquote></div><br class=""></div></body></html>