<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
@font-face
{font-family:"Segoe UI Emoji";
panose-1:2 11 5 2 4 2 4 2 2 3;}
@font-face
{font-family:Menlo;
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
p.m602899742474273154msolistparagraph, li.m602899742474273154msolistparagraph, div.m602899742474273154msolistparagraph
{mso-style-name:m_602899742474273154msolistparagraph;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
span.E-MailFormatvorlage20
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1728143264;
mso-list-template-ids:2001773884;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=DE-CH link=blue vlink=purple style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Hi Wayne<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Yep, HLS is something we would like to use with Icecast. </span><span lang=FR-CH style='font-size:11.0pt;mso-fareast-language:EN-US'>As you mentioned, Liquidsoap made a great step in the right direction if it comes to HLS. It seem that icecast might not get this support soon, as you might read in the discussion list. I don’t share these arguments, because we have real world use cases (we have many of them) where we would like use icecast with HLS support. But unfortunately we needed to go with another streaming server application which supports HLS to fulfill our requirements.<o:p></o:p></span></p><p class=MsoNormal><span lang=FR-CH style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span lang=FR-CH style='font-size:11.0pt;mso-fareast-language:EN-US'>But coming back to the topic of this thread.<o:p></o:p></span></p><p class=MsoNormal><span lang=FR-CH style='font-size:11.0pt;mso-fareast-language:EN-US'>I was looking into using NGINX as a reverse proxy for doing the load balancing (single point of SSL and centralized monitoring). NGINX is awesome in doing this. And there are some valid arguments using the approach to put a single NGINX server (or a two node Nginx Cluster) in front of a multi node icecast cluster. At that time, 5 years ago, we decided to go with the « poor man solution » and use the RR DNS approach. We did not had enough time for investigation, development and testing. Additional, we eliminated another single point of failure. Sometimes I like way of KISS (keep it simple stupid) </span><span lang=FR-CH style='font-size:11.0pt;font-family:"Segoe UI Emoji",sans-serif;mso-fareast-language:EN-US'>😊</span><span lang=FR-CH style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p></o:p></span></p><p class=MsoNormal><span lang=FR-CH style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span lang=FR-CH style='font-size:11.0pt;mso-fareast-language:EN-US'>if you need to serve static files globaly, I would consider the CDN approach. </span><span style='font-size:11.0pt;mso-fareast-language:EN-US'>We use CF for this, but any other CDN provider would do the job. They are kind of «same same - but different»<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'> <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Cheers<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Tom<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><div style='border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt'><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=DE style='font-size:11.0pt;font-family:"Calibri",sans-serif'>Von:</span></b><span lang=DE style='font-size:11.0pt;font-family:"Calibri",sans-serif'> Icecast <icecast-bounces@xiph.org> <b>Im Auftrag von </b>Wayne Barron<br><b>Gesendet:</b> Mittwoch, 20. März 2024 23:06<br><b>An:</b> Icecast streaming server user discussions <icecast@xiph.org><br><b>Betreff:</b> Re: [Icecast] Education - 1, 000s, 100, 000's, Millions of listeners. (What kind of infrastructure)<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal>Tom and Frederick.<o:p></o:p></p><div><p class=MsoNormal>Thank you both for your input. It is greatly appreciated, not only by me, but I am sure for many others who find this thread.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Tom - using Linux server for icecast.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>HLS was brought to my attention a while back on the liquidsoap forum.<o:p></o:p></p></div><div><p class=MsoNormal>I have not had a chance to completely look in on it, but do plan on checking it out.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Tom. You have your icecast servers in a round robin configuration.<o:p></o:p></p></div><div><p class=MsoNormal>Are you using NGINX for that?<o:p></o:p></p></div><div><p class=MsoNormal>I have watched several YouTube videos on using it for doing round robin as well as ssl and other things.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>I understand that once a scenario of say 10,000 or more, that I will have to look into either a bigger infrastructure on my side or leasing space on the cloud somewhere.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Now, if I did do the cloud.<o:p></o:p></p></div><div><p class=MsoNormal>Would that be to host the servers or just the files or everything?<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Wayne <o:p></o:p></p></div><p class=MsoNormal style='margin-bottom:12.0pt'><o:p> </o:p></p><div><div><p class=MsoNormal>On Wed, Mar 20, 2024, 4:50<span style='font-family:"Arial",sans-serif'> </span>PM <<a href="mailto:thomas.zumbrunnen@gmail.com">thomas.zumbrunnen@gmail.com</a>> wrote:<o:p></o:p></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm'><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt'>Dear all</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-GB style='font-size:11.0pt'>My 5 cents (or Rappen in CH) if it comes to serving many clients.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-GB style='font-size:11.0pt'>We are running a 4 node cluster since several years – rock solid and w/o any issues. This cluster serves many thousands of listeners from all over the world. Our source transcoder sending the audio streams to each Node. Hence, transcoding power is not an issue here. The four Nodes a geographically dispersed in</span><span lang=EN-GB> 3 countries in Europe. In our case </span><span lang=EN-GB style='font-size:11.0pt'>each Node is running Debian with icecast and has 10Gbit connectivity with brilliant worldwide peerings. Good peering is key, choose your ISP wisely </span><span lang=EN-GB style='font-size:11.0pt;font-family:"Segoe UI Emoji",sans-serif'>😊</span><span lang=EN-GB style='font-size:11.0pt'>.Each icecast servers has the same multi domain ssl cert. which allows us to deliver to several customers (each customer a subdomain) the cluster is round robin load balanced by using AWS Route53. This approach may can be achived also with other DNS Providers like Cloudflare. For example, if one node need to be taken down for maintenance, Route53 throws the Node out of the DNS automatically. This will be achived with “health checks” This mechanism is pretty fast and responsive. If a client gets disconnected and tries a reconnect, the RR DNS is passing the client immediately to a working Node. No issues here as well. It just works.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-GB style='font-size:11.0pt'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-GB style='font-size:11.0pt'>In the beginning we’ve experienced similar issues even though, the bandwidth capacity of the VM’s was never the root cause. We’ve identified some solutions:</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-GB style='font-size:11.0pt'> </span><o:p></o:p></p><ol start=1 type=1><li class=m602899742474273154msolistparagraph style='mso-list:l0 level1 lfo1;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'>Linux TCP stack tuning. Cloudflare has many studies published in their Blogs about this. But you will find a lot about this tuning also in the interweb</span><o:p></o:p></li><li class=m602899742474273154msolistparagraph style='mso-list:l0 level1 lfo1;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'>Consider to bake your own kernel, which is tuned for high throughput – goes in line with TCP Stack tunning</span><o:p></o:p></li><li class=m602899742474273154msolistparagraph style='mso-list:l0 level1 lfo1;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'>Tune the Linux open file limits and adjust the init start script for the icecast server. Example : start icecast with ulimit -c unlimited and ulimit -n 32768</span><o:p></o:p></li><li class=m602899742474273154msolistparagraph style='mso-list:l0 level1 lfo1;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'>Consider to use FreeBSD instead of Linux. FreeBSD has the better TCP stack out of the box.</span><o:p></o:p></li><li class=m602899742474273154msolistparagraph style='mso-list:l0 level1 lfo1;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'>If all of this is not feasible for you, just add a new Node to the cluster and level the amount of clients to more Nodes.</span><o:p></o:p></li></ol><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:18.0pt;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'>For the points 1. and 2. I can’t give you a “out of the box” solution or default settings. It’s an iteration process: adjusting, trial, load testing, monitoring and <repeat></span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'>Because the result will need to fit your requirements, therefore every setup might need a different tuning. And btw. do not try using icecast on Windows Servers, if you need to serve a lot of clients </span><span lang=EN-GB style='font-size:11.0pt;font-family:"Segoe UI Emoji",sans-serif'>😊</span><span lang=EN-GB style='font-size:11.0pt'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'>Happy icecasting</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-autospace:none'><span lang=EN-GB style='font-size:11.0pt'>tom</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-GB style='font-size:11.0pt'> </span><o:p></o:p></p><div style='border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt'><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span lang=DE style='font-size:11.0pt;font-family:"Calibri",sans-serif'>Von:</span></b><span lang=DE style='font-size:11.0pt;font-family:"Calibri",sans-serif'> Icecast <<a href="mailto:icecast-bounces@xiph.org" target="_blank">icecast-bounces@xiph.org</a>> <b>Im Auftrag von </b>Fred Gleason<br><b>Gesendet:</b> Mittwoch, 20. März 2024 20:53<br><b>An:</b> Icecast streaming server user discussions <<a href="mailto:icecast@xiph.org" target="_blank">icecast@xiph.org</a>><br><b>Betreff:</b> Re: [Icecast] Education - 1, 000s, 100, 000's, Millions of listeners. (What kind of infrastructure)</span><o:p></o:p></p></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>On Mar 20, 2024, at 13:16, Wayne Barron <<a href="mailto:wayne@cffcs.com" target="_blank">wayne@cffcs.com</a>> wrote:<o:p></o:p></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><div><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:9.0pt;font-family:"Helvetica",sans-serif'>In Windows and Linux web servers, we can create a forest for our web servers.<br>Send traffic to different servers to even the workload.<br><br>Can we do something like this with the Icecast servers?<br>(or)<br>Will we have to install new VMs, add the heavy stations on that one,<br>and send the new traffic there?</span><o:p></o:p></p></div></blockquote></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Ok, I’m going to be “that guy”…<o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>I would argue that, as soon as you’ve hit an audience size of 10,000 or more (especially if that audience is at all geographically dispersed), IceCast is basically off the table. The reason why can be summarized in three letters: “CDN” [Content Distribution Networks].<o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>To fan out to large, geographically dispersed audiences of 10,000 or more (not to mention 100k’s or, Lord help us, 1M’s or more), you need to get content cached in locations that are geographically close to your listeners. By far the easiest (read: most cost effective) way to do this at scale is to leverage the already existing infrastructure of CDNs (companies like Akamai or CloudFlare, that have a world-wide footprint). That means using streaming formats that utilize segmented distribution mechanisms, such as HLS or DASH. You can kinda-sorta do this sort of thing with IceCast by using relays, but it’s complex to configure and monitor while being not well supported at many CDNs (Akamai for example discontinued their IceCast product offering several years ago). HLS OTOH plays very well with that infrastructure because it’s effectively just a bunch of static files that get replicated via HTTP[S]. No special “server” software is required; bog-standard Apache or Nginx work just fine, because the complex “media handling” bits have been intentionally pushed to the endpoints; namely the encoder and (especially) the players. Today though, when FOSS HLS audio encoders are available and pretty much every browser supports playing HLS content natively, the complexity angle can be largely ignored by content creators.<o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Just my take. That, and 2 € will get you a (cheap) cup of coffee…<o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Cheers!<o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div><div><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>|---------------------------------------------------------------------|</span><o:p></o:p></p><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>| Frederick F. Gleason, Jr. | Chief Developer |</span><o:p></o:p></p><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>| | Paravel Systems |</span><o:p></o:p></p><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>|---------------------------------------------------------------------|</span><o:p></o:p></p><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>| All progress is based upon a universal innate desire of every |</span><o:p></o:p></p><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>| organism to live beyond its income. |</span><o:p></o:p></p><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>| |</span><o:p></o:p></p><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>| -- Samuel Butler |</span><o:p></o:p></p><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>| "Notebooks" |</span><o:p></o:p></p><p style='margin:0cm;font-variant-caps:normal;font-stretch:normal;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal'><span style='font-size:8.5pt;font-family:"Menlo",serif'>|---------------------------------------------------------------------|</span><o:p></o:p></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p></div></div></div></div><p class=MsoNormal>_______________________________________________<br>Icecast mailing list<br><a href="mailto:Icecast@xiph.org" target="_blank">Icecast@xiph.org</a><br><a href="http://lists.xiph.org/mailman/listinfo/icecast" target="_blank">http://lists.xiph.org/mailman/listinfo/icecast<br></a><o:p></o:p></p></blockquote></div></div></div></div></body></html>