Writing a web client for MP3 streaming in perl.
What is streaming?By streaming we refer to the decoding of a file consurrently with its download, i.e. rendering the contents of the file as they become available, without having to stand by for the entire file to be downloaded. Streaming is very useful in applications that involve live content (such as readio transmissions, or newscasts) or media files that tend to be very large, that is in applications where the user cannot afford waiting for the download to be completed before the file can be decoded. Not all file formats can be streamed. Many common media fromats/compressions that we use everyday, such as GIF or WAV require the entire file to be available before the decoding can take place. Formats such as mpeg-3 or RealAudio on the other hand, can be decoded as the data comes in. Such formats are called collectively streaming formats.
Taking advantage of the streaming properties of a file.If you start downloading an mp3 file and stop the download before it's finshed, you'll then be able to hear the song that you have downloaded perfectly ok, up to the point where the transfer was interrupted. Going a step further, if you start the download and also ask your mp3 player to play the file which is being written to right now, you'll notice that the decoder plays the file just fine, and if your network connection can maintain a sufficient throughput, you could listen to the entire song as it's being downloaded without a single jitter. Because network connections rarely are too stable, you will find that it is good practice to let the download do some progress first and then start the decoder, so that even if your network throughput loses pace for a while, there will be some data read ahead for the decoder to munch as the network catches up.. otherwise you might experience jerks and pauses. This is a common technique, similar to the lookahead buffer that car stero cd's use to ensure sound continuity even when you hit a bump on the road.
Automating the process...While it was fun to experiment with streaming manually, it would be even better fun if we made a program to do all of it for us: download the file from the internet and redirect the incoming data stream to the decoder. Ideally, we would just provide the url of the remote mp3 file and soon we would be listening to the song hot off the network. All we need is to make a program that can open a socket to a remote host, use HTTP to request the file from the server, and than just feed the incoming data from the socket into the standard input of the decoder/player to which we will open an input pipe.
Introducing webamp...And here's our program, webamp. Have a look at the code, which is pretty basic, and see for yourself how it works.. I will be explaining the details shortly.
How it works.
Line 3This is just the name of the program that we will use as a decoder. It is important to use a decoder that is capable of accepting standard input as we are going to be piping the data stream to it.
Lines 5-10Here we parse the URL that was passed as an argument from the command line. The URL consists of three components of interest to us. The hostname, the port and the filepath relatiev to the server's root. A simple regular expression (line 6) helps us identify each and store them in variables $host, $port and $file. Note that if no port is specified we assume port 80, the default HTTP server port.
Lines 12-17Here we create a socket and try to connect to the remote server/port. If all goes well, we wnd up with a filhandle SOCK bound to the socket. We will be using this filhandle to communicate with the remote program. (the web server in that case) Printing to the filhandle sends data and reading from the filhandle blocks waiting to receive until incoming data is available to satisfy the read request.
Lines 19-21In order for this to work we must turn off the buffering of the stream. Line 20 turns off buffering of the selected stream. We first select (in line 19) the socket filhandle, then switch off the bufferring, and then restore the previously selected filhandle (good housekeeping rules dictate leaving things as you found them, unless there's good reason for not doing so) which we had saved on our first select().
Lines 23-30Now that our communication channel is set up, we may send our HTTP request (lines 24-26) to the remote web server. Then we must wait for the server to respond. We read the first line from the response which contains the status code and message. If it's 200 OK, this means that our request can be satisfied and that headers and content follow... otherwise we abort. (This is a far too simplistic approach at interpreting server responses, but our main concern here is to provide a demonstration rather than a sophisticated web client that can deal with redirects, caching etc)
Lines 32-35Here we just loop over the headers ignoring them to get to the actual content. Again this is probably not an appropriate tactic for a serious web client, but we just want to provide a working demonstration at the moment.
Lines 37-44Finally we ger to the fun part. In line 38 we open a pipe to the inpu of the handler program, and right after that, we start reading through the incoming data stream and redirecting all data to the handler which will decode and play the music.
Further ImprovementThere is a lot of room for improvement in this program. First of all one desirable feature would be to also store the incoming data into a file as well as passing it along to the handler. So if at the end of the day we like the song, we have it stored somewhere to play it again later. Another obsious enhancement would be to change the last part of the program to buffer the incoming stream and keep a lookahead of a few Kbytes so that we reduce the chance of jitters in the decoding. Finally, note that this is a generic streamer application after all.. we can use any program as a handler, so with appropriate handler programs for various formats we could implement streaming of any other file type. We could even provide the ability to choose the handler from the command line, so the same program can be applied to all streaming uses we wish.
Warning: mysql_connect() [function.mysql-connect]: Access denied for user 'perlfect'@'184.108.40.206' (using password: YES) in /home/content/g/i/o/giorgoszervas/html/comments/comments_include.php on line 6
Connection Error: Access denied for user 'perlfect'@'220.127.116.11' (using password: YES)
Like it? Share it!
Perl and LWP is an excellent book to get you started with using sockets and HTTP to write your own web clients in perl. It covers many issues relevant to web clients and while it does not go into much depth in some of them, by the time you have absorbed the techniques described in it, you will no longer need a book to walk you through more complex problems.
Advanced Perl Programming among various other very interesting subjects, dedicates a chapter to socket programming, not in the context of web clients, but still in a very clear and to-the-point manner. It is also a good book to have if you're seriously interested about perl programming, in my opinion.