My Google piece in The Register

Thanks to the miracle of trans-Atlantic collaborative journalism, here’s my quick take on Google’s caching scheme: Network Neutrality, the public policy unicorn that’s been the rallying cry for so many many on the American left for the last three years, took a body blow on Sunday with the Wall Street Journal’s disclosure that the movement’s … Continue reading “My Google piece in The Register”

Thanks to the miracle of trans-Atlantic collaborative journalism, here’s my quick take on Google’s caching scheme:

Network Neutrality, the public policy unicorn that’s been the rallying cry for so many many on the American left for the last three years, took a body blow on Sunday with the Wall Street Journal’s disclosure that the movement’s sugar-daddy has been playing both sides of the fence.

The Journal reports that Google “has approached major cable and phone companies that carry Internet traffic with a proposal to create a fast lane for its own content.”

Google claims that it’s doing nothing wrong, and predictably accuses the Journal of writing a hyperbolic piece that has the facts all wrong. It’s essentially correct. Google is doing nothing that Akamai doesn’t already do, and nothing that the ISPs and carriers don’t plan to do to reduce the load that P2P puts on their transit connections.

A lot of questions remain about Google’s public policy flexibility and how wise their server farm strategy has been, and we’ll deal with them as Google answers our questions.

Google Gambles in Casablanca

I’m shocked. Google has been caught red-handed negotiating deals with ISPs to host servers inside the building, just like Akamai does. The semi-technical press thinks this is some sort of a game-changing event: The celebrated openness of the Internet — network providers are not supposed to give preferential treatment to any traffic — is quietly … Continue reading “Google Gambles in Casablanca”

I’m shocked.

Google has been caught red-handed negotiating deals with ISPs to host servers inside the building, just like Akamai does. The semi-technical press thinks this is some sort of a game-changing event:

The celebrated openness of the Internet — network providers are not supposed to give preferential treatment to any traffic — is quietly losing powerful defenders.

Google Inc. has approached major cable and phone companies that carry Internet traffic with a proposal to create a fast lane for its own content, according to documents reviewed by The Wall Street Journal. Google has traditionally been one of the loudest advocates of equal network access for all content providers.

At risk is a principal [sic] known as network neutrality: Cable and phone companies that operate the data pipelines are supposed to treat all traffic the same — nobody is supposed to jump the line.

Oh my goodness, where do I begin? Google already has a fast lane to most Internet users today thanks to their network of mega-data centers around the world, which I’ve written and spoken about at some length. These systems are wired directly to public Internet exchange points in high population areas and effectively move Google’s traffic to a higher priority than all but three competing routes: Akamai’s servers hosted inside ISP premises, Limelight’s private network wired directly to ISP networks, and the ISPs’ own content. Google’s desire to host servers (or routers, it could be either) inside ISP networks is a move calculated to improve on the ROI on the existing network of server farms and to blunt the Akamai advantage. It makes more sense to wire directly to the ISPs through private arrangements than to stress the public Internet infrastructure any further.

One thing that this deal doesn’t do is change the Internet infrastructure. Arrangements like this already exist, predating the kerfuffle over fast lanes created out of thin air by public interest advocates three years ago.

The Internet is not a network, it’s a complex set of agreements to interconnect independently owned and operated networks in various ways. There is no standard agreement, and this story doesn’t report on a new one. What it simply shows is that money buys performance in the technology space, and that should come as no surprise to anyone. Google has to do something like this to avoid being clobbered by ISP-friendly P4P as well as by Akamai.

Yes, Virginia, network neutrality is a myth, and it always has been.

UPDATE: Google’s response to the WSJ piece does nothing but muddy the waters. Net Neutrality advocates have insisted on a wall of separation between content and infrastructure, and this deal, if it happens, brings down that wall. I’m happy with that, because I don’t see the prohibition on expedited delivery as a good thing. But Google should admit they’ve come around to my way of thinking about the Internet instead of insisting nothing has changed. See my write-up in The Register.

UPDATE 2: The spin that Google’s supporters are producing around this issue is a marvel for those of us who appreciate the major league curveball. This subtle piece of nuanced distinction by Dave Isenberg deserves some sort of prize:

The concern of Network Neutrality advocates is not with access but with delivery. The fear is that Internet connection providers would charge for expedited delivery of certain content to the end user, and in so doing would put themselves in the business of classifying which content gets enhanced delivery.

Wow. Caching speeds up delivery, otherwise there would be no reason to do it. Google has paid for expedited delivery of its content in effect, regardless of the spin. What counts is bits on the wire, and Google is out to ensure theirs are better situated than yours are.

Don’t be fooled by the spin, this is a distinction without a difference.

Technorati Tags: ,

Bye bye G1

After suffering with the Google phone for 4 weeks, I took it back to T-Mobile yesterday (the contract says you only have 14 days, but I live in California where the time limit on an upgrade return is 30 days.) Jeff Turner describes the G1 appropriately: Like Windows 2.0, it’s good enough that you can … Continue reading “Bye bye G1”

After suffering with the Google phone for 4 weeks, I took it back to T-Mobile yesterday (the contract says you only have 14 days, but I live in California where the time limit on an upgrade return is 30 days.) Jeff Turner describes the G1 appropriately: Like Windows 2.0, it’s good enough that you can tell it’s going to become the standard some day, but it’s not really usable in its present form. The main gripes I had with it are, in no particular order: poor battery life, dropped calls, a crappy Bluetooth implementation, unusable e-mail, a pathetic keypad, and a dearth of applications. My previous phone was a Blackberry Curve, which did everything that it did extremely well; if the Curve could do 3G I’d have got a replacement for the one I lost in London. But it doesn’t, so I’ve gone to a Sony Ericsson TM506, a feature phone that does phone things extremely well, has a built-in GPS (that doesn’t seem to work very well) and may possibly be used as a modem to tether a laptop to the 3G network (that feature seems to be controversial as Sony Ericsson supports it and T-Mobile may not; see update below.)

It’s basically a stop-gap until there’s a competent Blackberry for T-Mobile’s 3G network, which unfortunately uses oddball frequencies in the US.

The G1 has a high return rate owing to the generally pathetic implementation of Android by HTC. And I also don’t like sharing all the information about my personal life that Google wants. But that’s another story.

It’s clear the the iPhone has changed the game for mobile devices and the entrenched cell phone suppliers are struggling to catch up. I don’t doubt that Apple will continue to dominate the mobile device space for at least the next year or two, so I may just have to accede to reality and jump on that bandwagon.

UPDATE: Tethering works, I get close to 800Kbps at home, the Bluetooth limit, but the quota is pathetic: 100 MB/mo, and that’s not going to last long. Presumably, it downgrades to EDGE when the 3G quota is exhausted. The phone doesn’t have a standard USB connector, so I tethered over Bluetooth using the very nice PC Suite from Sony-Ericsson. It guides you through the Bluetooth hookup and makes accessing the Internet through the phone a point-and-click operation, even on a Mac.

It’s nice to use stuff that’s well engineered, isn’t oversold, and actually works, (except for that GPS, which must be defective on my phone.) including the GPS.

The 100MB/mo quota for $20 for the TM506 makes no sense compared to the 10GB/mo they sell for $25 to G1 customers unless Google is paying a subsidy to T-Mobile. If they are, Steve Jobs must be laughing all the way to the bank.

Why Kevin Martin was throwing things and cussing today

A cable guy saved a few lives today: When Jorge Rivera saw thick, black smoke force a woman to drop a young girl from the top floor of a Silver Spring apartment building, he did not hesitate to act. The Comcast repairman pulled over, yanked the ladder off his truck and ran to rescue those … Continue reading “Why Kevin Martin was throwing things and cussing today”

A cable guy saved a few lives today:

When Jorge Rivera saw thick, black smoke force a woman to drop a young girl from the top floor of a Silver Spring apartment building, he did not hesitate to act. The Comcast repairman pulled over, yanked the ladder off his truck and ran to rescue those still trapped by the fire.

By the time firefighters arrived, Rivera had helped about six people escape the blaze, which injured two people and displaced a dozen families yesterday morning. “It was nothing,” Rivera said. “I got two kids at home. If they were somewhere burning, what would you do?”

After the obligatory press interviews, he continued on down the street to hook some people up. Harold Feld then resigned from the Media Access Project.

Internet routing around US

Here’s one more reason not to believe the claims of slow growth in Internet traffic in the US: the rest of the world is optimizing its routes. America is losing its position at the centre of the internet, according to a new study. The survey by communications analysts TeleGeography Research, based in Washington DC, shows … Continue reading “Internet routing around US”

Here’s one more reason not to believe the claims of slow growth in Internet traffic in the US: the rest of the world is optimizing its routes.

America is losing its position at the centre of the internet, according to a new study.

The survey by communications analysts TeleGeography Research, based in Washington DC, shows a rapid growth in internet capacity around the rest of the world over the past year – particularly in Latin America and Asia.

As a result, America’s traditional role as the internet’s traffic policeman is drifting away as other parts of the world become less reliant on it.

“The US used to be a primary hub for many regions,” said Eric Schoonover, a senior analyst at TeleGeography. “A lot of data still comes through the US, and a lot of content there is served out to other countries … but its importance is declining, though it has by no means gone away.”

On aggregate, Internet traffic is probably growing faster than it has in years. You read it here.

Numb3rs botches Simpson’s Paradox

If you watch Numb3rs on CBS, you’ll have noticed a rather bizarre discussion last night of Simpson’s Paradox, which was alleged to say that combing two series of numbers into a single series can change their order (it doesn’t really say that, but that’s beside the point.) The example given was David Justice’s and Derek … Continue reading “Numb3rs botches Simpson’s Paradox”

If you watch Numb3rs on CBS, you’ll have noticed a rather bizarre discussion last night of Simpson’s Paradox, which was alleged to say that combing two series of numbers into a single series can change their order (it doesn’t really say that, but that’s beside the point.) The example given was David Justice’s and Derek Jeter’s batting averages in 1995 and 1997. In each year, Justice had a better average than Jeter, but for the total of the two years, Jeter was alleged to have had a better average. It’s not hard to figure out how this could be true, but it wasn’t. The actual numbers for those years are these:

          Justice  H/AB     Jeter    H/AB
          -------           -----
1995       .253   104/411   .250     12/48
1997       .329   163/495   .291   190/654
==========================================
Comb.      .295   267/906   .288   202/702

Justice’s numbers, Jeter’s numbers

If Jeter had hit better in 1997, much closer to Justice’s average, it would have been true because Jeter very few at bats in 1995 and many more at bats in 1997 than Justice. For some bizarre reason, the show used fictitious numbers that didn’t even add up, alleging that Justice hit .321 and .329 for a combined average of .298.

How a show that’s supposed to be so math-oriented can screw up arithmetic so badly would be a a mystery if it weren’t for the fact that mathematicians are notoriously bad at basic arithmetic.

H/T Amnesia, who also got it wrong.

UPDATE: Aha! Reader Brian Thomas explains it all. See comments.

BitTorrent net meltdown delayed

See The Register for my follow-up on the BitTorrent meltdown story: The internet’s TCP/IP protocol doesn’t work very well. As the internet’s traffic cop, it’s supposed to prevent applications from overloading the network, but it’s at a loss when it comes to managing P2P applications. This deficiency, generally known to network engineers but denied by … Continue reading “BitTorrent net meltdown delayed”

See The Register for my follow-up on the BitTorrent meltdown story:

The internet’s TCP/IP protocol doesn’t work very well. As the internet’s traffic cop, it’s supposed to prevent applications from overloading the network, but it’s at a loss when it comes to managing P2P applications. This deficiency, generally known to network engineers but denied by net neutrality advocates, has been a central issue in the net neutrality debate. BitTorrent Inc has now weighed in on the side of the TCP/IP critics.

The next official release of the uTorrent client – currently in alpha test – replaces TCP with a custom-built transport protocol called uTP, layered over the same UDP protocol used by VoIP and gaming. According to BitTorrent marketing manager Simon Morris, the motivation for this switch (which I incorrectly characterized in The Register earlier this week as merely another attempt to escape traffic shaping) is to better detect and avoid network congestion.

Morris also told the media this week that TCP only reduces its sending rate in response to packet loss, a common but erroneous belief. Like uTP, Microsoft’s Compound TCP begins to slow down when it detects latency increases. Even though TCP is capable of being just as polite as BitTorrent wants uTP to be, the fact that it hides its delay measurements from applications makes it troublesome for P2P clients with many paths to choose from. But it’s sensible to explore alternatives to TCP, as we’ve said on these pages many times, and we’re glad BitTorrent finally agrees.

We strive to be fair and balanced. The nut is that we don’t actually know whether BitTorrent’s new protocol is going to work any better than TCP, as there’s no hard data available on it.

Technorati Tags: ,

Note about UDP

One of the more amusing criticisms of my article on BitTorrent over UDP is that I’m a clueless dork for saying UDP was designed for real-time applications since there was no such thing as VoIP back in the day. This is generally accompanied by the charge that I don’t know the first thing about the … Continue reading “Note about UDP”

One of the more amusing criticisms of my article on BitTorrent over UDP is that I’m a clueless dork for saying UDP was designed for real-time applications since there was no such thing as VoIP back in the day. This is generally accompanied by the charge that I don’t know the first thing about the Internet, etc. So for the record, here’s a statement of the design goals for UDP by one of the people involved, the lovable David Reed:

A group of us, interested in a mix of real-time telephony, local area networks, distributed operating systems, and communications security, argued for several years for a datagram based network, rather than a virtual circuit based network…[UDP] was a placeholder that enabled all the non-virtual-circuit protocols since then to be invented, including encapsulation, RTP, DNS, …, without having to negotiate for permission either to define a new protocol or to extend TCP by adding “features”.

Any questions?

Reaction to BitTorrent story

My article in The Register yesterday about BitTorrent and UDP got some attention. It was a primary article on Techmeme and was Slash-dotted. Here’s the Techmeme link set: Slyck, DSLreports, TorrentFreak, Ars Technica, Icrontic, Joho the Blog, TMCnet, GigaOM, Industry Standard, TechSpot. While most of the discussion went to questions of motivation – I’m alleged … Continue reading “Reaction to BitTorrent story”

My article in The Register yesterday about BitTorrent and UDP got some attention. It was a primary article on Techmeme and was Slash-dotted. Here’s the Techmeme link set: Slyck, DSLreports, TorrentFreak, Ars Technica, Icrontic, Joho the Blog, TMCnet, GigaOM, Industry Standard, TechSpot.

While most of the discussion went to questions of motivation – I’m alleged to be a telco shill for criticizing a system the telcos are OK with – some was actually quite substantial. It’s good to get these issues under the microscope.

More links: Canadian Broadcasting Company, Slashdot, Tales of the Sausage Factory; a few hundred more at Google.

I talked to a couple of the BitTorrent guys today – chief engineer and nemesis Stanislav Shalunov not among them, unfortunately – and they vehemently denied they had any intention of evading the Bell Canada traffic shaping system. Reports from Canada that motivated me to write the piece say the system actually does in fact evade Bell Can’s filters, which will have to be updated as the use of uTorrent 1.9 becomes more widespread, or replaced with more capable equipment.

It remains to be seen whether that upgrade will also catch VoIP and gamers in the throttling net. It’s interesting that the author of the reports on Canada, Karl Bode, is now playing dumb, all the better to be left out of the counter-PR campaign.