A was asked if I could share the files of my last diary entry: text-align:left">You can find the files on my">site here. And to teach you how to fish :-), here are the commands I used to produce these lists:

margin-right:0px">csv-cut.py -s \t 1 emd.txt text-align:left">My csv tools can be found on my text-align:left">My assumption when I read this blog post, was that the blacklisted domains would rank low in the Alexa and Umbrella lists. They don text-align:left">Conclusion: dont use Alexa and Umbrella top 1,000,000 lists as whitelists blindly, even if you just use the top 1000 or 10000.

Didier Stevens
Microsoft MVP Consumer Security
blog.DidierStevens.com DidierStevensLabs.com

(c) SANS Internet Storm Center. https://isc.sans.edu Creative Commons Attribution-Noncommercial 3.0 United States License.

A was asked if I could share the files of my last diary entry: text-align:left">You can find the files on my">site here. And to teach you how to fish :-), here are the commands I used to produce these lists:

margin-right:0px">csv-cut.py -s \t 1 emd.txt text-align:left">My csv tools can be found on my text-align:left">My assumption when I read this blog post, was that the blacklisted domains would rank low in the Alexa and Umbrella lists. They don text-align:left">Conclusion: dont use Alexa and Umbrella top 1,000,000 lists as whitelists blindly, even if you just use the top 1000 or 10000.

Didier Stevens
Microsoft MVP Consumer Security
blog.DidierStevens.com DidierStevensLabs.com

(c) SANS Internet Storm Center. https://isc.sans.edu Creative Commons Attribution-Noncommercial 3.0 United States License.

A was asked if I could share the files of my last diary entry: Domain Whitelisting With Alexa and Umbrella Lists.

You can find the files on my site here. And to teach you how to fish :-), here are the commands I used to produce these lists:

csv-cut.py -s \t 1 emd.txt blacklist.txt
csv-lookup.py -s , -e blacklist.txt 0 top-1m-umbrella.csv 1 0 blacklist-umbrella.csv
csv-lookup.py -s , -e blacklist.txt 0 top-1m-alexa.csv 1 0 blacklist-alexa.csv

My csv tools can be found on my Beta GitHub repository.

My assumption when I read this blog post, was that the blacklisted domains would rank low in the Alexa and Umbrella lists. They dont, look at the histograms of the rankings.

Blacklisted domains with Alexa rank:

Blacklisted domains with Umbrella rank:

These long tail distributions indicate that blacklisted domains with higher ranks are more prevalent than those with lower ranks. This is also reflected in the ranking average: 350553 for Alexa and 420846 for Umbrella.

Conclusion: dont use Alexa and Umbrella top 1,000,000 lists as whitelists blindly, even if you just use the top 1000 or 10000.

Didier Stevens
Microsoft MVP Consumer Security
blog.DidierStevens.com DidierStevensLabs.com

A was asked if I could share the files of my last diary entry: Domain Whitelisting With Alexa and Umbrella Lists.

You can find the files on my site here. And to teach you how to fish :-), here are the commands I used to produce these lists:

csv-cut.py -s \t 1 emd.txt blacklist.txt
csv-lookup.py -s , -e blacklist.txt 0 top-1m-umbrella.csv 1 0 blacklist-umbrella.csv
csv-lookup.py -s , -e blacklist.txt 0 top-1m-alexa.csv 1 0 blacklist-alexa.csv

My csv tools can be found on my Beta GitHub repository.

My assumption when I read this blog post, was that the blacklisted domains would rank low in the Alexa and Umbrella lists. They dont, look at the histograms of the rankings.

Blacklisted domains with Alexa rank:

Blacklisted domains with Umbrella rank:

These long tail distributions indicate that blacklisted domains with higher ranks are more prevalent than those with lower ranks. This is also reflected in the ranking average: 350553 for Alexa and 420846 for Umbrella.

Conclusion: dont use Alexa and Umbrella top 1,000,000 lists as whitelists blindly, even if you just use the top 1000 or 10000.

Didier Stevens
Microsoft MVP Consumer Security
blog.DidierStevens.com DidierStevensLabs.com

It's been interesting in Perugia with me being the designated rep of the open web.

Many many interesting conversations.

Facebook, Google and Amazon were everywhere. They paid for a lot of the conference.

I had a rollicking session. A real come to Jesus revival for the open web. We started two new rivers at the show. One by a very popular startup in the Netherlands that's coming to the US (the startup Jay Rosen was singing the praises of, rightfully) and one from a journalism class at an Italian university. I'll share more info when I have URLs to share.

At one session, I wondered if Twitter had ever considered buying a major news org. I know the party line on that was no, but I think with Twitter sort of stuck in the mud, if that might not be an interesting way to get unstuck. Consider that the valuation of Twitter is over three times that of the NYT, Twitter is still a much more efficient attractor of value than the news industry, even with it being in the doldrums, as it is (disclaimer I am a Twitter shareholder).

I met a lot of interesting people, and spent major time with some people I already knew. I saw Hossein Derakhshan for the first time since he spent six years in prison in Iran. Lots to say about that. He's an amazing guy.

And many others. Just starting to sort it out in my mind.

Basically, I achieved my goal and much more. I wanted to get new rivers going in journalism. One in publishing and one in J-school. Perfect. With a few more, I'll have the beginnings of a Tom Sawyer evangelism strategy going. And I have some excellent ideas on how to take Electric River to the next level. 

At next year's #ijf the goal is to have reps of the open web on every panel that Facebook and Google people are on. I think that's a reasonable goal. And yes, also to bring some of what we've learned to journalism conferences in the US.