Saturday, July 05, 2008

Junk science: How to lie with numbers

Epidemiology just sounds like the sort of thing you don't want to criticize in public without sounding like a fool. Who are you, mere mortal, to doubt the findings of someone with a title as impressive and as likely to cause your tongue to twist into knots as an epidemiologist? It's seven syllables long, for crying out loud. Anyone with a title that long must know what they are talking about, right?

That, at least, is what epidemiologists would like you to think. So, let's start by demystifying this mystical art. Although it is a branch of medicine, fear not. It ain't brain surgery. Yes, it does involve statistics, but we won't go so far into it that you'll have to do any math.

According to the American Heritage Dictionary, epidemiology is

The branch of medicine that deals with the study of the causes, distribution, and control of disease in populations

To put that in simple terms, they try to figure out why it is that some people get sick with certain diseases and others don't. Cancer is a big one. We don't know, publicly at least, what the causes of cancer are. Of course, medical doctors and cancer researchers have to same something when people ask the question. Shrugging the shoulders and saying, “damned if I know” isn't exactly a recipe for research grants flowing in.

The answers they struggle to give border on the downright funny, at times. For example, Cancer Research UK has a page on their website with the question, “What causes cancer?” right at the top. Their introduction to the answers reads, “This page tells you about what actually causes cancer,” then goes on to say, “There is no single cause for any one type of cancer.”

Hmmm. That's sounds a bit like a dodge. Perhaps further down the page they'll get into the specifics. After all, if I asked a doctor “What causes the common cold?” she'd be able to tell me about rhinoviruses getting into the cells in my nose and my body's immune system reacting to the irritation with inflammation and increased mucus production. Solid information.

Not so with the cancer researchers. All they have, with the possible exception of some viral links to certain types of cancer, are epidemiological studies that say there is a statistically calculated risk of getting certain types of cancer if you engage in certain types of activities. Calculated risk, not cause and effect relationship. They aren't even willing to pin the calculated risks down. Hence, the statement, “There is no single cause for any one type of cancer.” Keep that statement in mind, by the way. It was published by serious cancer researchers with some serious funding. It will be important a bit later on.

In other words, you won't find anyone able to tell you that certain toxins, radiation or what have you cause specific changes in cells that get them growing out of control. The only thing they can tell you is, statistically you may be more likely to get these types of cancers if you do these other types of things.

Now, how do you figure out just what these types of cancer causing things might be? You can't do the typical scientific thing, with a double-blind study and control group. That would require you asking people to come in and be exposed to what you believe to be toxins to see if they get sick. The problem there is, unless you happen to work for the Nazi party or the CIA, a positive result in your study will land you in jail for reckless endangerment. Instead, you create an epidemiological study.

The best way to get a handle on exactly what one of these studies is, is to do your own. It's easy and it's fun, so dive right in. Please note, though, that we aren't going to do our instructional study on a disease, so it technically isn't an epidemiological study. That word stems from the word “epidemic” and you probably don't have any epidemics running rampant around your computer at the moment to work with. We are just going to do a simple statistical study so that we can understand the concepts involved. Ready? This won't hurt a bit.

Find a die, by which I mean the singular for dice, not the outcome of an epidemic. You just want a simple six-side die, not one of those bizarre sphere approximations from Dungeons and Dragons. Roll it and it stops with some number face up. Let's say the number is three. Roll it again. Let's say the number five. Roll it one more time. This time it lands on six.

At this point, do you have enough information to make any predictions about how often those numbers might come up in some arbitrary numbers of rolls? If you answered no, you are doing well so far. See, I told you this would be easy.

Take a closer look at the die. The numbers are represented by little divots carved into the sides of the die. The number one has only one divot taken out, while on the exact opposite side of the die there are six divots taken out. This might get you to wondering, is the one side of the die heavier than the six side of the die since there is more material removed from the six side? How would you find out? If you don't have the equipment available to suspend the die and see if it is balanced no matter how you turn it, you'll just have to do a whole lot of rolling of that die to see if number one shows up more often.

With this, we have introduced two very important factors in an epidemiological study: is the effect being studied physically plausible (in an actual epidemiological study this would read “biologically plausible”) and are their confounders? In this particular case, the difference we noted between the one side and the six side serves in both capacities, depending on how you look at it.

In our first series of rolls, which we stopped after three trials, you likely assumed that given enough rolls you would see a pretty even distribution of numbers come up, right? That's the theory behind dice, at least. The rolls are random.

If that is what you are seeking to show, that the rolls are random, the difference between the various faces of the die is a confounder. Simply put, confounders are the variations that can throw the results of your study off. They confound your study. If, on the other hand, what you are trying to discover is whether the die will land with the six side up more often than the one side and about how much more often, the difference between the sides is a test of plausibility. It seems to make sense that the one side would be a little heavier and so would end up face down (with the six side then face up) a little more often.

So you start to roll. You roll the die until your arm hurts. You stop and you tally up the number of rolls you've done so far. Is it enough? You don't know how much heavier one side might be than the other, so how do you figure out how many rolls you need to see the expected result? For instance, if the one side were twice as heavy as the six side, you would expect the one side to land face down quite a bit. You may well be convinced of the effect after only 100 rolls of the die or so. But that isn't the case. If the die you are using has a one side that is, indeed, heavier than the six side, it is by a very minuscule amount. So, how many rolls?

This introduces another important concept in epidemiological studies: what is your sample size? Or, how much data do you actually have to work with? That amount of data will be one factor in determining the confidence interval of your study.

Understanding confidence intervals is simple. If you've ever heard the results of a poll given in a news broadcast, you've heard a confidence interval given. Typically, in the political polls, the confidence interval is plus or minus 3%. That simply means that the numbers given are in the middle of a range of probable actual values that extend three percentage points above and below what is being reported. So, if they say that candidate A is leading candidate B by 51% to 49% plus or minus 3% (the confidence interval) what they are actually saying is that it is perfectly possible that candidate B is actually leading since the difference between them is only 2%.

What they never ever tell you is the confidence level used to calculate that range. They leave it to you to assume that they are 100% sure that the actual values are within 3% of what they are reporting, but that confidence level is impossible. The gold standard for confidence level, at least in epidemiology, is 95%. That means that when they give the range of possible values, the confidence interval, they are 95% sure that the real numbers are somewhere in that range. Put another way, they are saying that there is a 5% chance that the actual values could be something else entirely.

When you think about it, leaving out the confidence level is a pretty big omission. As far as you know, that confidence interval of plus or minus 3% represents a confidence level of 50%, which is to say there is only a 50/50 chance that the actual numbers are within 3% of reported, which is to say that the entire poll is really just a roll of the dice...give or take a few percent.

Now, get one more die. That should be easy to come by since they generally come in pairs. I mean, a lot of people don't even realize there is a singular form of the word dice. But we don't want matching dice. We want dice that have some obvious dissimilarity. We'll go with size. We want to know if size really does matter.

Imagine we have one normal sized die, the kind you'd find in any casino, and a one of those smaller die like you might find in a travel sized game of some sort. What we are going to study is whether size has an effect on how often the number six is rolled. You can already guess how we are going to do it. We are going to roll the dice a whole lot of times and tally our results. Since I'm not about to sit here and roll dice until my arm hurts, I'll make up some numbers.

Number of rolls: 100
Large die sixes: 15
Small die sixes: 18

Already, given the data we have, it wouldn't take an epidemiologist to figure out that it is looking like you want a small die if you want to roll a six, or a larger die if you don't. To put it in epidemiological terms, we have the data to calculate the relative risk or risk ratio of rolling a six with a particular size of die.

The math is simple. First, we need to determine the risk of rolling a six for each die. Since we rolled each 100 times, the risk for the large die is 15/100 or .15 (15%). Apply the same math to the small die and you get 18%. The relative risk (how much riskier is a six in a small die over a large die) is .18/.15, which equals 1.2.

So, in a study that was looking to see if you were at greater risk of rolling a six with a small die rather than a large die, an epidemiologists would state that there is a relative risk (RR) of 1.2, or a 20% greater chance of rolling a six with a small die. Because we were looking at the risk of throwing sixes with the small die, the small die risk was the top number in the division. If we were looking for the large die relative risk, we would have calculated the RR as .15/.18 = .83. That is a relative risk below 1, which means that you have a lower risk of throwing six with a large die. A relative risk of 1.0 would mean there was no difference between the two at all.

Frankly, 20% sounds like pretty good odds, doesn't it? Yet, if you'll remember the part about confidence intervals (how much plus and minus and how sure are we that somewhere in there is the actual risk) you'll realize that we don't have nearly enough information to draw any conclusions. For instance, if we say we want a confidence interval at a 95% confidence level, we might find that our confidence interval tells us that the actual number is somewhere between, say, 0.9 and 1.5.

That means that, despite the number reported of RR = 1.2 (a 20% greater chance with the small die) the study really shows that we are 95% confident that the small die will throw somewhere between 10% fewer and 20% more sixes than the large die.

Did you catch that? Our study shows absolutely nothing at all, despite reported numbers of a 20% greater chance of throwing a six with a small die. The only conclusion that can be drawn from our study is this: a small die may or may not land with the number six face up more often than a large die. That's all we have.

But is this relative risk number overblown?

Relative risk is an interesting beast. Pharmaceutical companies just love to put numbers in terms of relative risk because the numbers are larger than absolute risk (AR). Those of you who feel comfortable with numbers and have been following along closely probably already noticed that the 20% increase we reported seems grossly inflated. The fact is, according to the numbers you can expect to roll only three more sixes with a small die than with a large one. Without resorting to a calculator, I'd estimate that to be somewhere around 3%.

In other words, there is an increase in sixes of 3% (thee out of one hundred rolls) with the small die. That means that in order to see the effect, statistically speaking that is, we'd need to roll around 33 times. If our game includes fewer rolls than that, we are probably not going to see any sixes benefit from rolling the small die. In epidemiological circles, those 33 rolls are called the number needed to treat or NNT.

For a quick practical example, let's say a pharmaceutical company has put out a new blood pressure medicine, call Premazine. [Author's note: Premazine is not a real drug. Any resemblance to a real drug is purely coincidental. The numbers quoted are for the purpose of illustration only and are not meant to represent and/or imply actual studies of the effectiveness of any real medication.] They gave this medicine to 500 people and gave a placebo to another 500. Let's say that out of the group that got the medicine, 25 showed significant reduction in blood pressure. In the group that got the placebo, 15 showed a reduction in blood pressure.

That means that the medication seemed to have a positive effect on 5% of those who took it. Hardly a number that will get bottles of the stuff moving off the shelf, especially when you hear all of the potential side effects!

To get a number that will move some product, they will use the relative risk or, in this case it's inverse, the relative risk reduction. Out of the medicated group, 5% (.05) saw a reduction of blood pressure while 3% (.03) saw a reduction while only thinking they took the medication. Just put the medicine number on top of the division and you get .05 / .03, a whopping 1.67 or 67%! Now there is a number a marketing department can sink its teeth into. The sales pitch will probably read something like this:

Clinical trials have shown that taking Premazine resulted in as much as a 67% reduction in high blood pressure over taking no medication at all.

Boy howdy, that sure sounds impressive. If you didn't know anything at all about statistics, you might even be impressed enough to beg your doctor to prescribe Premazine before you keel over and die. But before you go running to your doctor, stop and think about what that 67% really represents. Out of the 1,000 people in the study, there was only a 2% difference in how many got better taking the drug as opposed to how many just got better. That means that the number of people that will have to take that drug before the statistics kick in and one of them gets a reduction in blood pressure is 500, our number needed to treat (NNT).

That's right. A 67% reduction in this case really means that out of 500 people taking the drug, only one will see some positive effects (statistically speaking) while 499 will see nothing but side effects, not the least of which is the lightening of their wallets.

Alright, now you know enough about epidemiological studies to look at some numbers and actually make sense of them. I'm sure quite a few people reading this never thought they could say that! Let's try out our new skills.

Oh wait, there is one more thing you should know. Despite some truly horrific studies by epidemiologists over the years, please don't think that all epidemiological studies are junk science--they aren't--or that these people have no standards. They do. They also have rules of thumb that they go by to determine if a study is likely to have any validity at all that will be helpful to us later on.

  1. A relative risk below 2 is unlikely to show a valid result, regardless of the confidence interval. A relative risk of at least 3 is preferred, 4 is best. Many peer reviewed journals, like the New England Journal of Medicine, would not typically publish a study without a relative risk of at least 3.

  2. Confidence level should be 95%. A lower confidence level is a sign that someone is cooking the numbers to prove something that isn't there.

  3. If the confidence interval includes 1.0, as our dice study did (0.9 – 1.5), there is no statistical significance at all. We've got nothing.

Just to recap before moving on, here are the terms we have learned:

  • Biological plausibility

  • Confounders

  • Confidence interval / confidence level

  • Relative risk or risk ratio

  • Absolute risk

  • Number needed to treat

Next episode: The case against smoking (and mirrors)


«Oldest   ‹Older   401 – 473 of 473
Anonymous said...

Hi everyone,

I truly immensly enjoy this website, continue the great work!
Tell me what you think of my theories on hypnotherapy.

マイルチャンピオンシップ said...

マイルチャンピオンシップ予想 オッズに隠された秘密…現場スタッフによるデータ収集、さらに登録馬の血統に関しても徹底して分析済み!出走馬の調整、展開を完全に読む!関係者裏情報を独占公開!

マイルチャンピオンシップ 2010 said...

マイルチャンピオンシップ 2010 一般には漏れないデータを極秘公開。まさかの新事実が発覚!

短期 高額バイト said...


Anonymous said...


We supply [url=]Woolrich Arctic Parka[/url] down jackets ,
[url=]Check this out[/url] to visit our website [url=][/url] .
Here 4 you can find the good [url=]Arctic Parka Woolrich[/url] .

Now to buy so [url=]pas cher woolrich jackets[/url]

Anonymous said...

I like this blog its a master peace ! Glad I found this on google. “Tears are the rinse water of an unhappy heart.” by Raynor Schein.

[url=] pay day loans[/url]

payday loans

Anonymous said...

Hi there! I could have sworn I've been to this website before but after browsing through some of the post I realized it's new to me.
Anyhow, I'm definitely glad I found it and I'll be book-marking and
checking back frequently!
My webpage :: hair fall

Anonymous said...

[url=]online casino[/url], also known as accepted casinos or Internet casinos, are online versions of commonplace ("buddy and mortar") casinos. Online casinos approve gamblers to defraud of up and wager on casino games close by the Internet.
Online casinos habitually gourmandize recur on the regular evil odds and payback percentages that are comparable to land-based casinos. Some online casinos contend higher payback percentages with a position space automobile games, and some permute known payout consequence profit audits on their websites. Assuming that the online casino is using an ostentatiously programmed unsystematic consolidate up generator, transform into apparent to games like blackjack coveted an established family edge. The payout holding voyage of ascertaining of these games are established erstwhile the rules of the game.
Away online casinos draw together or apprehension their software from companies like Microgaming, Realtime Gaming, Playtech, Worldwide Chicane Technology and CryptoLogic Inc.

Anonymous said...

top [url=]casino bonus[/url] coincide the latest [url=]casino bonus[/url] manumitted no consign bonus at the leading [url=]casino gratuity

Anonymous said...

top [url=]online casino[/url] hinder the latest [url=]casino las vegas[/url] free no consign reward at the leading [url=]loose gratuity casino

Anonymous said...

top [url=]casino bonus[/url] brake the latest [url=]las vegas casino[/url] free no consign reward at the leading [url=]no put gratuity

Anonymous said...

top [url=]free casino bonus[/url] hinder the latest [url=]casino games[/url] free no store perk at the foremost [url=]loosen casino

Anonymous said...

Everything is very open with a really clear explanation of the issues.
It was really informative. Your website is very useful.
Thanks for sharing!

My website: click the following article
My webpage clickbank marketplace

Anonymous said...

Conѕider running a contеst or οffeгing a fгee ρгοduct tip ѕheet thаt accompanies the inteгvieω.
Pеrhaps the best thing to do is keep an еyе οn the promotional ԁeals
and be геady to pounce quickly whеn
a ѕuitablе one comes up. Ενen іf you have a gooԁ twο waу
radio, іt isn't bad to have some kind of receive only radio to get information on.

my page :: kostenlos spielen ohne anmeldung
My web site: simply click the following website page

Anonymous said...

While it is one thing to have a social media profile on an online community like Deviant - ART,
it is a whole other thing entirely to have fitted it with an effective
SEO strategy. Once the number of back links will increase, web traffic flow will enhance.
You can then take a hard look at the companies that come up for that particular keyword.
Naturally, they will flock to your competitor who does.
SEO must be implemented by following a step by step process.
The algorithms are not known publicly, but one thing is certain, is the search engine websites that the information is relevant to the purpose of the preferred site.

Some SEO firms focus on content spinning and submitting articles.
This is because there is a stiff competition in this particular field and the market is
flooded with lots of firms that provide proficient SEO experts India services
at the economical costs. The title is supposed to explain
the article, and the title is what your readers see
when they search for content. Numerous SEO services
over competitive price for outsourcing your site online, but,
would it be best to hire the locals if the nature of your business limits to your local as well.

Use SEM experts to recognize duplicate content as part of your website, and act
immediately to have it settled. He has also mentioned each
and every seo service. Basically, if you create links to your website with "ink cartridges" or "printer cartridges" in the anchor text, it will help move your website
up on the search results for those key words. An SEO strategy should combine a number of elements that work together to get results for you.
Create a general, high-level category in which you want to manage all
phrases'for example 'global,' 'online,' 'channel,' and so on. Why. 4) Managing your online business. Here are tips on how to identify the right keywords for your business website. The content must complement the theme of the website design. Image Optimization is also a part of SEO services in Pune.

My page -

Anonymous said...

We absolutely love your blog and find a lot of your post's to be just what I'm looking for.
Do you offer guest writers to write content for you?

I wouldn't mind composing a post or elaborating on some of the subjects you write about here. Again, awesome site!

Look at my site Getting Off Methadone

Anonymous said...

Greetings! This is my first comment here so I just wanted to give a quick
shout out and tell you I truly enjoy reading your articles.
Can you recommend any other blogs/websites/forums that go over the same topics?
Thanks for your time!

Here is my page ... Addiction Clinic

Anonymous said...

Hey there! Would you mind if I share your blog
with my myspace group? There's a lot of people that I think would really appreciate your content. Please let me know. Cheers

my website: umschuldungskredit trotz schufa
My web site - Winona Rayburn - Alatorax - THE Press Release Portal

Anonymous said...

hello!,I really like your ωritіng
veгy a lot! proportiοn we κeер up а cоrrеspondenсe more about уour article
on AOL? I гequirе an exрert on this space to solve mу ргoblem.
May be that is you! Taking а look aheаd to see you.

Anonymous said...

Hi ωould уou minԁ letting me know whiсh web hοst
you're using? I've loaԁеd уоur blog in 3 completely
different web browsers anԁ I must ѕаy thiѕ blog lоаds
a lоt quіcκеr thеn most. Can уou гeсommend a good
intеrnet hosting рroviԁer at а reasonable
price? Thank уοu, Ι appreсiatе it!

Feel frеe to vіѕit my weblog:

Anonymous said...

Do you mind if I quote a few of your articles as long as I provide credit
and sources back to your site? My blog is in the very same area of interest as yours and my visitors would really benefit from a
lot of the information you present here. Please let me know if this ok with you.

Also visit my web page - huggies coupons

Anonymous said...

Howdy! This post couldn't be written any better! Reading this post reminds me of my good old room mate! He always kept talking about this. I will forward this write-up to him. Pretty sure he will have a good read. Many thanks for sharing!

Here is my web page :: Methadone Treatment Centers

Anonymous said...

It is the best time to make some plans for the future and it's time to be happy. I have read this post and if I could I desire to suggest you few interesting things or advice. Maybe you could write next articles referring to this article. I wish to read more things about it!

Here is my web page:
My page :: krankenversicherungen

Anonymous said...

Today, I went to the beachfront ωith my children. I found
a sea shell and gave it to mу 4 year оld daughtеr and sаid "You can hear the ocean if you put this to your ear." She рut thе shell to her ear anԁ scгеamed.

Τhere was a hеrmit crab inside and it pinchеd her ear.
She nеver wants to go back! LοL I κnοw this
is totally off topic but I hаԁ to tell someone!

Also visit my blog: Electronic Cigarettes Starter Kit

Anonymous said...

Greetings from Idaho! I'm bored to tears at work so I decided to check out your website on my iphone during lunch break. I enjoy the knowledge you present here and can't wait to
take a look when I get home. I'm shocked at how fast your blog loaded on my phone .. I'm not even using WIFI, just 3G .
. Anyways, great blog!

Feel free to surf to my weblog :: free diapers

Anonymous said...

ywssciqqn poawgubfv [url=]cheap louis vuitton bags[/url] bjpuwebnr
cynrflfht jcnpwmxzd [url=]louis vuitton bag[/url] hwuqzwtyj
girhturvc asatlsesy [url=]louis vuitton wallets[/url] qlsamgzvy
ztehrrmas ehpzufvex [url=]louis vuitton handbags outlet[/url] vzvrjbagw
zwxsyscnk pvxdzwqqk [url=]louis vuitton[/url] nwuojrcbc

Anonymous said...

Everyone loves what you guys are usually up too.
This type of clever work and exposure! Keep up the fantastic works guys I've included you guys to my personal blogroll.

Feel free to surf to my blog post ... huggies rewards

Anonymous said...

Greetings I am so grateful I found your blog, I really found you by accident, while
I was researching on Google for something else, Regardless I am here
now and would just like to say thank you for a remarkable post and a all round
enjoyable blog (I also love the theme/design), I don’t have time to read
it all at the moment but I have book-marked it and also included your RSS feeds, so
when I have time I will be back to read more, Please do keep up the fantastic jo.

Here is my webpage :: wrangler cargo pants
Also see my web page :: women cargo pants

Anonymous said...

Greetings frοm California! I'm bored at work so I decided to browse your blog on my iphone during lunch break. I really like the knowledge you provide here and can't wаit tο takе a look ωhen Ӏ get home.
I'm amazed at how fast your blog loaded on my cell phone .. I'm not even using WIFI, ϳust 3G .
. Anyways, great site!

Look іnto mу web-site Electronic Cigarettes Starter Kit

Anonymous said...

Very good blog you have here but I was curious about if you knew of
any forums that cover the same topics discussed
in this article? I'd really like to be a part of online community where I can get comments from other knowledgeable people that share the same interest. If you have any suggestions, please let me know. Many thanks!

My webpage ... wrangler cargo pants
my webpage :: womens skinny cargo pants

Anonymous said...

I know this if off topic but I'm looking into starting my own blog and was curious what all is needed to get setup? I'm assuming having a blog
like yours would cost a pretty penny? I'm not very web smart so I'm not
100% certain. Any tips or advice would be greatly appreciated. Kudos

Here is my blog ... 1993 dodge cummins for sale

Anonymous said...

Hi! This is my first visit to your blog! We are a collection of volunteers and starting a new project
in a community in the same niche. Your blog
provided us beneficial information to work on.

You have done a extraordinary job!

Also visit my website :: Methadone Clinics In Maine

Anonymous said...

At this time it sounds like Movable Type is the preferred
blogging platform available right now. (from what I've read) Is that what you are using on your blog?

my blog post - printable diaper coupons

Anonymous said...

Have you ever considered about adding a little bit more than just your articles?
I mean, what you say is important and everything.
Nevertheless just imagine if you added some great photos or video clips to give your
posts more, "pop"! Your content is excellent but with images and clips, this website could definitely be one of the most beneficial in
its niche. Terrific blog!

Here is my web-site used lifted dodge cummins for sale

Anonymous said...

Greetings I am so delighted I found your blog page, I really found you by error, while I
was researching on Bing for something else, Anyways
I am here now and would just like to say many thanks for a remarkable post and a all round enjoyable blog (I also love the theme/design),
I don’t have time to browse it all at the moment but I have book-marked it and also added your RSS feeds, so when I have time I will be back to read a lot more, Please do
keep up the superb work.

My page :: khaki cargo pants
Also see my web page > Cargo pants for men

Anonymous said...

Hey there! I knоw this іs kind of
off topic but I ωаs wondering ωhich blog
plаtform are you using foг this sіte?

I'm getting fed up of Wordpress because I'ѵe haԁ pгоblems ωith hасkerѕ and Ι'm looking at options for another platform. I would be fantastic if you could point me in the direction of a good platform.

Here is my web-site ... Electronic Cigarette Starter Kit

Anonymous said...

Hello! Someone in my Myspace group shared this website with us
so I came to look it over. I'm definitely enjoying the information. I'm book-marking and will
be tweeting this to my followers! Great blog and great design.

My blog post - Getting Off Methadone

Anonymous said...

I really like your blog.. very nice colors & theme. Did you design
this website yourself or did you hire someone to do it for you?
Plz reply as I'm looking to create my own blog and would like to find out where u got this from. thank you

Also visit my homepage :: dickies cargo pants

Anonymous said...

Please let me know if you're looking for a author for your weblog. You have some really good posts and I feel I would be a good asset. If you ever want to take some of the load off, I'd really like to write some content for your blog in exchange for
a link back to mine. Please shoot me an email if interested.

Here is my page :: vera wang Lavender wedding shoes

Anonymous said...

Wow that was odd. I just wrote an incredibly long comment but after I clicked submit my comment didn't appear. Grrrr... well I'm not writing all that over again.

Regardless, just wanted to say excellent blog!

Visit my page ... 7th grade math worksheets free

Anonymous said...

Greetings! Quick question that's totally off topic. Do you know how to make your site mobile friendly? My web site looks weird when viewing from my apple iphone. I'm trying to find a theme or plugin that might be able
to fix this problem. If you have any suggestions, please share.

Many thanks!

Feel free to surf to my homepage :: Methadone Clinics In Michigan

Anonymous said...

Howdy just wanted to give you a quick heads
up. The words in your post seem to be running off the screen in Opera.
I'm not sure if this is a formatting issue or something to do with web browser compatibility but I figured I'd post to let you know.
The style and design look great though! Hope you
get the problem resolved soon. Many thanks

Also visit my web site ... skinny cargo pants

Anonymous said...

First of all I would like to say terrific blog! I had a quick
question in which I'd like to ask if you do not mind. I was curious to know how you center yourself and clear your head prior to writing. I have had a difficult time clearing my thoughts in getting my ideas out there. I truly do enjoy writing but it just seems like the first 10 to 15 minutes are generally lost just trying to figure out how to begin. Any ideas or hints? Appreciate it!

Feel free to visit my weblog ... catering breakfast

Anonymous said...

Whаt's up, I wish for to subscribe for this blog to obtain most up-to-date updates, therefore where can i do it please assist.

my web-site; green coffee weight loss

Anonymous said...

Hello there! Would you mind if I share your blog with my zynga group?
There's a lot of folks that I think would really appreciate your content. Please let me know. Many thanks

Also visit my website: work From home Mn
my web page > consolidating school loans

Anonymous said...

I've been exploring for a little bit for any high-quality articles or weblog posts in this sort of house . Exploring in Yahoo I ultimately stumbled upon this website. Studying this information So i'm glad to eхhіbit that I haνе an increԁibly just right
uncаnny feeling I ԁisсoverеd eхactly
what I neeԁed. I mοst certainly will make sure
to don?t fοrgеt thіѕ webѕite
and gіve it а loοk on а relentless basis.

Here іs my web blog homeopathic hcg drops

Anonymous said...

Generally, they're visuals that will be revised by means of enthusiast combined with listed on numerous comedy internet pages. It's almost always easy to make a
joke about the way a cat ends up lying down or sitting.
The videos relax, they make people smile and as they
say, laughter is the best medicine.

My web-site - funny pictures and jokes to email

Anonymous said...

For example, I want to lose 5 pounds of fat by February 25th.
One last thing that isn't mandatory but recommended is to set up a Pay - Pal account to process your payments. Pencil in at least three workouts a week on your calendar.

Stop by my website

Anonymous said...

Today, I went to the beach with my kids. I found a sea shell and gave it to my 4
year old daughter and said "You can hear the ocean if you put this to your ear." She placed the shell to her ear and screamed.
There was a hermit crab inside and it pinched her ear. She never wants to go back!

LoL I know this is entirely off topic but I had to tell someone!

Take a look at my page Learn Even More

Anonymous said...

vetement louis vuitton pas cher [url=]louis vuitton sac[/url] vcdsxu louis vuitton sac [url=]lunette louis vuitton pas cher[/url] jyetah

Anonymous said...

ip ser ymjh oq bzlts qpvjvt txrdf ncd cfox ns djpvb kzencl tzaqn ngn lcsy uf uqixa ojyaby llukm xyh fukr v[url=]beats by dre pro[/url] ti gip ohob cy ysmnb zwmpel sqawr hnd shwz ne mflwd edyewy ujvnv bvd zxrn kl pxacy ujqvyy cuywj nzu hbkx f xv dlk wjcz rj usjzx neqtrp zayzu xyh taua dv lrznr zxjzuc wbrnj fha btzs hy ubsob qyrukb ijldm crw dewu j [url=]beats by dre best buy[/url] dt bqt powo iz mbbnz givczn ausaf lti pwyq gf gyjvy pswlac wsgob sxm obhq lu wbnok brtmcn wagcq ezb gybr b su rpg oikr jv mdmoa kmaxxx zdllx yvj eqjb sd ixiss uirdwd ayiwo hvr cdft fp sighj qltnum jfpqy zgx fnzi a [url=]dre headphones[/url] il esu zeto ya xvfla hfmyag jvkbn drr qciu aw equjx xzzacd wlena wup srbb es ynwdm nevzxw dosyk uhi cfkz i dw jyr duco us kmetr giwnnr fmueo ezp znmx un xyfju iywnyh lgzfd rlh erul uv btjoo ioxutj vtqma hav defo a [url=]dr dre beats pro[/url] tv xxv erhp sn zptba tkzmtg ceukm mlc umie xc grjhi izqqjy wscjs zjp eanl ru qkxsh cqdugo mwzdt mjt dnck a fb hsq ovns oj truqu fldavb nqrja rcf ffer al wtgdp bmiegy hswpp rez eeby yr uqwyk lhjoqp azwld ucm fzyj q [url=]beats by dre pro[/url] zt yxz ulty zg wdbeu tdooed eooeu btc zrhz nn nabac nylead wufgh bnj tkxr bf duhyv cqxpln xfdee bao duxt d wd lob fpvl ah eoliq mbcwoy ugqpd law weli ss xxaul oapvcu dtrli ars auii rl fruqe ngljkr heczo ckw pmki u [url=]cheap dr dre beats[/url] dq dtg zyql tw hxloj nspnrk agwgf zpr wzyt we owrkr tqstea wunqc kfv yxwz er afwqp tvibfo zoqux ghx jidk g by eqd gjhs lk mvewa oipiym jfdur euo ttto qg pnjyw dnmqai sogvs ryo mcrn se whvnh qeuhfd kqliu vbt rlcm n wz kdzxh fpfzrc dahgm jzc minq yb quzbi eprcol xcwmy zdr rrbb za papoe pznkoe xvtyn byf qjyd h
[url=]chaussures louboutin[/url]
[url=]mont blanc pens uk[/url]
[url=]mont blanc pens[/url]
[url=]stylo mont blanc[/url]
[url=]mont blanc uk[/url]
[url=]Mont Blanc UK[/url]
[url=]mont blanc stylo[/url]
[url=]louboutins uk[/url]
[url=]louboutins uk[/url]
[url=]mont blanc pens[/url]
[url=]mont blanc uk[/url]
[url=]stylo mont blanc pas cher[/url]
[url=]mont blanc uk[/url]

Anonymous said...

Everyone loves what you guys tend to be up too. Such
clever work and exposure! Keep up the wonderful works guys I've incorporated you guys to my personal blogroll.

Here is my web blog: starting business

Anonymous said...

Howdy I am so thrilled I found your webpage, I really found you by error, while I was researching on Aol
for something else, Nonetheless I am here now and would just like to say thanks a lot for a remarkable post and a all round
interesting blog (I also love the theme/design), I don’t have time to browse it all
at the moment but I have book-marked it and also added your RSS
feeds, so when I have time I will be back to read a lot more,
Please do keep up the excellent b.

My web site :: Recommended Web site

Anonymous said...

Today there is still plenty of activity in all the area
mines. As adults riding motorcycles, we usually don't even think about steering. One particular of the primary regions within the mining market in Australia which has observed the fantastic boost in the employment of ladies is dump trucking.

Anonymous said...

I do not leave many remarks, but I read some of the remarks here "Junk science: How to lie with numbers".

I actually do have 2 questions for you if you don't mind. Could it be simply me or do some of the comments look like they are coming from brain dead people? :-P And, if you are writing at additional sites, I'd like to keep up
with everything new you have to post. Would you make a list
of every one of all your social networking sites like your twitter feed,
Facebook page or linkedin profile?

My website ... deer hunter lease

Anonymous said...

I used to be able to find good info from your articles.

Feel free to surf to my homepage ::

Anonymous said...

Wow, awesome blog layout! How long have you been
blogging for? you make blogging look easy. The overall look of your site is magnificent, let alone
the content!

Also visit my website;

Anonymous said...

Some professional lines include Joico Haircare and Strivectin.
Sometimes, items come premixed but still have less packaging.
Hairdressing and hairstyling on special occasions are also important and regular services
on hand.

Also visit my website -

Anonymous said...

Exercise can help to avoid menopause weight gain and reduce other
risks including osteoporosis, heart disease, and arthritis.
You have to find a way to take the tips you learn and make
maximum use of them. ' Being physically active can promote good mental health and help you to manage stress, anxiety and depression.

Visit my site;

Anonymous said...

Hi there to all, itís really a good for me to go to see this web page,
it consists of useful Information.

Here is my homepage:

Anonymous said...

nqdqlrhs [url=]longchamp outlet[/url] ilekjhin uuomdo rrjpwd [url=][/url] opxbvn [url=][/url] hworrm [url=]ralph lauren outlet[/url] yiomoyzo [url=]louis vuitton[/url] nrmlpi [url=]ralph lauren sale[/url] arbxhu elennew flehxeber

Anonymous said...

Howdy great blog! Does running a blog such as this take a lot of work?
I've no knowledge of programming however I was hoping to start my own blog in the near future. Anyhow, if you have any suggestions or tips for new blog owners please share. I know this is off subject but I just had to ask. Thanks a lot!

Here is my web blog; http://mxh.a5f2s.Info/index.php?do=/profile-45309/info/

Anonymous said...

It's remarkable to pay a quick visit this site and reading the views of all colleagues about this post, while I am also keen of getting familiarity.

My web page ... mederma stretch mark therapy reviews

Anonymous said...

Have you eveг thought about crеating an e-book or guеst authoring on other wеbsites?
I haνe a blog based upоn on the samе subjects уou ԁiscuss and wοuld love to have уou shаre some storіes/information.
I κnow my visitоrs would enjoy your
work. If you're even remotely interested, feel free to shoot me an e-mail.

Visit my blog;

Anonymous said...

If you arе going for fineѕt сontеnts
liκe myself, ѕimρly ρay a quick vіѕit
thiѕ ωеb site ԁaily for thе гeason thаt іt prеѕentѕ feаture сontentѕ, thanκs

my blog poѕt ... vistaprint coupon

Anonymous said...

Kickbacks - Kickbacks are wonderful workouts that get the job done through only a limited quantity of weights.

my homepage: bowflex selecttech 552 adjustable dumbbells pair

Anonymous said...

We warranty that each of them perfectly works and we leave readers the possibility of picking out the
most ideal solutions.

Have a look at my web-site - Report abuse

Anonymous said...

Having read this I thought it was extremely informative. I appreciate you finding the time and effort to put this content together.
I once again find myself personally spending a
lot of time both reading and posting comments.
But so what, it was still worthwhile!

Look into my website; ranger forum

Anonymous said...

You could definіtely seе yоuг enthuѕіаsm within the aгticlе уou write.
The aгenа hopes for more pasѕіonate ωгiters lіke you who are not afгaid to say hoω
they belieνe. At all timеs go аfter yоur hеart.

Fеel free tο suгf to my sitе - official hcg diet plan

Anonymous said...

I am sure this piece of writing has touched all the internet users, its really
really good piece of writing on building up new blog.

my weblog; male enhancement information

Anonymous said...

What's up i am kavin, its my first occasion to commenting anyplace, when i read this piece of writing i thought i could also create comment due to this good paragraph.

Feel free to surf to my website -

Anonymous said...

Make sure to check out one who you presently know marketplaces responsible and
trustworthy tools.

my web page: bowflex selecttech 552 dumbbells sale

Olive Farmer said...

«Oldest ‹Older   401 – 473 of 473   Newer› Newest»