Yeah. The problem with current ad networks is twofold. One is advertisers require metrics, metrics require some form of tracking or JS, and advertisers don't trust the ad networks to give accurate metrics, so they require the ability to embed their own JS. This is where you get the app store redirects and malware. Two, ad networks are scummy as shit and don't do any auditing so long as advertisers are willing to pay. You pay us, we'll put your code on client sites. No questions asked.
I think the solution is that advertisers will just need to give up the idea of having reliable metrics on ads, since that's the source of the problem. It's kind of a tragedy of the commons situation: no one would use an ad network that simply distributes JPGs because it has no metrics (malware), but users will block ads that have metrics (malware). There are two solutions: give up metrics, or install an ad blocker on every machine. Ad networks are rapidly pushing us towards the latter.
I don't think advertisers need all of the tracking crap they seem to think they do, for many decades advertisers have had much less tacking ability and the industry thrived. Even without ad network JavaScript, you get more tracking ability on the web than any other medium, because you can give each ad a unique URL, and once you have a click from that URL , you have the prospect on you own site and can track the results. Prospect bounces almost immediately? Well, that wasn't very successful- prospect buys your product/service- success! Prospect spends 15 minutes on your site, reading several articles? Not so bad. What do I need from the publisher that ad network JavaScript provides?
I suspect tying payments to actual user actions, in particularly the user buying something, is the best solution. Affiliate marketing essentially. Its easy to verify and very tough to profitably game so the company running the ads can pay their ad network/publishers/marketing staff with confidence.
Ultimately the advertiser doesn't really care how many impressions (or whatever) they get. They care how many people buy their thing or take some specified action.
I suspect the big roadblock is that some ad networks, publishers and marketeers don't particularly want there to be a concrete ungameable metric that requires them to produce ads that actually move product. If you are counting views or clicks it is easier to look like you are succeeding than if you are only counting people who actually get their wallet out.
They can still count clicks and views- you know if someone visited your site or not from an ad that uses a custom URL- so if that is what you want to measure, your don't need any JavaScript. If you find a publisher is sending you too much garbage (fake) traffic, you don't advertise with that publisher anymore. Thus it behooves the publisher to do fraud prevention on their end.
What about a sort of metrics protocol? Ie, the ad network puts up it's own JS, the advertisers don't get to put up any code. The Networks JS will be configured to optionally call a custom metrics endpoint with some data - ie, the advertisers own servers.
Very little trust is needed, and customers don't get crazy JS on their pages. Is something wrong with this model?
The issue is that large-scale advertisers don't actually trust the ad networks - the network could make up data, and has less reason to track fraudulent clicks/etc.
Yesss, and with video ads, where VAST is involved, once the ad script starts loading, it has no knowledge about the actual media file, as it has to follow a chain of XML files leading to different middlemen (for tracking purposes), ad exchanges, etc... Bidders in ad exchanges can be exchanges as well.
Dealing with bots, fraudulent clicks and malware is one of the things that sets some ad platforms from the really nasty ones.
There was a dozen plus last I worked in the field. There are scores of horror stories related to ad fraud. In particular:
- PPV ads that get stacked. That, several ads laid out on top of each other so that only one (if any at all) is visible.
- PPV ads that get served to bots. Sometimes purposely so, other times as a result of phantom users who replay sessions to build fake profiles for PPC purposes.
- Ad injection that replace legit ads or include new ones via browser toolbars or compromised devices.
- PPC fraud, of course, including some combined with all of the above.
- PPA fraud through cookie stuffing, meaning flooding browsers with cookies to make it look like the traffic originate from where it doesn't.
- PPA fraud through ad injection. Nothing converts better than a popover served via ad injection for the very site you're shopping on.
I'm sure I'm forgetting quite a few, but at a high level those are the main ones to be aware of. As an advertiser you generally cannot rely on the stats you're provided with.
Is it safe to assume that all of these go away within a closed network like Facebook? If so, the numbers that advertisers see on Facebook (vs elsewhere) could help quantify fraud.
Only partially, unfortunately. One of the things sophisticated fraudsters do is replay actual user sessions to build fake profiles. That is, they record scrolls and clicks on compromised devices, and have other users build similar profiles by following similar sessions on other compromised devices. This includes browsing FB and interacting with AdWords of course, and screws up PPV, PPC, and PPI metrics all over.
On top of building more valuable fake user profiles for the latter two purposes, doing this allows to bypass click-density based ad fraud detection. See this article for an example of what you see when you can sometimes observe using the latter when detecting the less sophisticated fraudsters:
As the latter article implies, Google's team is pretty sophisticated at detecting fraud. But even then, seeing things like this suggests there are edge cases they'd like to see go away or that are hard to detect:
The advertiser may choose a partner and run it with the ad, or they may choose a partner and require the publishers produce reports from that partner. Some advertisers will simply require some notable anti-fraud vendor, and the publisher is free to choose the cheapest/least effective.
Traditional news media is dying because advertisers are running to the internet, where they can get lots of highly targeted impressions and deep metrics for pennies on the dollar... perhaps that trend will turn around soon.
Advertising's tragedy of the commons isn't unique to the internet. Other media went through the same adoption cycle of over-promising followed by consumer backlash.
I'm hopeful we'll see advertisers return to the model of (mostly) blindly trusting their advertisers. It will be interesting to see how our largely ad-supported internet changes as a result.
> I think the solution is that advertisers will just need to give up the idea of having reliable metrics on ads, since that's the source of the problem.
One of the things I found incredibly annoying when I was working in this area was the fact that definitions of some metrics can be so drastically different, eg. viewable impressions, completed view impressions (in video) - these difference were so huge that a video played off screen, a video played with only 1px (or 50% height) visible - have been treated as exactly the same thing.
I heard about a company that changed their way of measuring these metrics to something more realistic than... well, a video playing off-screen, whilst increasing prices, which sounds like a decent move - they ended up losing ca. 70% of their revenue.
The problem is that it's really difficult to explain your customers that you've been potentially lying to them (or at least that's the impression they might get).
Regarding the performance footprint - I recommend taking a look at the VAST/VPAID spec. It's not uncommon for an ad to fetch 3-4 xml files containing dozens of tracking pixels coming from 10s of domains. There's also no guarantee that any if the intermediate VAST files contains the right content, how long the chain is or where it comes from.
[EDIT] disclaimer: I might've used incorrect names here, since it's been quite a long time since I've worked in this area, I hope you still get the idea.
Let's imagine that not all the advertisers are that shady, and just don't know better. Or if I wish to serve a subset of them, how break into this business? How get the first batch of customers?
I have some ideas about build a server-side ad-network, but
because I imagine is very hard to get customers I dismiss it, for the same reason: You need to be "famous/large" to attract customer in the ad-space.
Publishers want someone to handle monetisation of their website. If they get enough traffic, they want that someone to work in-house, but if they don't, they want some one (ad network) to do it for them.
Advertisers want impressions/clicks/performance.
A (successful) ad network needs to do both, so bootstrapping invariably looks something like matchmaking in the very beginning.
If you want to find my email address and reach out, I'm happy to talk to you more about bootstrapping: I've gotten more than one ad network off the ground.
Some exist already, you may gain inspiration from them. Project Wonderful is one I know about. There was some guy on here a year ago claiming to have an ethical ad network, but when I visited his client sites, it was mostly "Click Here to win a Free iPod" scams. I think you're right, it'd take a lot of work to find both clients and advertisers interested in working with you given your ethics-inspired limitations.
Edit: The other problem you'll run into is the tragedy issue I mentioned. Your ads will be blocked by most ad-blockers' scorched-Earth policy, which comes from your shitty, unethical competitors. Good luck to ya ;)
I think the solution is that advertisers will just need to give up the idea of having reliable metrics on ads, since that's the source of the problem. It's kind of a tragedy of the commons situation: no one would use an ad network that simply distributes JPGs because it has no metrics (malware), but users will block ads that have metrics (malware). There are two solutions: give up metrics, or install an ad blocker on every machine. Ad networks are rapidly pushing us towards the latter.