The backlash against misuse of private data has started. Yesterday, Facebook announced that (effectively) no third party data will be used to target advertising on Facebook.
While there may be ulterior motives for this move - it is clearly an overreaction to a real problem. As I have previously mentioned, it is an unsustainable violation of consumer privacy to gather internet behavior to target advertising. Of course, our friends at Cambridge Analytica are the new poster children for this practice. What is surprising is that they are banning predicted data from their site. As a refresher, predicted data makes a variety of predictions based solely on public data. So, AIQ's 'Facebook Influencer' model actually contains no Facebook data - we leverage analytics to make accurate predictions.
Although I have always believed that the future of targeting involves heavy analytics, my faith did waver a bit over the last several years. It did seem that 'internet scrapers' were having a lot of success and no one was especially concerned about the privacy implications. The world has turned.
Thursday, March 29, 2018
Wednesday, March 21, 2018
Cambridge Analytica
I am very proud that my firm, AnalyticsIQ, was named one of the '10 most innovative companies' by the Technology Association of Georgia. But...it is frustrating that it was necessary to spend a portion of our acceptance speech contrasting our approach to the other 'analytic' firm in the news.
The reality is that the need for analytics would be greatly minimized if we just grabbed/scraped individual Facebook profiles - I would argue that we know what people are all about at that point, without the need for prediction. AIQ does have data that is analogous to some of the CA data - such as political preference, etc. But here is a major difference - we have used hard-core analytics to make these predictions about individuals based solely on public data - and we independently validate every one of our predictions.
Of course, 'knowing' that someone supports a particular candidate (or cause) is undoubtedly better, but not at any cost. There is a major backlash coming - led by consumers against Facebook and other social networks. I am more than OK offering 80% solutions that are 100% on the right side of where the world is headed.
Now dismounting my high horse to have a glass of wine....
The reality is that the need for analytics would be greatly minimized if we just grabbed/scraped individual Facebook profiles - I would argue that we know what people are all about at that point, without the need for prediction. AIQ does have data that is analogous to some of the CA data - such as political preference, etc. But here is a major difference - we have used hard-core analytics to make these predictions about individuals based solely on public data - and we independently validate every one of our predictions.
Of course, 'knowing' that someone supports a particular candidate (or cause) is undoubtedly better, but not at any cost. There is a major backlash coming - led by consumers against Facebook and other social networks. I am more than OK offering 80% solutions that are 100% on the right side of where the world is headed.
Now dismounting my high horse to have a glass of wine....
Wednesday, March 7, 2018
Deep Thoughts from RampUp 2018
I am just returning to the ATL from RampUp 2018 in San Francisco. It was an intense couple of days.
First thought: Despite my concerted effort to look and act like i am 23, I actually felt very old. I was born 53 years ago, which makes my age 136 in 'tech years'. That aside, it is great to interact with so many super-smart kids, who seemed genuinely surprised that i could remember what i had for breakfast.
Thought 2: I am shocked by how many startups are focused on geo-location data. Don't get me wrong, it is very cool to know that someone spent their afternoon at a bar before going to church, but i am truly surprised that 20 companies have gotten funding to pursue this angle.
Thought 3: I am bullish on Liveramp. They really have a cool business model and have been a great partner to AIQ. While i still maintain a few concerns about the near monopoly they have in the on boarding space, they at least seem like benevolent overlords - which is all we can ask for.
Thought 4: Digital marketing is now officially just marketing. I know that some of us still sell buggy whips, but all money, energy and intelligence is focused on digital. The new world is Tesla, not Pontiac.
While I still expect Skynet to activate before RampUp 2019, it is good to know that humans still have a small place in the marketing biz.
First thought: Despite my concerted effort to look and act like i am 23, I actually felt very old. I was born 53 years ago, which makes my age 136 in 'tech years'. That aside, it is great to interact with so many super-smart kids, who seemed genuinely surprised that i could remember what i had for breakfast.
Thought 2: I am shocked by how many startups are focused on geo-location data. Don't get me wrong, it is very cool to know that someone spent their afternoon at a bar before going to church, but i am truly surprised that 20 companies have gotten funding to pursue this angle.
Thought 3: I am bullish on Liveramp. They really have a cool business model and have been a great partner to AIQ. While i still maintain a few concerns about the near monopoly they have in the on boarding space, they at least seem like benevolent overlords - which is all we can ask for.
Thought 4: Digital marketing is now officially just marketing. I know that some of us still sell buggy whips, but all money, energy and intelligence is focused on digital. The new world is Tesla, not Pontiac.
While I still expect Skynet to activate before RampUp 2019, it is good to know that humans still have a small place in the marketing biz.
Thursday, February 22, 2018
AIQ is hiring! Senior Analytical Consultant
AnalyticsIQ is seeking a highly qualified individual for the following position: Senior Analytical Consultant.
This is highly visible position reporting directly to AIQ's COO. The role requires providing technical support to AIQ's sales team and technical management of existing accounts.
This job requires 5+ years of hands-on analytics experience and 5+ years of sales support.
Salary and title commensurate with experience.
Please respond with resume to gailm@analytics-iq.com
This is highly visible position reporting directly to AIQ's COO. The role requires providing technical support to AIQ's sales team and technical management of existing accounts.
This job requires 5+ years of hands-on analytics experience and 5+ years of sales support.
Salary and title commensurate with experience.
Please respond with resume to gailm@analytics-iq.com
Wednesday, February 21, 2018
The Case for Automated Modeling
I have been a vocal opponent to all forms of (truly) automated modeling for years. When I started my first analytics firm (Sigma Analytics) in 1998, there were some seemingly valid players out there. Before we went out and hired what turned out to be 20 humans to build models, we did take a look at these automated modeling platforms. None could touch what a well trained human could do.
Just to be clear, I am not innately against automated modeling - it is just that we have tested most newcomers to this field and have universally found that an experienced modeler can outperform automated platforms. By outperform, I mean in predicting the future (as opposed to what automated platforms have traditionally done well - predict the past).
My view has recently changed - we have tested a platform that equals the power of an experienced analyst, and does it far more efficiently. Of course, the ideal solution is for an analyst to intervene into a 'near final' solution to add in the art of modeling.
What does this mean going forward? I think it will allow experienced analysts to cover far more ground (maybe 3X), while still producing really solid algorithms that actually predict the future. I am not under any illusions that this platform will remain a competitive advantage for my firm - but it does mean that we need to continue to adapt new technologies as they come along.
Just to be clear, I am not innately against automated modeling - it is just that we have tested most newcomers to this field and have universally found that an experienced modeler can outperform automated platforms. By outperform, I mean in predicting the future (as opposed to what automated platforms have traditionally done well - predict the past).
My view has recently changed - we have tested a platform that equals the power of an experienced analyst, and does it far more efficiently. Of course, the ideal solution is for an analyst to intervene into a 'near final' solution to add in the art of modeling.
What does this mean going forward? I think it will allow experienced analysts to cover far more ground (maybe 3X), while still producing really solid algorithms that actually predict the future. I am not under any illusions that this platform will remain a competitive advantage for my firm - but it does mean that we need to continue to adapt new technologies as they come along.
Tuesday, February 13, 2018
Predicting What Cannot Be Known
We here at AIQ have spent the prior ten years building marketing tools. We often focus our analytics skills towards taking things that you 'know' on a relatively small universe and projecting this information to the entire US adult population. An example would be household income: we start with a 'truth' file and use modeling techniques (both standard and proprietary) to extrapolate to every household in the US. Interestingly, this tool sometimes outperforms 'known' income files in accuracy (of course, the reason is that any widely available 'known' data is probably not really known).
Recently, my firm has turned its attention to items that cannot be known at scale. Examples would be whether someone has extrinsic or intrinsic motivations around philanthropy - so, basically the spectrum from 'why would I donate money to a charity if no one knows about it?' to 'I would never donate if people found out!'. Another example is predicting the spectrum of 'impulsivity'. On one extreme are people who are essentially impulse driven (and thus responsive to digital advertising) or, on the other hand, extremely conscientious. Individuals who are conscientious require a lot of information and multiple touches. We have found that digital advertising is not the best way to reach these individuals. The exciting thing about this is that we have jumped from predicting what people 'are' (meaning, typically, things that cannot be easily changed - such as gender, age, ethnicity) to what really motivates people.
Of course, the challenge in producing these tools is that it requires some deep psychological knowledge. About four years ago we began discussions with a leading cognitive psychologist, Holly Adams, about this concept. The ultimate result truly marries purchase/donation drivers with actionable marketing data.
We have repeatedly seen these scores validate in the real world.
Recently, my firm has turned its attention to items that cannot be known at scale. Examples would be whether someone has extrinsic or intrinsic motivations around philanthropy - so, basically the spectrum from 'why would I donate money to a charity if no one knows about it?' to 'I would never donate if people found out!'. Another example is predicting the spectrum of 'impulsivity'. On one extreme are people who are essentially impulse driven (and thus responsive to digital advertising) or, on the other hand, extremely conscientious. Individuals who are conscientious require a lot of information and multiple touches. We have found that digital advertising is not the best way to reach these individuals. The exciting thing about this is that we have jumped from predicting what people 'are' (meaning, typically, things that cannot be easily changed - such as gender, age, ethnicity) to what really motivates people.
Of course, the challenge in producing these tools is that it requires some deep psychological knowledge. About four years ago we began discussions with a leading cognitive psychologist, Holly Adams, about this concept. The ultimate result truly marries purchase/donation drivers with actionable marketing data.
We have repeatedly seen these scores validate in the real world.
Tuesday, December 19, 2017
The Truth About Marketing Data
I sold an analytics firm to Merkle in 2004. While spending two years at Merkle, I learned a lot about the state of the art when it comes to marketing data (and Merkle was and is one of the better data providers).
Here is what I learned:
Here is what I learned:
- There is very little that is known about individuals
- There is a delicate balance between privacy and accuracy
These days, there are two paths in the data biz: scraped data from the internet or compilation of public data.
While making a small attempt not to sound judgmental, I am not a fan of 'scraped' data related to marketing to consumers. I believe there is an ever larger backlash coming for using data that individual consumers consider to be 'private' - such as posting on social networks.
AIQ operates in another world altogether - the world of predicted data. To do this, we acquire everything you can know (via public data) about an individual or the geographic area where an individual resides. In total, AIQ now pulls in > 120 data sources. No single source is anything close to a 'silver bullet'. The only way to optimize this all of this disparate data is via heavy-duty analytics.
The analogy I frequently use is a chef making soup: no one would find any single ingredient in the soup very attractive as a meal, but when combined correctly something special can be created.
While making a small attempt not to sound judgmental, I am not a fan of 'scraped' data related to marketing to consumers. I believe there is an ever larger backlash coming for using data that individual consumers consider to be 'private' - such as posting on social networks.
AIQ operates in another world altogether - the world of predicted data. To do this, we acquire everything you can know (via public data) about an individual or the geographic area where an individual resides. In total, AIQ now pulls in > 120 data sources. No single source is anything close to a 'silver bullet'. The only way to optimize this all of this disparate data is via heavy-duty analytics.
The analogy I frequently use is a chef making soup: no one would find any single ingredient in the soup very attractive as a meal, but when combined correctly something special can be created.
Subscribe to:
Posts (Atom)