Web Scraping and Black Lives Matter: analyzing patterns in ad placement

Our code running, automating a browser session, and collecting banner ad visits
{‘foreverspin.com’: 1887, ‘business.comcast.com’: 3, ‘www.npr.org': 5, ‘www.penguinrandomhouse.com': 38, ‘www.getrealmaine.com': 140, ‘www.brimstoneconsulting.com': 1, ‘www.ecmcfoundation.org': 2, ‘topshelf.nprpresents.org’: 4, ‘www.barracuda.com': 10, ‘www.cpb.org': 1, ‘www.macfound.org': 1, ‘www.ikonpass.com': 3, ‘mellon.org’: 2, ‘one.npr.org’: 5, ‘www.capitalone.com': 3, ‘www.dnb.com': 3, ‘avtech.com’: 1, ‘www.ddcf.org': 1, ‘sloan.org’: 1, ‘www.amazon.com': 1, ‘www.td.com': 1, ‘mejuri.com’: 1, ‘www.alonetogether.com': 1}
  • The website could be tracking our visits using cookies
  • The site could be monitoring our traffic using our IP address
  • The results could actually be representative of typical visits to the article




Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

What Is Predictive Analytics?

This is the new patch content for Hunt: Showdown — pulling arrows and knives out of the victims

Real-time thoughts on real-time data collection

Data Transformation

7 Applications of Machine Learning in Healthcare

Go deep, but also … go Bayesian!

Step-by-Step Guide — Building a Prediction Model in Python

Assignment 1 - Social Media: Theories, Ethics, and Analytics

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Emily, Lily, Hannah, and Shivani

Emily, Lily, Hannah, and Shivani

More from Medium

Your first simple Encryption Algorithm

What does a Python developer do and why do all large companies need it?

NFL Twitter Sentiment: Falcons at Bills, Week 17, 2021

How to find secrets in websites