Web Scraping and Black Lives Matter: analyzing patterns in ad placement

Our code running, automating a browser session, and collecting banner ad visits
{‘foreverspin.com’: 1887, ‘business.comcast.com’: 3, ‘www.npr.org': 5, ‘www.penguinrandomhouse.com': 38, ‘www.getrealmaine.com': 140, ‘www.brimstoneconsulting.com': 1, ‘www.ecmcfoundation.org': 2, ‘topshelf.nprpresents.org’: 4, ‘www.barracuda.com': 10, ‘www.cpb.org': 1, ‘www.macfound.org': 1, ‘www.ikonpass.com': 3, ‘mellon.org’: 2, ‘one.npr.org’: 5, ‘www.capitalone.com': 3, ‘www.dnb.com': 3, ‘avtech.com’: 1, ‘www.ddcf.org': 1, ‘sloan.org’: 1, ‘www.amazon.com': 1, ‘www.td.com': 1, ‘mejuri.com’: 1, ‘www.alonetogether.com': 1}
  • The website could be tracking our visits using cookies
  • The site could be monitoring our traffic using our IP address
  • The results could actually be representative of typical visits to the article




Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

How to Build your own Datasets or Corpora from Wikipedia

Modeling with a multivariate linear regression

Analytics novelties at Google Next 2019

Small Multiples in Power BI: Supercharge Your Dashboards

My Data Science learning journey (completely free)

How to Effectively Plan Your First Machine Learning Project?

Implementing Linear and Polynomial Regression From Scratch

Explanatory Data Analysis on Stack OverFlow Data

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Emily, Lily, Hannah, and Shivani

Emily, Lily, Hannah, and Shivani

More from Medium

How PyCon Cured (Some of) My Imposter Syndrome

Read what you choose! How I made a custom article selector in Python

How to Add a Contact to Multiple Whatsapp Groups Using Python Code (Beginner’s Guide)

All you need to know about Python app development in 2022