A while back somebody posted the SEO platforms/vendors/tools that he was using at his agency job (as an SEO). Me missing some great tools in there decided to respond but it also got me thinking about my own toolset and decided to dedicate a blog post to it, to get better recommendations and learn from others what they’re using but hopefully also to shine some light on what I am looking for in tools. This is not all of it and I din’t really have time to explain in detail what I’m using specific tools for (I might dedicate some posts over time to this). But at least wanted to give you a first look. So here we go..
In general I have three requirements for tools:
- It should be easy to use & user friendly, no weird interfaces and stuff that only works (90% of my tools).
- The most data/features available, or the opposite: have a very specific focus on 1 element of what I’m looking for.
- They must have an API, so I can build things on top of it, preferably this is included in the pricing of the tool (normal for most tools these days).
Google Search Console, Bing Webmaster Tools, Yandex Webmaster Tools
Obviously Google Search Console is the tool that really matters out of the three. As most of my time is being spent managing our visibility in Google. My favorite reports are Search Analytics for getting a quick overview in our performance (we use most of their data outside of it, by using their API/R library). Structured Data (don’t forget about the Structured Data Testing Tool) to track what we’re doing with Schema.org on our pages. From time to time I might look into the Index Status report when I’m dealing with multiple domains at the same time.
One of the reasons why I like Bing Webmaster Tools is that their Index Explorer enables you to find directories & subdomains that exist on the site. A great benefit if you’re just getting started with a new site. Still after years at The Next Web and these days at Postmates I’m find out about folders or subdomains that you never hear about on a day to day basis but might cause issues for SEO.
Google Analytics & Google Tag Manager
You get the point on this one right? You’re tracking your traffic and the combination of the two can help you track all the contextual data through custom dimensions or other metrics/dimensions that will help you understand your data better. I’ve blogged about them many times on The Next Web while I was there and will remain to do so in the future.
Screaming Frog & Deepcrawl
Getting more insights in your technical structure is super valuable when you’re working on a technical audit. But ScreamingFrog for day to day use for subsets of data and Deepcrawl for weekly all-pages crawls are very powerful and help me get more insights into what kind of pages or segments are creating issues. I like to use them both as they have different reports and certain differences between tools help me better understand issues.
In my current toolset, Botify which I’ll mention later in this document, is a third option.
SEMrush & Google Adwords Keyword Tool
You always want more insights in keywords and you want to know more about them, that’s what both tools are great at. They give you a great basis for a keyword research which you can use as the start of your site’s architecture, keyword structures and internal links structures. In my previous blog post on Google Search Console I kicked off the basis for a keyword research based on that, if you want to take it easy: go with these tools (as a start).
Majestic, might not be the most user friendly (hint & sorry!), but as they have one of the largest indexes it’s great for link research. In this case I definitely value data + quality over the friendliness of the tool.
AuthorityLabs / SERPmetrics
I still deeply believe in using ranking data, as I have the opportunity to do this at large scale & use the data for both national & local level it helps me get a better understanding in what’s happening in the rankings and mostly what’s moving. It doesn’t necessarily have to be that I’m interested in our own rankings or our competitors. But if certain features in the SERP suddenly move up it will help me understand why certain metrics are moving (or not). It’s a great provider of intelligence data that you can leverage for prioritization and measuring your impact.
AuthorityLabs used to be my favourite tool to use, these days as they changed their pricing model I switched over to SERPmetrics.
Botify / Servers
I’ll try to write a follow up blog post on this explaining how this data can help you in getting more insights into the performance of the features/products that you build. But getting more insights from the log file data that you have on your servers can be extremely useful (must add that this is a thing that mostly applies to big site SEO). Right now I’m using Botify for this.
For bigger sites it’s really hard to keep up to date on the latest changes as so many people are working on it. That’s why we want to make sure that you get alerted when important SEO features are changing. We’re using some custom scripts in Google Drive but also like to use SEORadar.
Google Cloud Platform
My former coworker Julian wrote a great blog post on how to scale up ScreamingFrog and run it on a Google Cloud server. It’s one of many use cases why you want to use the Google Cloud Platform. Besides their server, analyzing large data sets with BigQuery (with or without using their Google Analytics connection) provides you with a better ability to handle large sums of data (log file, internal databases, etc.).
- Data: In addition to the tools I just listed, there are a few APIs that I’m using on a regular basis that are making my life easier as they’re providing a lot of data. They’re APIs to retrieve keyword volumes and related keywords, to handle things on a bigger scale you’re going to want to be able to work with APIs instead of dealing with Excel files.
- Reporting: Most of the reports that you’re delivering on can be automated. That is one of the best things that can deliver a great timesaver. By using the Google Analytics reporting in Google Sheets, googleAnalyticsR, SearchConsoleR and the Google Analytics Reporting API V3 and V4.
What am I still looking for?
- Quality Control & Assurance: Weekly crawls aren’t enough if things are messed up. You want to know this on an hourly basis. Mostly when things are moving so fast that you can’t keep track of changes anymore.
- More link data: Next to Majestic it would be great to be able to combine the datasets of others as well when doing this research. Doing this manually is doable but not on a regular basis.
- More keyword data: When you start your keyword research you can just start with a certain set of keywords. But it could be that you’re forgetting about a huge set of keywords in a nice related industry. I’m exploring how to have more keywords to start your keyword research with (we’re not talking about 19 extra keywords here, more like 190.000 keywords).
I’m sure the set of tools will keep evolving over the next months when new things happen. I’d love to learn more about the tools that you’re using. Shoot in the comments or on Twitter what I should be using and I’ll take a look!
Duplicate content is (according to questions from new SEOs and people in online marketing) still one of the biggest issues in Search Engine Optimization. I’ve got news for you, it for sure isn’t as there are plenty of other issues. But somehow it still always comes up to the surface when talking about SEO. As I’ve been on both sides of the equation, having worked for comparison sites and a publisher I want to reflect on both angles. Why I think it’s really important that you see both sides of the picture when looking into why sites could have duplicate content and if they do it on purpose or not.
When I started in SEO about 1211 years ago I worked for a company who would list courses from all around the globe on their website (Springest.com, let’s give them some credit), making it possible for people to compare them. By doing this we were able to create a really useful overview of training courses on the subject of SEO for example. One downside of this was that basically none of the content we had on our site was unique. Training courses are often a very strict program and in certain cases are regulated by the government of institutions to provide the right qualification to attendees. Making it impossible to change any of the descriptions on contents, books or requirements as they were provided by the institutions (read: copy pasted)
Having worked at the complete other side with The Next Web where I had the privilege of working with 10-15 full-time editors all around the globe who write unique, fresh and (news) content on a daily basis. Backed up by dozens of people willing to write for TNW where are presented with the opportunity to chose what kind of posts we publish. It made some things easier, but even at TNW we ran into content issues. The tone of voice over time devalues/changes as editors come and go. But also when you publish more content from guest authors it’s hard to maintain the right balance.
These days I’m ‘back’ with duplicated content, working at Postmates where we work on on-demand delivery. Now it makes it easier to deal with the duplicate content that we technically have from all of the restaurants (it’s published on their own site and on some competitors). But with previous experience it’s way easier to come up with so many more ideas based on the (duplicate) content that you already have. It also made me realize that most of the time you’re always working with something that is duplicate, either it be the product info you have in ecommerce, the industry that you operate in. It’s all about the way you slice and dice it to make it more unique.
In the end, search engine optimization is all about content. Either duplicated or not. We all want to make the best of it and there is always a way to provide a unique angle. Although the angle of the businesses and the way of doing SEO for them is completely different there are certain skills required that I think could provide you with a benefit over a lot of people when you’ve worked with both.
Last year I blogged about using 855 properties to retrieve all your Search Analytics data. Just after that Google luckily released that the limits on the API to retrieve only the top 5000 results had been lifted. Since then it’s been possible to potentially pull all your keywords from Google Search Console via their API (hint: you’re not able to get all the data).
Since I’ve started at Postmates now well over two months ago one of the biggest projects that I started with was getting insights into what markets + product categories we’re already performing OK in from an SEO perspective. With over 150.000 unique keywords weekly (and working on increasing that) it is quite hard to easily get a good grasp on what’s working or not as we’re active in 50+ markets that influence the queries that people are searching for (for example, show me all the queries over a longer period of time with only Mexican in the title across all markets, impossible from the interface). That’s why clicking through the Search Analytics feature in Google Search Console was nice for checking specific keywords quickly, but overall it wouldn’t help in getting detailed insights into what’s working and what’s not.
Some of the issues I was hoping to solve with this approach:
- Pull all your data on a daily basis so you can get an accurate picture of the number of clicks and how that changes over time for a query.
- Hopefully get some insights into the actual number of impressions. Google Adwords Keyword Tool data is still vary valuable but as it’s grouped it can be off on occasion. Google Search Console should be able to provide more accurate data on a specific keyword level.
- Use the data as a basis for further keyword research and categorization.
Having used the Google Search Console API a bit before I was curious to see what I could accomplish pulling in the data on a daily basis and making sense of it (and combining it with other data sets, maybe more on that in later blog posts).
- Daily pull in all the keywords, grouped by landing page so you know for sure you get all the different keyword combinations and your data isn’t filtered by the API.
- Save the specific keyword if we haven’t saved it before, so we know if the keyword was a ‘first-hit’ for the first time.
- For every keyword that you return do another call to the API to get the country, landing pages and metrics for that specific query.
In our case we categorize the keywords right after we pull them in to see if it’s matching a certain market or product category. So far this has been really useful for us as it’s providing way better ways for dashboarding.
Some of the things that I ran into while building out this:
What to look out for?
- The API is very much limiting the keywords that you get to see with only impressions. I was able to retrieve some of the data but on a daily basis the statistics for impressions are off with 50% from what I’m seeing in Google Search Console. However clicks seems to only have a small difference, win!
- Apparently they’re hiding some of the keywords as they qualify them as highly personal. So you’ll miss a certain percentage because of that.
- The rate limits of the Google Search Console aren’t very nice, for over 5k keyword it’s taking quite long to pull in all the data as you have to deal with their rate limits.
Most of these items aren’t really being an issue for us, we have better sources for volume data anyway. In the future we’re hoping to gather more data around different sources to extend that. I’m hoping to blog about somewhere in the future.
Last week was my last one at The Next Web as their Director of Marketing. For the last four years I’ve worked alongside great people: publishing the best content (TNW), organising the best + biggest tech conferences (TNW Conferences), selling the craziest drones (TNW Deals), creating the most beautiful workspace (TQ) and them who collect a ton of data on the global tech industry (Index.co). But still… it’s time for me to move on to something new:
Project: ‘New adventures’
As of Monday I’ll be joining Postmates to help out/lead their SEO strategy, which means I’m already in San Francisco to join the team from there.
For the last 7 years I’ve been maintaining a list of goals that I update every day/week/month with the things I’d like to achieve on a personal and business level in the (near) future. Since my first trip to the US many years ago one of the goals that I created was to move to the Bay Area for x months > x years, mainly to see if my skills would hold up in the more competitive and global area that I consider the Bay Area to be. Having had the ability to spend 6 weeks in/around San Francisco at the end of last year it made it even easier to decide that I wanted to move towards that area the sooner the better.
Having had some very positive changes in my life over the course of the last year it made the choice even easier ? #analyticspowercouple.
In talking to Postmates I found that my passion for SEO, Growth, Analytics, Innovation could even be more stimulated so joining them is a great opportunity to develop myself even more.
Some highlights and numbers from my time at TNW: 8 TNW conferences, 35+ conferences, 60+ flights, xx blog posts, 415 million users, 342 A/B tests, 1465 commits, 231 Gitlab tickets, 111827 messages on Slack.
What I’m not going to miss from my time at TNW:
- The most ridiculous PR pitches from companies that aren’t relevant to TNW 😉
- Product & startup pitches in my inbox that aren’t relevant or not ready for the scale of TNW 😉
- Endless analysis on what content is supposed to attract more engagement + traffic 😉 – Still haven’t found the answer if your curious.
What I’ll be missing though:
- The great opportunity that I got from Boris & Patrick in having me built out the marketing team.
- Very passionate people trying to improve TNW every day just a little bit more.
- A great team, that I’ll truly miss working with.
Overall, I’m ready for the new challenge at Postmates and very enthusiastic about working with a new (growing) team and trying to reach world domination. If you’re around in the future, please let me know. I’ll definitely be sticking to my current strategy: trying to meet with great people across the industry to learn from. So, drinks on me!
If you want to reach out to me, you can find me at: email@example.com
Getting more experience can be hard when you’re just starting with your career. You’re either trying to hope to get into an internship, your first job or if you’re making a career move you just need the experience to keep up. But you’re living in a great time to get there as there are many options available to you to get started, which would almost deserve it’s own blog post. Today I’d like to talk about the idea of giving back to help you get more experience.
Giving back, even if you’re more experienced, is really important in my opinion. There are way too many NGOs, foundations that don’t have the resources (time, tools, people, knowledge, budget) to hire the experts in the field of SEO, Growth, Analytics and CRO. But there are many more opportunities for all of us to give back (our time). I’d like to highlight two initiatives that I’m working with in helping them out but that allow you as well to participate:
- Analysis Exchange: Started by Analytics Demystified to give NGOs the ability to hire a mentor + student to help them with their web analytics projects. The perfect opportunity for people starting in web analytics to get taught by an industry expert in improving their skills. But also a great way for NGOs to get the help from two people during a couple weeks to help them out with their questions.
- MeasureCamp (Amsterdam): A great initiative that MeasureCamp Amsterdam is starting during the next edition is reserving 8 time slots for a foundation/NGO to help them out with ideas from 100+ experts in different areas. That’s basically a hundred hours that day from top experts in the area of data, analytics, SEO and CRO that will get contributed and should help the chosen foundation in improving their web presence.
How are you helping!? What great initiatives am I missing that you & I could contribute our time + knowledge to?