Software Engineering Daily

Podsheets is a set of open source tools for podcast hosting, publishing, ad management, community engagement, and more.

Podsheets is influenced by our experience managing Software Engineering Daily, a full-time podcast business.

Software Engineering Daily is a podcast that airs 5 times per week. With 4 ads per show and 50 business weeks per year, we have 1000 podcast ads that we manage per year. Podcast ad sales is an inefficient market, and the tooling around managing ads for the individual podcaster is poor.

Difficulties in the podcast ecosystem also exist for new podcasters. It is still very confusing to get started as a podcaster. Podcasting should be as easy as blogging but remains far from it.

Podsheets serves the use cases of all podcasters — from beginners to full-time professionals.

In this document, we outline the landscape of podcasting. We describe the major corporate players, the workflow of a podcaster, and the mechanics of running a podcast business.

Next, we present Podsheets, a set of open source tools for podcasters.

Finally, we give our predictions for how the media landscape will shift in the coming years, creating a need for more open source media publishing tools.

The State of Podcasting

Podcasting has been having a renaissance over the last five years.

In 2014, the launch of Serial coincided with improvements to cellular bandwidth in the US. It was now possible to stream podcasts from your phone easily and cheaply. There was great content to listen to, and the improved infrastructure made it listenable.

Still, podcasting remained in a fractured stalemate for five years after the launch of Serial. This was due to the fact that Apple had first-mover advantage as the dominant podcast index, but Apple opted not to capitalize on that fact. This is understandable, as Apple’s core competency is futuristic hardware, and its resources are allocated to business lines such as self-driving cars and augmented reality glasses.

In 2019, Spotify acquired Gimlet (a source of premium podcast content) and Anchor (the most popular, simplest podcast host). Spotify is making a play at consolidating the market of podcasting. Spotify has a clear path to becoming the “YouTube of podcasts”, which we should all celebrate as a long time coming.

At the same time, we recognize the hunger for decentralized media platforms. The centralization of video content within YouTube has driven conspiracy theory, ad fraud, and other problems that are difficult for a centralized player to solve. These problems manifest for text as well, and Twitter CEO Jack Dorsey has spoken enthusiastically about the potential for blockchain technology to improve trust for applications such as Twitter.

Podcasts have suffered and benefited from the lack of centralization. As the podcast world swings towards a centralized marketplace, there is a need for a countermovement towards open, decentralized infrastructure.

The Players

Below is an overview of the types of players in the podcasting ecosystem.

Today’s ecosystem is fragmented and messy. The line between podcast networks, ad agencies, and production studios is blurry.

Podcasters

Individual podcasters range from small, unmonetized podcasts to individuals with millions of listeners.

The staff for an individual podcaster may include ad sales, editing, scheduling, and technical operations such as website management. The individual podcaster might hire these people on full- or part-time basis.

To sell ads, a podcaster often works with a podcast ad agency. The podcaster might join a podcast network to consolidate inventory with other podcasters.

Some podcasts, such as Software Engineering Daily, manage all their ad sales in-house. This requires demanding sales activities such as prospecting, account management, close management, and client services.

Podcast Production Studios

NPR, Gimlet, and Vox Media are examples of podcast production studios. These companies own physical studio space to produce high quality audio content on a regular basis.

Podcast Networks

Earwolf, Nerdist, and Podcast One are examples of podcast networks. A podcast network combines the inventory available across multiple podcasts in order to sell more efficiently to advertisers.

Spotify

Spotify is perfectly positioned to become the YouTube of podcasts.

With its acquisition of Anchor, Spotify has a real chance at capturing the creation, distribution, hosting, and automated monetization of podcasts.

With its acquisition of Gimlet Media, Spotify gains high quality content, established production processes, and sales teams. Gimlet was co-founded by Alex Blumberg, whose roots in NPR give Spotify knowledge of the entire history of the modern audio space.

Apple

Apple maintains the central index of podcasts.

Other podcast indexes are usually built by scraping Apple. Compared to its available resources, Apple has invested almost nothing into podcasting over the last five years. Its biggest milestone is a detailed analytics tool that lets podcasters see detailed data on when users are dropping off from podcasts.

Apple Podcast Analytics is a seemingly simple tool, but not trivially easy to build and deploy. It could be a bellwether for more vigorous technical investments.

In any case, Apple could have acted sooner. Apple could have poured money into podcasting at any point in the last 5 years. Why hasn’t Apple become the Spotify of podcasts?

• Apple could be apathetic about podcasts. When you are managing the iPhone supply chain and building self-driving cars, it’s hard to care about mp3 files and RSS feeds.
• Apple could be enthusiastic about the fractured state of the ecosystem. Apple is a subtly rebellious company, and podcasts are perhaps the most rebellious content medium today.
• Apple could be marshalling the troops for its own grab at the YouTube of podcasts. Apple is easing into high-quality original content production for TV. If Apple has a desire to expand into a multimedia network, it has that option.

Apple has been historically willing to pursue last-mover advantage. Perhaps we will see more investment in podcasting from Apple in the near future.

YouTube

YouTube is relevant because searching for individual podcast episodes is currently immature.

As an example, try searching Google for podcasts where Seth Godin talks about his childhood. Seth Godin has been on many podcasts, and has written many blogs. It is easy to find the blogs where he talks about his childhood. But the podcasts are much harder.

Many podcasts are not transcribed, so there is not a good index of what is said on that podcast episode — unless someone proactively transcribes the audio. YouTube automatically transcribes the videos that are uploaded. This allows YouTube to offer contextual ads as well as closed captioning.

In order to get your podcast on YouTube, you need to convert each audio file into a video and upload it to YouTube. Most podcasters don’t want to bother with this.

To summarize: YouTube has the best search engine for individual podcast episodes — except that many podcasts are not on YouTube.

If you are not a YouTube Red subscriber, your video will stop playing when you lock the screen on your phone. In order to exclusively listen to a YouTube video, you need to be a YouTube Red subscriber.

Podcast Ad Agencies

Individual podcasters who do not want to sell ads but do want to have advertisements can enlist the help of a podcast ad agency. The biggest advertisers in the podcast space (Squarespace, Audible, ZipRecruiter, etc) purchase inventory through these agencies.

Agencies have huge informational advantage because they see both sides of the market in real time. They see the volume of inventory in different podcast segments, CPMs, CPCs, and CLTVs.

The big ad agencies are viciously exploitative of their leverage over podcasters. The perversions of podcast ad sales are beyond the scope of this document. But it is important to note that podcast agency ad sales is an inefficient market.

Regarding ad sales, consolidation towards Spotify is a coin flip — it could make things worse for podcasters or could make things better.

Podcasters should have a viable option for managing their own ad inventory.

This explains the eponymous “sheet” in Podsheets. Software Engineering Daily (and many other podcasts) maintains a detailed spreadsheet for managing inventory.

We’ll discuss the importance of the podcast spreadsheet, and our vision for podcast production and ads management later in the document.

Other Players

Google Podcasts, Overcast, Pandora, Libsyn, and other products in the space also represent important facets of this ecosystem. The above list of players is not comprehensive.

Influencer Marketing Predicts The Future Of Podcast Marketing

The best podcast ads are personal testimonials that are spliced into the episodes.

Podcast ads are a form of influencer marketing. This is in stark contrast to the world of TV commercials, which are produced wholly by the product companies themselves.

Influencer marketing has not consolidated into automated auctions in the way that advertising platforms like Facebook and Google ads have consolidated. Influencer marketing has matured into a fractured, inefficient ecosystem that bears many similarities to the podcast ecosystem.

We can look at the social media influencer marketing space as a leading indicator of where the podcast market is headed, and a few points are worth considering:

1. Influencer marketing agencies take an enormous cut from both the advertisers and the influencers.
2. Influencers who have been in business for a few years realize they can make more money (and better sponsored content) if they deal directly with brands.
3. As influencers have become more savvy, the market for influencer SaaS tools has expanded to serve the needs of influencers. These SaaS tools let an influencer operate like a personalized multimedia platform without the need for agency middlemen.

As of March 2019, the influencer ecosystem is evolving even further, with adoption of technologies such as Patreon and Discord.

How To Manage A Podcast With Ads

Software Engineering Daily has 5 shows per week, 4 ads per show, 50 weeks per year, for a total of 1000 podcast ads. We manage our ad inventory and show production process in a spreadsheet, which is shown below.

As we sell podcast ads, we schedule them onto episodes in our upcoming show calendar. Our inventory (on the right) is updated as we schedule ads (on the left).

Here is a list of complexities we deal with related to advertising:

• Prospecting: how do we find potential companies who want to buy our ads?
• Lead management: how do we work a prospect through the sales process and eventually close a deal?
• Close management: once a deal is closing, how do we issue the contract?
• Accounting: how do we issue invoices and get paid?
• Transparency: how does an advertiser know that we are airing our ads when we say we will?
• Reporting: how do we communicate statistics around our ads and episodes?
• Account management: how do we retain an advertiser and keep them happy?
• Ad scheduling: how does an advertiser pick which episodes to air their ads on?
• Ad insertion: how do we communicate to our podcast editor which ads to insert and at what timestamps?

We address these complexities through a combination of spreadsheets, emails, CRMs, accounting tools, Slack workflows, and contractors. With Podsheets, we hope to consolidate much of this work into a single technology.

We do not expect to replace everything — but we have a clear vision for a set of tools that are custom built for podcasters to manage their media businesses.

At Software Engineering Daily, we work hard to sell our podcast ad inventory. But we are sacrificing a lot of value because we are struggling with our tooling, and struggling with an undeveloped advertising ecosystem.

When we splice in podcast ads, that podcast ad is usually going to be in the podcast audio for the lifetime of the podcast. At Software Engineering Daily, we do not use “dynamic insertion”. But we would like to.

Dynamic insertion allows podcasters to easily change the ads that are spliced into their podcast episodes. Dynamic insertion can mean two things:

• A podcaster manually changes the ads that are spliced into an episode. Example: podcaster releases episode X on January 3rd. 6 months later, podcaster changes the ads which are spliced into that episode. This can be useful for podcasts with “evergreen” content.
• Podcast ads are inserted on-the-fly based on the persona of the listener. Example: you listen to 4 episodes of Software Engineering Daily in a row about Bitcoin. Then you start listening to an episode about JavaScript. When you load this episode, we insert an ad for a Bitcoin-related product just before you start listening.

Dynamic insertion is an important consideration for the future of podcasting, as we explain later in this post.

Podcast Surveillance

Before we discuss Podsheets, one more point around the downsides of podcast market consolidation towards platforms like Spotify and YouTube.

When you listen to a podcast on a naive podcast player, there is usually not a system monitoring what words you are hearing. In its most basic form, a podcast player is a dumb mp3 player reading from dumb RSS infrastructure.

Many podcast consumers like things this way. Podcast feels distinctly like radio or old school television. When you listen to a podcast about topic X on a dumb podcast player, you do not immediately start seeing display ads around the Internet for X.

Let’s understand why this is the case.

There is no transcript that has been aligned with timestamps in the audio. Because of this, there can be no natural language processing over this stream of audio. You cannot see improved search results, ad targeting, or content recommendations based on the content you listen to.

Depending on who you are, this is a benefit or a disadvantage. As blockchain technology improves, the Internet will offer a more granular range of surveillant media outlets. Some people will choose surveillance + convenience, other people will choose privacy.

Until we have blockchain-powered media, podcasting remains one of the few bastions of semi-private media consumption.

Today, podcasting is not surveillant because the infrastructure is immature. Transcription and audio alignment powered by deep learning remains expensive. As these costs drop, podcasting will become increasingly surveilled.

Today’s podcast infrastructure is decentralized, and not heavily surveilled. Market consolidation into companies like Spotify and YouTube will increase that surveillance.

Podsheets

Podsheets is an open source platform for podcasters.

Podsheets will allow a podcaster to accomplish the following:

• Host their podcast’s audio files, website content, and RSS feed on a backing storage medium of their choice
• Manage the audio files to do updates in their ads and other dynamic insertions
• Manage ad inventory and communicate that inventory to potential advertising customers
• Allow for a podcaster to offer subscriptions or donations
• Give every podcast its own social network for its listeners

We believe the following about our users:

• Podsheets should feel like a simple, vertical solution for a nontechnical podcaster
• Podsheets should feel like a modular toolset for a technical podcaster
• Podsheets should feel like decomposable media platform software for a developer

Current State of Podsheets

As of 3/20/19, Podsheets is a simple tool for hosting a podcast. It fulfills the minimum needs for a podcaster.

Here is the interface for publishing and editing an episode.

Here is the public website view.

Our design is minimalistic because podcasting is a minimalistic system. A podcast hosting tool is simply an interface for publishing and editing an RSS feed of text and audio files.

Podsheets is built in React and Node. The audio files are stored in Google Cloud Storage. Our podsheets.com live version of the site is on Heroku.

Podsheets is open source on GitHub.

The rest of this section describes a specification for Podsheets. We will explain the name “Podsheets” and describe the features that an open source podcast hosting platform needs to compete with closed source companies.

We argue that podcasting can be improved by the introduction of open source tools that empower a podcaster to the same extent as closed source platforms.

There are many parallels between the world of open source software and podcasts. Podcasting feels free and open. Podcast content is useful and rebellious.

We hope to build a community of people who are excited about open source podcasting.

To build Podsheets, we need help from many types of people: designers, writers, engineers, podcasters, podcast listeners, and QA testers. If you want to get involved, follow our FindCollabs project and see our roles for contribution.

Spreadsheets: The Ultimate Tool For Media Planning

Advertising is how most podcasters make their living.

Paid subscriptions and donations are also important to the podcasting ecosystem, and we will explore those monetization options later in the post. This section is about the tooling that Podsheets will offer for advertising-based podcasters.

Advertising allows podcasters to run their own media company. One beauty of podcast advertising is that it can connect small audiences with products that those audiences have a genuine need for. Podcasters can find advertisers that do not compromise their views.

Podcasters need a way to manage their own ad inventory. Without the option to self-manage, podcasters will turn to centralized solutions such as Spotify and media agencies.

Why the name “Podsheets”?

We believe that managing the ad inventory of a podcast is best handled by a dynamic spreadsheet view that would allow podcasters to change their scheduled ads by simply changing a row in a spreadsheet-like view.

Advertising is central to the life of a podcaster. A podcaster needs to find ad deals and manage the production of their advertising content. The advertising needs to be harmonious with the podcast content.

Many podcasters are solo entrepreneurs. They do not have employees. They are doing everything themselves. A dynamic spreadsheet allows a podcaster to manage the podcast along with their advertising.

Our perspective on the importance of the podcast spreadsheet comes from personal experience of running Software Engineering Daily. We have scheduled roughly 3000 ads across all of our episodes.

Let’s revisit the spreadsheet we use to plan our podcast episode calendar.

This spreadsheet is used for:

• Planning our show schedule
• Budgeting and scheduling ads
• Communicating our upcoming shows to advertisers who may want to buy targeted ads on those shows
• Notating edits that we need to communicate to our audio editor

Experienced podcasters who I have spoken to all have a similar spreadsheet, Trello board, or show management tool.

Podcasters Need Dynamic Insertion

Podsheets will allow the spreadsheet view to be tied to the current state of a given podcast episode.

This will enable easy dynamic podcast ad management. It also gives a place for podcast editors, hosts, producers, and operations members to collaborate.

Self-managed, dynamic ad insertion allows a podcaster to control their own media platform and earn more money.

It’s important to emphasize how much money a podcaster is giving up without dynamic insertion. This is because podcasts are “evergreen content”. Listeners are often seeking out episodes that are 1–10 years old. Listeners who hear these episodes are listening to old ads, which are not paying a podcaster any more.

Let’s illustrate with an example.

Below is a row from our Software Engineering Daily management spreadsheet. This row is an episode from 2/1/2018, which was an interview with Zhamak Deghani. We had 4 ads scheduled on that show: OutSystems, Datadog, Microsoft, and GoCD.

Below is a chart showing the last 3 months of listens to our interview with Zhamak.

Most podcast ads are sold on a 6–36 week performance basis. When we sell Software Engineering Daily ads that are permanently embedded in the audio file, the advertiser is only judging us based on the performance over the next 6–36 weeks. This means that the downloads that we get after 36 weeks are not monetized.

Over the last 3 months, we have had 206 listens to this episode. At a $25 CPM (lower bound pricing for a podcast with a technical audience), that’s $5 we left on the table. We have roughly 1000 episodes in our back catalog, which means that we could have earned $5000 in additional ad sales if we could have easily sold and dynamically inserted this new ad inventory.

Podcasters with a large back catalog need a way to dynamically change the ad inventory.

The only available solutions are closed source, expensive products such as Megaphone. Megaphone hosts the shows for some of the biggest podcasters in the world, including Malcolm Gladwell.

The relationship between a podcaster and a closed source hosting and dynamic insertion platform is similar to the relationship between YouTubers and YouTube.

We are lucky to live in a time when the centralized options such as Megaphone and YouTube allow so many small media platforms to thrive. But we need options that are more portable, and are not overseen by monolithic institutions.

Podcasters make much more money from dynamic insertion.

To the extent that dynamic insertion technology is centralized, podcasting will be centralized.

Podsheets Dynamic Insertion

How would dynamic insertion work in Podsheets?

Let’s revisit the Software Engineering Daily spreadsheet from earlier, zooming in on a week in March 2018.

As a reminder, these ads are no longer generating any revenue for Software Engineering Daily. But the episodes are still getting listens.

Those ad deals were made in January 2018, and we were paid by the end of March. By the time the month of June started, we were in talks with some of these sponsors to renew their ads, and other sponsors chose not to renew.

Now let’s imagine we enter into a negotiation with Audible. Audible wants to buy 2,000 podcast episode listens at a cost of $25 CPM, coming out to a total cost of $50. In an ideal world, we would be able to serve those podcast ads on any episodes that get listens — including old episodes.

Editing old episodes requires splicing out the ads in the old audio file and splicing in the new ads to the file. This is a time-consuming process to do in an audio editing tool like Audacity or GarageBand.

For each audio file you would want to edit, you would need to do the following:

1. Find the start and end timestamp of the old ad you want to replace.
2. Remove audio from the old ad
3. Compare the length of time of the old ad to the length of time of the new ad. If the new ad is longer, you will need to move the post-ad portion of your podcast audio file to a later start point based on the difference in time between the old and new ad. If the new ad is shorter, you will do the same movement in the opposite direction.
4. Insert the new ad in the space between the two portions of the podcast audio file.

Closed-source tools like Megaphone include a script that lets you dynamically insert ads easily. Such a script can be created with FFmpeg, an open source tool for editing media files.

Podsheets will require a similar script for doing this ad splicing.

In Podsheets, we should be able to change the ads inserted in a particular episode as simply as changing the entry in our spreadsheet, illustrated below.

Under the covers, this change to the spreadsheet interface should trigger our FFmpeg script to run and replace the ads from these podcasts.

In addition, our system should register that these episodes now have an Audible ad. Our stats tracking system should aggregate the new listens that these episodes get, so that we can easily evaluate the number of listens we have received across the Audible campaign.

One downside of this system is that it requires podcasters to notate the timestamps of the initial ads in their episodes. For podcasters who can afford it, this notation exercise can be outsourced to digital knowledge workers, or to podcast audio editors.

The example of a podcaster easily changing 5 ads is simple but powerful.

On top of this spreadsheet-plus-podcast-editing interface, a podcaster could write macros to run their own creative campaigns.

For example:

• Serve ads to users in specific geographies based on IP address
• Serve ads on all episodes about a specific topic
• Make all the ad schedules across your entire inventory the same, so that you could quickly run bulk campaigns on short notice
• Make all your episodes ad-free, or run your own personal calls-to-action when you do not have ad inventory to sell
• Dynamically serve super cheap “remnant” advertising when you do not have any other ad inventory to sell

Additionally, such a spreadsheet creates a flexible shared interface. A podcaster could make this spreadsheet public, allowing advertisers to buy ads on episodes in a “self-service” fashion. The Podsheets ecosystem could develop other rich interfaces to allow a podcaster to broadcast their advertising options and explain their process for working with advertisers.

Decentralized Advertising

If you are not a podcaster, the ability to dynamically manage your ad inventory may not sound like a killer feature.

Understand that advertising is how podcasters make most of their money. That is not likely to change in the near future. Podcasters need advertisers. Podcasters need technology to manage their advertisements.

Why are there so many frictions in podcast advertising? Podcast advertising is decentralized.

Podcasters can and should manage their own ad inventory.

The world of podcasts is in a different universe than the rest of the Internet. Podcast advertising has moved us beyond the bureaucracy of advertising agencies, the menacing opacity of corporate advertising duopolies, and the ineffectiveness of one-size-fits-all advertising units.

With Podsheets, we can build a tool for empowering podcasters — and paint a picture for how other media formats can decentralize as well.

The Future of Media

Podcasting represents the future of media.

Consider the following three aspects of the podcast ecosystem:

• Consumers are extremely happy with the state of podcasting. There is no shortage of content. Listeners are finding comfort and joy in their podcast listening habits.
• Content producers have control of their content. In contrast to Facebook, Twitter, and YouTube, it is almost impossible to get de-platformed or de-monetized as a podcaster.
• Advertisers are seeing excellent results. Most podcast advertising is highly measurable direct response campaigns with ads read by the host. This format resonates with consumers.

Every constituent in podcasting is happy. Podcasting’s decentralized nature allows the actors to operate independently. The podcast ecosystem has self-organized into a beautiful, chaotic, positive sum environment.

Centralized platforms like YouTube, Twitter, and Facebook have enabled all of us to connect with each other. Centralization allows for economies of scale that would not exist in a fragmented, decentralized ecosystem. But that centralization also comes at a cost.

We need centralized platforms.

We need Twitter to create a town square for us all to connect within. We need Facebook to onboard new Internet users with a system that is more intuitive than the open web. We need Google to unify our intellect.

But we also need decentralization.

Decentralized technologies give us fresh, fertile ground to play with on the Internet. To see this in action, look no further than podcasts. The decentralized model of podcasting will spread across other mediums, notably video and social networking.

In the long term, Podsheets should allow podcasters to move up the stack, and own their own entire platforms, all built on open source software.

A Social Network For Every Podcast

Software Engineering Daily is built on WordPress. We use WordPress to publish our podcast episodes and share basic text and audio information with our listeners.

WordPress was built as a publishing tool, not a social network. Software Engineering Daily has a community of 30,000 frequent listeners and 150,000+ occasional listeners, and they want to connect with each other. Two years ago, our community started working on an open source platform called Software Daily.

Software Daily gives us the following tools that we cannot offer through WordPress:

• Comments, forums, and profiles that allow users to connect with each other
• Advanced indexing and search functionality
• Subscription offerings, so that users can pay us to opt out of advertising
• “Related Links”, a wiki-like feature that allows users to add additional resources

Software Daily also has mobile apps. This allows us to offer a logged-in experience to podcast listeners so we can customize their experience based on what episodes they listen to. Our mobile apps can be used to listen to our episodes without ads using our paid subscription feature.

Software Daily iOS app

This functionality would be a useful option to any podcaster with a substantial community. Software Daily is completely open source and could be reconfigured to work for any podcast.

In the future, Podsheets could allow a quick and easy way to spin up your own social network for your podcast.

Software Daily Android app

This standalone podcast social network could also serve as a tool for a podcaster to organize events, manage donations, build an email list, sell e-commerce, and any other functionality that requires a user login.

The Coming Disaggregation

Open source software has disaggregated the infrastructure layer. But open source does not replace the proprietary layer. It gives users another option. We have Linux in addition to Windows. We have Android in addition to iOS.

The same phenomenon is coming to the application layer. We will see open source, easily manageable alternatives to YouTube, Instagram, and Netflix. Text publishing has already been disaggregated by WordPress. Audio publishing has been disaggregated by podcasts.

With Podsheets, we hope to give podcasters an alternative to the centralized networks. But it is an adjunct alternative, not a complete replacement. A podcaster does not need to opt out of the centralized ecosystem completely to use Podsheets.

As the cost of computing and storage drops to zero, the media landscape will change in favor of the creators. Raw resources will not be scarce, but creativity and entrepreneurship will always be scarce.

Video has not been disaggregated yet, possibly due to the size of video files. Social networks have not been disaggregated yet, perhaps because of the importance of strong recommendation systems, search algorithms, and other complexities that are required to make a decent social network.

Eventually, video creators and social media influencers will want tools to build and manage their own platforms. In the limit, every media company becomes a social media company. And every social media company wants its own platform.

The golden age of decentralized media starts with podcasting. Let’s hope it never ends.

The post Podsheets: Open Source Podcasting appeared first on Software Engineering Daily.