Skipped processing large RSS feed

[chrisd]

Hello! I have a self hosted blog, and I recently updated my micro.blog feed to include HTML instead of plain text. Notes on Chris DeLuca

However, the feed never updates on micro.blog, and the activity log shows that the RSS feed is too large.

Example:

 2022-12-05 21:37:42: Feed: Skipped processing large RSS feed 1589814

This has been going on for a few days. My feed is ~850k.

Is there some way I can tell micro.blog to only ingest newer data so it doesn’t have to process the whole feed? Or am I missing some other solution?

Thanks!

[sod]

Hello and welcome!

I don’t know the exact limit, but 1 629 items are probably way too many.

Wordpress RSS feed stopped updating to Micro.blog

I’m experimenting with a change on Micro.blog with how it processes very large RSS feeds, and this has broken some WordPress feeds. Your RSS feed is 400k and has 200+ posts in it. Until I can fix this, I’d suggest limiting your RSS feed in WordPress to only recent posts, like the latest 20 posts. (This limitation also doesn’t apply to JSON Feed if you want to switch to using that.) Sorry about the trouble! I didn’t realize it was going to affect any WordPress feeds. Making your feed shorter wil…

So you will either have to cap the number of posts in your feed or try your luck authoring and providing a JSON Feed instead.

[chrisd]

Ah ha, okay thanks so much! I can write a JSON feed; didn’t realize it had different rate limits!

[manton]

The current limit is 800k for RSS feeds. No limit for JSON. I added this because for huge RSS feeds, it was actually a performance problem in some cases. I’ll eventually remove the limit but it requires a change on our backend to handle more efficiently.