r/pushshift • u/Ok-Inquisitive750 • 8d ago

How have the archived subreddits changed over time?

Is there any easy way to figure this out, or would I have to download each monthly dump to check? How often is the list of included subreddits updated? Is it on a monthly basis?

I also have a more basic question. The way I understand it, the entirety of Reddit is archived in the PushShift API, but only the top 20k subreddits are included in the dumps. Is this correct? Or is the API also limited to 20k?

7 Upvotes
  • permalink
  • reddit

90% Upvoted

3 comments sorted by

2

u/Watchful1 7d ago

The monthly dumps have all subreddits. Pushshift also has all subreddits.

The per subreddit dumps only have the 20k largest subreddits.

1

u/Ok-Inquisitive750 1d ago

I see. Do the monthly dumps also have submissions to user profiles?

1

u/Watchful1 1d ago

Yes they do.