Repositories list

• Zeno

  Public
  State-of-the-art web crawler 🔱

  web-crawlerarchivingzeno

  HTML

  •

  GNU Affero General Public License v3.0

  •11•83•26•5•Updated Dec 2, 2024Dec 2, 2024

• openlibrary

  Public
  One webpage for every book ever published!

  open-sourcebooksinternet-archive+ 2hacktoberfestlibrary-catalogue

  Python

  •

  GNU Affero General Public License v3.0

  •1.4k•5.3k•817•154•Updated Dec 2, 2024Dec 2, 2024

• bookreader

  Public
  The Internet Archive BookReader

  ebooksbookreaderhacktoberfest+ 1internetarchive

  JavaScript

  •

  GNU Affero General Public License v3.0

  •419•998•134•88•Updated Dec 1, 2024Dec 1, 2024

• heritrix3

  Public
  Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

  warcheritrixwebcrawling+ 1java

  Java

  •

  Other

  •762•2.8k•33•5•Updated Nov 30, 2024Nov 30, 2024

• gocrawlhq

  Public
  Go client for Crawl HQ v3

  Go

  •0•0•0•1•Updated Nov 29, 2024Nov 29, 2024

• iaux-collection-browser

  Public
  TypeScript

  •

  GNU Affero General Public License v3.0

  •1•5•2•13•Updated Nov 29, 2024Nov 29, 2024

• rclone

  Public
  [vault fork] of "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

  Go

  •

  MIT License

  •4.2k•2•0•0•Updated Nov 29, 2024Nov 29, 2024

• iaux-typescript-wc-template

  Public template
  IAUX Typescript WebComponent Template

  TypeScript

  •

  GNU Affero General Public License v3.0

  •4•7•3•11•Updated Nov 28, 2024Nov 28, 2024

• iaux-modal-manager

  Public
  A Modal Manager WebComponent

  TypeScript

  •

  GNU Affero General Public License v3.0

  •1•1•1•12•Updated Nov 28, 2024Nov 28, 2024

• iaux-monthly-giving-circle

  Public
  TypeScript

  •

  GNU Affero General Public License v3.0

  •0•0•1•11•Updated Nov 28, 2024Nov 28, 2024

• iaux

  Public
  Monorepo for Archive.org UX development and prototyping.

  JavaScript

  •

  GNU Affero General Public License v3.0

  •86•67•88•144•Updated Nov 27, 2024Nov 27, 2024

• Sparkling

  Public
  Internet Archive's Sparkling Data Processing Library

  Scala

  •

  MIT License

  •2•11•1•0•Updated Nov 27, 2024Nov 27, 2024

• archiveorg-e2e-playwright

  Public
  TypeScript

  •2•2•0•0•Updated Nov 27, 2024Nov 27, 2024

• iiif

  Public
  The official Internet Archive IIIF service

  hacktoberfest

  JavaScript

  •

  GNU General Public License v3.0

  •4•22•17•2•Updated Nov 26, 2024Nov 26, 2024

• brozzler

  Public
  brozzler - distributed browser-based web crawler

  Python

  •

  Apache License 2.0

  •97•673•33•13•Updated Nov 26, 2024Nov 26, 2024

• openlibrary-bots

  Public
  A repository of cleanup bots implementing the openlibrary-client

  Python

  •

  Other

  •49•62•27•8•Updated Nov 25, 2024Nov 25, 2024

• wayback-custom-view

  Public
  components for IA Wayback Machine to render legacy medias and data in human friendly fashion

  Python

  •0•0•0•0•Updated Nov 25, 2024Nov 25, 2024

• www

  Public
  archive.org website prototype - using only javascript static files

  javascriptweb-componentslit+ 1deno

  JavaScript

  •

  GNU Affero General Public License v3.0

  •0•2•0•0•Updated Nov 24, 2024Nov 24, 2024

• newsum

  Public
  Daily TV News Summary using GPT

  pythontvopenapi+ 6internet-archivesummarizationgptgdeltnews-summarizationtv-news

  Python

  •

  GNU Affero General Public License v3.0

  •4•21•1•1•Updated Nov 23, 2024Nov 23, 2024

• wayback-radial-tree

  Public
  JavaScript

  •

  GNU Affero General Public License v3.0

  •8•7•2•0•Updated Nov 22, 2024Nov 22, 2024

• wayback-diff

  Public
  React components to render differences between captures at the Wayback Machine

  JavaScript

  •

  GNU General Public License v3.0

  •8•32•1•1•Updated Nov 22, 2024Nov 22, 2024

• iaux-item-userlists

  Public
  Add/remove item to userlists on Details page

  TypeScript

  •

  GNU Affero General Public License v3.0

  •1•1•0•1•Updated Nov 22, 2024Nov 22, 2024

• tarb_insights

  Public
  A Streamlit application to visualize Wikipedia IABot statistics

  pythondockerdata-science+ 7statisticswikipediainsightsinternetarchivestreamlitiabotinternetarchivebot

  Python

  •

  GNU Affero General Public License v3.0

  •1•2•0•0•Updated Nov 21, 2024Nov 21, 2024

• internetarchivebot

  Public
  botphpcomposer+ 2webservertor

  PHP

  •

  GNU Affero General Public License v3.0

  •33•127•0•2•Updated Nov 21, 2024Nov 21, 2024

• iare

  Public
  An interactive IARI JSON viewer

  JavaScript

  •

  GNU Affero General Public License v3.0

  •4•5•33•1•Updated Nov 21, 2024Nov 21, 2024

• iari

  Public
  Import workflows for the Wikipedia Citations Database

  Python

  •

  GNU General Public License v3.0

  •9•11•56•0•Updated Nov 21, 2024Nov 21, 2024

• iaux-book-actions

  Public
  IA lending bar controls for bookreader

  JavaScript

  •

  GNU Affero General Public License v3.0

  •0•2•1•3•Updated Nov 20, 2024Nov 20, 2024

• web_collection_search

  Public
  An API wrapper to the Elasticsearch index of web archival collections and a web UI to explore those indexes.

  Python

  •

  GNU Affero General Public License v3.0

  •5•8•2•0•Updated Nov 19, 2024Nov 19, 2024

• gospn

  Public
  Save Page Now client in Go

  Go

  •

  GNU Affero General Public License v3.0

  •1•5•0•0•Updated Nov 18, 2024Nov 18, 2024

• gifcities

  Public
  gifcities.org web app

  Go

  •

  GNU Affero General Public License v3.0

  •0•2•1•0•Updated Nov 15, 2024Nov 15, 2024