Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.
Nietzsche
A Serverless application that fetches quotes from Goodreads and saves it to DynamoDB. (About 88K+ unique quotes)
It also includes:
- Quotes Search API
- Tweet Quotes
Architecture
High Level Block Diagram
Quote Tweet State Machine
Requirements
Setup
- Get Twitter API keys
aws ssm put-parameter --name nietzsche-twitter-consumer-secret --type String --value $CONSUMER_SECRET --profile default --overwrite --region eu-west-1aws ssm put-parameter --name nietzsche-twitter-consumer-key --type String --value $CONSUMER_KEY --profile default --overwrite --region eu-west-1aws ssm put-parameter --name nietzsche-twitter-access-token --type String --value $ACCESS_TOKEN --profile default --overwrite --region eu-west-1aws ssm put-parameter --name nietzsche-twitter-access-token-secret --type String --value $ACCESS_TOKEN_SECRET --profile default --overwrite --region eu-west-1npm i
Deploy
npm run deploy
Invoke
Start Quotes Scrapping Job
serverless invoke -f dispatchScrappers --stage prod
Tweet Random Quote
serverless invoke stepf --name tweetQuoteStateMachine --stage prod
Contribute
Help make this app better and future proof.
- Clone the code
- Install the dependencies with
npm install - Create a feature branch
git checkout -b new_feature - Lint with standard
npm run lint
License
This software is released under the MIT license. See the license file for more details.