Skip to content

asimov-modules/asimov-apify-module

Repository files navigation

ASIMOV Apify Module

License Package on Crates.io Package on PyPI Package on RubyGems Package on NPM

ASIMOV module for data import powered by the Apify web automation platform.

✨ Features

  • Imports structured data from Apify actors (web automation scripts).
  • Collects the raw JSON data via the Apify API (requires an API token).
  • Constructs a semantic knowledge graph based on the KNOW ontology.
  • Supports plain JSON output as well as RDF output in the form of JSON-LD.
  • Distributed as a standalone static binary with zero runtime dependencies.

🛠️ Prerequisites

  • Rust 1.85+ (2024 edition) if building from source code

⬇️ Installation

Installation from PyPI

pip install -U asimov-apify-module

Installation from RubyGems

gem install asimov-apify-module

Installation from NPM

npm install -g asimov-apify-module

Installation from Source Code

cargo install asimov-apify-module

👉 Examples

export APIFY_TOKEN="..."

Fetching Google Results

asimov-apify-fetcher  https://www.google.com/search?q=Isaac+Asimov  # JSON
asimov-apify-importer https://www.google.com/search?q=Isaac+Asimov  # JSON-LD

Fetching X (Twitter) Followers

asimov-apify-fetcher  https://x.com/apify/followers  # JSON
asimov-apify-importer https://x.com/apify/followers  # JSON-LD

Fetching X (Twitter) Followees

asimov-apify-fetcher  https://x.com/apify/following  # JSON
asimov-apify-importer https://x.com/apify/following  # JSON-LD

Fetching LinkedIn Profile

asimov-apify-fetcher  https://www.linkedin.com/in/sarptecimer  # JSON
asimov-apify-importer https://www.linkedin.com/in/sarptecimer  # JSON-LD 

Fetching Instagram Profile

asimov-apify-fetcher  https://www.instagram.com/humansofny  # JSON
asimov-apify-importer https://www.instagram.com/humansofny  # JSON-LD 

⚙ Configuration

Environment Variables

📚 Reference

Installed Binaries

  • asimov-apify-fetcher: collects JSON data from the Apify API
  • asimov-apify-importer: collects and transforms JSON into JSON-LD

Supported Actors

Actor URL Pattern JSON RDF
Google Search https://www.google.com/search?q=:query
X (Twitter) Followers https://x.com/:account/followers
X (Twitter) Followees https://x.com/:account/following
LinkedIn Profile https://www.linkedin.com/in/:username 🚧
Instagram Profile https://www.instagram.com/:username 🚧

👨‍💻 Development

git clone https://github.com/asimov-modules/asimov-apify-module.git

Share on X Share on Reddit Share on Hacker News Share on Facebook Share on LinkedIn

About

✅ ASIMOV module for data import powered by the Apify web automation platform.

Topics

Resources

License

Security policy

Stars

Watchers

Forks

Contributors 3

  •  
  •  
  •