Data Miner VS Datomic

• User-Friendly Interface
  Data Miner offers a clean and intuitive user interface that allows users to easily navigate and set up web scraping tasks without requiring extensive technical knowledge.
• Browser Extension
  Being available as a browser extension for both Chrome and Edge makes it easy to install and use directly within the browser, without needing separate software installations.
• Pre-built Recipes
  Data Miner provides a library of pre-built recipes for common web scraping tasks, enabling users to quickly deploy scrapers without starting from scratch.
• Custom Recipes
  Users have the option to create custom recipes, offering flexibility and the ability to tailor scraping tasks to specific needs.
• Cloud Storage
  Offers cloud storage options that allow users to save and manage their scraped data directly on the platform for easy access and organization.
• Export Options
  Supports multiple export formats like CSV, XLS, and Google Sheets, making it easy for users to integrate scraped data with other tools and workflows.
• Scheduling
  Allows users to schedule scraping tasks, automating the data collection process at specified intervals.

Possible disadvantages

• Limited Free Tier
  The free version of Data Miner is limited in terms of the number of rows and pages that can be scraped, which may not be sufficient for more extensive data collection needs.
• Learning Curve
  While the interface is user-friendly, there can still be a learning curve for users unfamiliar with web scraping concepts and the tool itself.
• Browser Dependence
  As Data Miner is a browser extension, its functionality is limited to the browser environment, which might not be ideal for more complex or large-scale web scraping tasks.
• Potential Website Restrictions
  Some websites actively prevent scraping activities, which could limit the effectiveness of Data Miner on certain web pages.
• Subscription Cost
  Advanced features and higher usage requirements necessitate a subscription plan, which may be costly for individual users or small businesses.
• Reliance on Internet Stability
  As an online tool, its performance can be hindered by poor internet connectivity, potentially disrupting the scraping process.

• Immutability
  Datomic employs an append-only data model where data is never overwritten but instead appended, ensuring historical data is always available and providing strong consistency.
• Time Travel Queries
  Datomic allows you to query the database as of any point in time, facilitating auditing and debugging by allowing easy access to historical data states.
• Rich Data Model
  Supports complex data types like maps and sets directly within its schema, providing a flexible way to represent data.
• ACID Transactions
  Datomic supports fully ACID-compliant transactions, ensuring reliable and predictable database operations.
• Scalability
  Separates storage and compute, allowing for horizontal scaling of read operations, making it suitable for handling large datasets.
• Query Flexibility
  Offers a powerful query language that supports recursive queries, making it suitable for complex data retrieval needs.

Possible disadvantages

• Complexity
  The architecture of Datomic can be complex to understand and implement, particularly for teams unfamiliar with its design principles.
• Cost
  Can be expensive to operate, especially in a cloud environment, where costs increase with the amount of data stored and the compute resources required.
• Limited Write Throughput
  Due to its append-only design, Datomic can have limited write throughput, which may not be suitable for applications with heavy write requirements.
• Closed Source
  Datomic is a proprietary database system, which may not appeal to organizations that prefer open-source solutions.
• Learning Curve
  Requires a learning curve as its conceptual model and query language are different from traditional databases, potentially requiring additional training.
• Dependency on AWS
  Relying on AWS ecosystem for the storage backend can limit choices for deployment environments, impacting flexibility.

No analysis of Datomic yet.

Data Miner 4.0

KotlinConf 2018 - Datomic: The Most Innovative DB You've Never Heard Of by August Lilleaas

More videos

• A list of SaaS, PaaS and IaaS offerings that have free tiers of interest to devops and infradev

  Data Miner - A browser extension (Google Chrome, MS Edge) for data extraction from web pages CSV or Excel. The free plan gives you 500 pages/month. - Source: dev.to / over 2 years ago

• What's something you'd like to see implemented on AO3?

  The web app at https://dataminer.io/. If you open it on your Saved for Later page, it should show you a public "recipe" that I made to scrape the data. Possibly others as well. Source: almost 4 years ago

• free-for.dev

  Data Miner - A browser extension (Google Chrome, MS Edge) for data extraction from web pages CSV or Excel. The free plan gives you 500 pages/month. - Source: dev.to / almost 4 years ago

View more

Tracking Datomic since Mar 2021.