Building a dev.to analytics dashboard using OpenSearch

CMS Data Management Custom Search Engine

OpenSearch Landing Page

1

OpenSearch

OpenSearch is a community-driven, open source search and analytics suite derived from Apache 2.0 licensed Elasticsearch 7.10.2 & Kibana 7.10.2. It consists of a search engine daemon, and a visualization and user interface, OpenSearch Dashboards.

Now I know I've got some data I could use, I now need to find a platform that I can use to analyse the data coming from the Forem API. I did consider some other pieces of software, such as Google BigQuery (with looker studio) and ElasticSearch (with Kibana), I ultimately went with OpenSearch which is essentially a forked version of ElasticSearch maintained by AWS. The main reasons are that I could host it locally for free (unlike BigQuery). I do have some prior experience with both elastic (back when it was called ELK) and OpenSearch, but my work with OpenSearch was far more recent, so I decided to go with that.

#Custom Search Engine #Search Engine #Custom Search 25 social mentions
OpenAPI Generator Landing Page
2

OpenAPI Generator

OpenAPI Generator enables you to generate documentation, clients, and servers from OpenAPI 2.0/3.x documents without hassle.
Pricing:
- Open Source
While I could have written out a full API to talk to the Forem API, this would have taken a long time and I had an OpenAPI spec document, so I used OpenAPI Generator which can pretty much instantly generate a full API integration, just from the OpenAPI spec. While I'm using C# and .Net 6, this tool has a pretty large list of supported languages, so if you wanted to code something similar, you could absolutely use your language of choice, rather than C#.

#Development #Tool #Online Services 39 social mentions
DEV.to Landing Page

3

DEV.to

Where software engineers connect, build their resumes, and grow.

-a, --articleGatherer (Default: true) Whether the article gatherer is enabled -f, --followerGatherer (Default: true) Whether the follower gatherer is enabled -f, --GatherData (Default: once per day) How often to gather data in TimeSpan format -k, --ApiKey The API key used to connect to the Forem API -n, --NodeList A list of opensearch nodes -b, --BasePath (Default: https://dev.to) The base path of the Forem site --help Display this help screen. --version Display version information.

#CMS #Blogging #Blogging Platform 387 social mentions
Cloudinary For Video Landing Page

4

Cloudinary For Video

Cloud Video Management Solution, Made For & By Developers

Now I've got data into the OpenSearch Dashboard, I need to analyse the data. To start with, I used the Discover tool to see if there was interesting, which I did find pretty quickly, such as DEV using Cloudinary for image storage and that I've been fairly consistent in releasing articles:.

#Developer Tools #Javascript UI Libraries #Runtime 112 social mentions
Google BigQuery Landing Page
5

Google BigQuery

A fully managed data warehouse for large-scale data analytics.
Pricing:
- Open Source
Now I know I've got some data I could use, I now need to find a platform that I can use to analyse the data coming from the Forem API. I did consider some other pieces of software, such as Google BigQuery (with looker studio) and ElasticSearch (with Kibana), I ultimately went with OpenSearch which is essentially a forked version of ElasticSearch maintained by AWS. The main reasons are that I could host it locally for free (unlike BigQuery). I do have some prior experience with both elastic (back when it was called ELK) and OpenSearch, but my work with OpenSearch was far more recent, so I decided to go with that.

#Data Management #Data Warehousing #Data Dashboard 35 social mentions