FuzzyWuzzy VS FastText

Do fuzzy matching (something like fuzzywuzzy maybe) to see if the the words line up (allowing for wrong words). You'll need to work out how to use scoring to work out how well aligned the two lists are. Source: over 1 year ago

Convert the original lines to full furigana and do a fuzzy match. (For reference, the original line is 貴方がこれまでに得てきた力、存分に発揮してくださいね。) You can do a regional search using the initial scene data (E60) first, and if the confidence is low, go for a slower full search. Source: over 1 year ago

It's now known as "thefuzz", see https://github.com/seatgeek/fuzzywuzzy. Source: almost 2 years ago

You can have a look at this library to use fuzzy search instead of looking for plaintext muck: https://github.com/seatgeek/fuzzywuzzy. Source: over 2 years ago

To deal with comparing the string, I found FuzzyWuzzy ratio function that is returning a score of how much the strings are similar from 0-100. Source: almost 3 years ago

Here is one library that will be used for the training https://fasttext.cc/ this allows for the consensus across multiple languages so that we can define our mystery word correctly. Source: over 2 years ago

(response to edit) > The classification problem is interesting though. I ended up with a long list of hundreds of topics. Most articles fall in two or more. There's also a sub-problem of clustering news by subject. Yeah, certainly difficult. I'm doing it partially manually right now but also with fastText[1]. I'd like to switch completely to fastText soon though since more often than not the newsletters I add... - Source: Hacker News / almost 3 years ago

I'm planning to build a business on this, so probably won't open-source it--but I'm always looking for interesting things to write about! I write a weekly newsletter called Future of Discovery[1]; I might write up some more implementation details there in a week or two. In the mean time, most of the heavy lifting is done by the Surprise python lib[2]. It's pretty easy to play around with, just give it a csv of... - Source: Hacker News / almost 3 years ago

FastText is a Facebook tool that, among other things, is used to train text classification models. Unlike Tensorflow.js, it is more intended to work with text so we don't need to pass a tensor and we can use the text directly. Training a model with it is much faster and there are fewer hyperparameters. Besides, to use the model from the browser is possible through WebAssembly. So it's a good alternative to try.... - Source: dev.to / almost 3 years ago