Pig, a platform/programming language for authoring parallelizable jobs. - Source: dev.to / over 1 year ago

In the early days of the Big Data era when K8s hasn't even been born yet, the common open source go-to solution was the Hadoop stack. We have written several old-fashioned Map-Reduce jobs, scripts using Pig until we came across Spark. Since then Spark has became one of the most popular data processing engines. It is very easy to start using Lighter on YARN deployments. Just run a docker with proper configuration... - Source: dev.to / over 2 years ago

When I click on https://synapsemedia.io/ I get redirected to a link like https://ipfs.io/ipns/synapsemedia.io (to use ipfs.io instead of my local node). Source: about 1 year ago

You may already be aware that the Interplanetary File System or IPFS is a distributed storage network where computers from all over the world form nodes to share data. Source: over 1 year ago

In case of you don't trust them, it gets harder. Especially if you need to have it hosted without any trace to yourself. I'd probably pay a service to store my data on ipfs. You can pay with crypto. But I'm this case there's the question, how will you be able to access it. My thought would be to have a [tails][tails] USB with the necessary software. Source: over 1 year ago

Https://ipfs.io is the only acceptable file host. Source: over 1 year ago

I never click GET button, don't even know what it does tbh XD Those four buttons are for choosing which IPFS gateway you want to use. By default I use ipfs.io, if ipfs.io is down then I click the Cloudflare one. General rule is that you pick one gateway if it does not work then another one and so on. Source: over 1 year ago