Luigi Reviews

Google App Engine Reviews

Luigi mentions (9)

• Ask HN: What is the correct way to deal with pipelines?

  I agree there are many options in this space. Two others to consider: - https://airflow.apache.org/ - https://github.com/spotify/luigi There are also many Kubernetes based options out there. For the specific use case you specified, you might even consider a plain old Makefile and incrond if you expect these all to run on a single host and be triggered by a new file... - Source: Hacker News / 8 months ago

• In the context of Python what is a Bob Job?

  Maybe if your use case is “smallish” and doesn’t require the whole studio suite you could check out apscheduler for doing python “tasks” on a schedule and luigi to build pipelines. Source: almost 2 years ago

• Lessons Learned from Running Apache Airflow at Scale

  What are you trying to do? Distributed scheduler with a single instance? No database? Are you sure you don't just mean "a scheduler" ala Luigi? https://github.com/spotify/luigi. - Source: Hacker News / about 2 years ago

• Apache Airflow. How to make the complex workflow as an easy job

  It's good to know what Airflow is not the only one on the market. There are Dagster and Spotify Luigi and others. But they have different pros and cons, be sure that you did a good investigation on the market to choose the best suitable tool for your tasks. - Source: dev.to / over 2 years ago

• DevOps Fundamentals for Deep Learning Engineers

  MLOps is a HUGE area to explore, and not surprisingly, there are many startups showing up in this space. If you want to get it on the latest trends, then I would look at workflow orchestration frameworks such as Metaflow (started off at Netflix, is now spinning off into its own enterprise business, https://metaflow.org/), Kubeflow (used at Google, https://www.kubeflow.org/), Airflow (used at Airbnb,... Source: over 2 years ago

Google App Engine mentions (26)

• A Brief History Of Serverless

  In 2008, Google launched AppEngine. This product predates the formal existence of Google Cloud and can be considered Google Cloud's first offering. - Source: dev.to / 16 days ago

• CQL Trace Viewer: Visualizing CQL Traces with Dash

  To deploy the app, we can use Google Cloud App Engine, which is specifically built for server-side rendered websites. After we create a new project in the Google Cloud Console, we have to configure the cql-trace-viewer application. - Source: dev.to / 12 months ago

• Which service to host a Discord bot?

  I've read that article, but I'm thinking there are other better (and most importantly cheaper) ways of doing that, such as using App Engine (given that you have to mitigate the maximum request timeout and to make sure there are constantly exactly 1 instance running). Source: about 1 year ago

• Using NextJs for front-end only?

  Shout out to GCP App Engine for deploying anode/Express severe. Source: about 1 year ago

• What will Komi's resume look like?

  If your project is a bit more complicated using next.js or react.js or angular.js, you may find some free Platfrom-as-a-Service%20is%20a%20complete%20cloud%20environment,middleware%2C%20tools%2C%20and%20more.). I have seen some of my peers using free PaaS like Heroku, Vercel and I have no experience in using PaaS but I will recommend you to use PaaS from either of the three 1. Google Cloud's Google App Engine 2.... Source: about 1 year ago