Databricks Reviews and details

Social recommendations and mentions

• dolly-v2-12b

  Dolly-v2-12bis a 12 billion parameter causal language model created by Databricks that is derived from EleutherAI’s Pythia-12b and fine-tuned on a ~15K record instruction corpus generated by Databricks employees and released under a permissive license (CC-BY-SA). Source: about 1 year ago

• Clickstream data analysis with Databricks and Redpanda

  Global organizations need a way to process the massive amounts of data they produce for real-time decision making. They often utilize event-streaming tools like Redpanda with stream-processing tools like Databricks for this purpose. - Source: dev.to / over 1 year ago

• DeWitt Clause, or Can You Benchmark %DATABASE% and Get Away With It

  Databricks, a data lakehouse company founded by the creators of Apache Spark, published a blog post claiming that it set a new data warehousing performance record in 100 TB TPC-DS benchmark. It was also mentioned that Databricks was 2.7x faster and 12x better in terms of price performance compared to Snowflake. - Source: dev.to / almost 2 years ago

• A Quick Start to Databricks on AWS

  Go to Databricks and click the Try Databricks button. Fill in the form and Select AWS as your desired platform afterward. - Source: dev.to / about 2 years ago

• data science workspace/notebook solution thoughts?

  I am considering Hex, Deepnote, and possibly Databricks. Does anyone have any experience using the first 2 (i have worked with Databricks in the past) and have thoughts they can share? The company isn't doing any fancy data science so far so I mostly want it for deep product analytics which I can turn into reports that are easily shareable across the org. That being said, I do want to get into statistical... Source: about 2 years ago

• The Big Data Game – Because even a simple query can send you on an unexpected journey. Help the 8-bit data engineer to get the data

  Another data pipe, in the background Databricks, a data lake (A data lake is a storage repository that holds a vast amount of raw data in its native format until it is needed for analytics applications. While a traditional data warehouse stores data in hierarchical dimensions and tables, a data lake uses a flat architecture to store data, primarily in files or object storage.), and Elastic which is a search tool,... Source: about 2 years ago

• 3 industries that raise the most money from investors

  Databricks is a data and AI company that interacts with corporate information stored in the public cloud. They've raised $3.5 Billion already in 9 founding rounds. Source: about 2 years ago

• Industry use cases for Spark/pySpark?

  I would argue that databricks moves Spark close to being a competitive data warehouse as well. Source: about 2 years ago

• Integration Testing Done Right

  In the project I’m currently working on, we have a component called the Integration Component (IC). IC is a Spring Boot service that acts as a consumer and a producer of RabbitMQ messages. As a consumer, it listens to a queue where another service sends job requests. IC reads those messages (job requests), processes them and finally sends an HTTP request to Databricks to run a job. Before we submit the request... - Source: dev.to / about 2 years ago

• I'm 54, learning Python, been out of IT for 10 years, any advice?

  New versions of default shell have autocompletion (not as I good as ipython's). Jupyter-notebook is web version of ipython, there are a lot of nice things you can do with it. I am using it for example for an issue investigation or prototyping, you extract data, make preview, show steps how to get results, can add markdown notes - all reproducible and exportable (html/pdf/python file/notebook). A lot of web/cloud... Source: over 2 years ago

• Dreaming and Breaking Molds – Establishing Best Practices with Scott Haines

  Scott: Yeah. So this is a program that just kicked off, and it's for people not like working for Databricks who are part of the community and helping to teach and evangelize or mentor new people. - Source: dev.to / over 2 years ago

• What libraries do you use for machine learning and data visualizing in scala?

  It depends on what kind of visualization you would like to get. https://databricks.com notebooks provide very basic visualization tools, such as histograms, line charts, etc. For Sparks datasets and dataframes. Source: over 2 years ago

• MDS Newsletter #8

  #2 Featured tools this week- Databricks and Adverity. Source: over 2 years ago

• Data Science toolset summary from 2021

  Databricks - Databricks is an enterprise software company founded by the creators of Apache Spark. The company has also created Delta Lake, MLflow and Koalas, open source projects that span data engineering, data science and machine learning. Link - https://databricks.com/. - Source: dev.to / over 2 years ago

• notebooks: do you love them or do you hate them?

  I recently stumbled on this talk from a few years ago by joel grus on why notebooks suck. there's been a lot of innovation in the space since (with products like databricks, deepnote, hex, etc.), but a lot of the fundamental flaws of notebooks still exist. Source: almost 3 years ago

• 6 Money-making Strategies Used by Companies with Open Source Projects

  With the growing popularity of open source technology, venture capital (VC) investments in open source technology have increased. For instance, the company Databricks is the largest contributor to the open source Apache Spark project. Recently, Databricks received a $1 billion series G investment! - Source: dev.to / about 3 years ago

• Automating Databricks with Bash

  This is a collection of most common bash scripts to automate Databricks. - Source: dev.to / about 3 years ago