November 29, 2022
  • November 29, 2022
  • Home
  • Data programming
  • Snowflake embraces data programming (and Slootman writes another book) – Blocks and Files

Snowflake embraces data programming (and Slootman writes another book) – Blocks and Files

By on November 27, 2020 0


Snowflake cloud data warehouse updated its product with access to unstructured data, data service providers, extended data entry, and row access policies. Plus, CEO Frank Slootman wrote another book.

Let’s talk about the book first. With co-author Steve Hamm, Slootman wrote “Rise of The Data Cloud”. You can read a example chapter to see if you want it as a Christmas present ($ 16.84 hardcover on Amazon). Slootman clearly enjoys writing – or ghost writing – lark. In 2009, he wrote “TAPE SUCKS: Inside Data Domain, A Silicon Valley Growth Story”. Now back to Snowflake.

The company, which benefited from the largest software IPO ever in September, is expanding its data ingestion pipeline and increasing customer data processing services in its warehouse.

Benoit Dageville

“Many organizations today are still struggling to mobilize all of their data to serve their business,” said Benoit Dageville, Co-Founder and President of Snowflake Products, in a statement.

“The Data Cloud contains a massive amount of data from Snowflake customers and commercial data providers, creating a powerful global data network effect to mobilize data to drive innovation and create new revenue streams. “

Data in the Snowpark

SnowPark is a new data entry portal where data engineers, data scientists, and developers can write code in the language of their choice, using familiar programming concepts, and then run workloads like as ETL / ELT, data preparation and functionality engineering on Snowflake. It brings more data pipelines into Snowflake’s core data platform and is currently available in test environments.

The company has added more than 100 data service providers to Snowflake Data Marketplace, which allows customers to discover and access third-party datasets live, ready to query, without the need to copy files or move the data. Services such as performing a risk assessment, behavioral scoring, predictive and prescriptive data analysis may be outsourced to a data service provider.

Snowflake announced private preview support for unstructured data such as audio, video, PDFs, imagery data, and more, which will orchestrate the pipeline runs of these. data. It looks like specific types of unstructured data, not general file storage data.

Future row access policies will allow Snowflake clients to create policies to restrict the result sets returned when running queries. By creating a global policy to restrict access to row data in its database, users no longer need to ensure that their queries contain all the correct constraints every time. This feature is slated for a private preview before the end of the year.

Leave a comment

Your email address will not be published.