0
$\begingroup$

One of the fun things to do with WL is to examine datasets from various sources. In doing so, I have encountered an error that I have not previously observed. Upon creation of two datasets in the lower right of the dataset there appears a button that indicaes "Data Not Saved", which upon hovering over it, indicates that the "Object can not be used for input".

A previous question, /30149, suggested that this issue arises from the fact that the dataset is larger than the

$NotebookInlineStorageLimit

, which is set to 2^20 bytes by default. This is in fact the case, for the two datasets I have imported. Consequently, I set the $NotebookInlineStorageLimit as

 $NotebookInlineStorageLimit = 2^30

which is larger than the byce count for either. However, the error button persisted. Turning off the Dynamic Updating also suggested as a fix eliminated display of the datasets.

The two datasets used here were downloaded from:

EMBER World Electricity Data

  worldEnergyDataEMBER = 
  Import["https://storage.googleapis.com/emb-prod-bkt-publicdata/public-downloads/yearly_full_release_long_format.csv", "CSV"]
 headers = 
 First[worldEnergyDataEMBER];
 data = Rest[worldEnergyDataEMBER];
 emberWorldDataset = 
 Dataset[AssociationThread[headers, #] & /@ data]
 ByteCount[emberWorldDataset]

 europeanEnergyDataEMBER = 
 Import["https://storage.googleapis.com/emb-prod-bkt-publicdata/public-downloads/europe_yearly_full_release_long_format.csv", "CSV"];
 headersEurope = 
 First[europeanEnergyDataEMBER]
 dataEurope = 
 Rest[europeanEnergyDataEMBER];
 emberEuropeanDataset = Dataset[AssociationThread[headersEurope, #] & /@ dataEurope]
    ByteCount[emberEuropeanDataset]

Can anyone explain why increasing the $NotebookInlineStorageLimit to a size greater than either dataset did not eliminate the error from appearing?

Improve this question
$\endgroup$
3
  • $\begingroup$ Did you create evaluate the Dataset[... line again after increasing the limit? Can't use your example but works for my experiments. $\endgroup$ Commented Jan 2 at 8:10
  • $\begingroup$ I execute the $NotebookInlineStorageLimit = 2^30 prior to executing the commands to create the dataset. Unfortunately, the error messages still appears even though the ByteCount for the emberWorldDataset is 1008955256, which is less than 2^30 = 1073741824. Hence, I remain mystified. WL has no problem actually creating or displaying the dataset, other than tagging it with the error. $\endgroup$ Commented Jan 17 at 21:24
  • $\begingroup$ Looking more closely and changing the $NotebookInlineStorageLimit = 2^40, which is definitely larger still generates the error, even after having put ClearAll at the top of the file and reevaluating. Likewise, for quiting the kernal, then restarting and then reevaluating still leaves the error in place. $\endgroup$ Commented Jan 17 at 21:40

0

Reset to default

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.