What happens when a SSAS Tabular model exceeds memory?
If you are using the Tabular model in SSAS, it will use the xVelocity technology to load your entire database in memory (greatly compressing the database). So what happens if your database is too big to fit in memory? You will get this error when you process the model:
“The following system error occurred: Insufficient quota to complete the requested service.
Memory error: Allocation failure. If using a 32-bit version of the product, consider upgrading to the 64-bit version or increasing the amount of memory available on the machine.
The current operation was cancelled because another operation in the transaction failed.”
This happens because, by default, no paging to disk is allowed if the data is too big for the amount of available memory on the machine where the model resides. To change this, go to the Analysis Server properties (by right clicking on the Tabular Model server) and change the property VertipaqPagingPolicy to 1 or 2:
- Zero (0) is the default. No paging is allowed. If memory is insufficient, processing fails with an out-of-memory error. All Tabular data is locked in memory
- 1 enables paging to disk using the operating system page file (pagefile.sys). Lock only hash dictionaries in memory, and allow Tabular data to exceed total physical memory
- 2 enables paging to disk using memory-mapped files. Lock only hash dictionaries in memory, and allow Tabular data to exceed total physical memory
Another solution is to use the DirectQuery mode, which bypasses the in-memory model, so client applications query data directly at the source. Then it does not matter how big the database is since you are not using any memory. Of course the trade-off is much slower queries.
More info:
Memory Settings in Tabular Instances of Analysis Services
Undo Bad Tabular Mode Analysis Server Properties
Hi,
Thanks for this useful paper.
Do you know if there is such setting available in PowerPivot ?
Because it is very easy to reach this memory limitation in that tool. I experienced it many times under PowerPivot V1/V2 in 32bits.
Thanks
Eric
Pingback:Really in deep trouble Memory Error allocation Failure
“Zero (0) is the default. No paging is allowed. …..” that’s not true… Default value is 1.