PyTables A package for managing hierarchical datasets and designed to efficently cope with extremely large amounts of data
Download

PyTables Ranking & Summary

PyTables Tags

manage manipulate dataset manager dataset manipulation dataset management dataset

PyTables Description

A package for managing hierarchical datasets and designed to efficently cope with extremely large amounts of data PyTables is built on top of the HDF5 library and the NumPy package and features an object-oriented interface that, combined with C-code generated from Pyrex sources, makes of it a fast, yet extremely easy to use tool for interactively save and retrieve large amounts of data.One important feature of PyTables is that it is capable of optimizing disk resources and memory so that data takes much less space (specially if on-flight compression is used) than other solutions such as relational or object oriented databases. What's New in This Release: Small enhancements: · openFile(), isHDF5File() and isPyTablesFile() functions accept Unicode filenames now. Closes #202 and #214. · When creating large type sizes (exceeding 64 KB), HDF5 complained and refused to do so. The HDF5 team has logged the issue as a bug, but meanwhile it has been implemented a workaround in PyTables that allows to create such large datatypes for situations that does not require defaults other than zero. Addresses #211. · In order to be consistent with how are stored the other data types, Unicode attributes are retrieved now as NumPy scalars instead of Python Unicode strings or NumPy arrays. For the moment, I've fixed this through pickling the Unicode strings. In the future, when HDF5 1.8.x series would be a requirement, that should be done via a HDF5 native Unicode type. Closes #213. Bug fixes: · Fixed a memory leak when a lot of queries were made. Closes #203 and #207. · The chunkshape="auto" parameter value of Leaf.copy() is honored now, even when the (start, stop, step) parameters are specified. Closes #204. · Due to a flaw in its design, the File class was not able to be subclassed. This has been fixed. Closes #205. · Default values were not correctly retrieved when opening already created CArray/EArray objects. Fixed. Closes #212. · Fixed a problem with the installation of the nctoh5 script that prevented it from being executed. Closes #215. · The iterseq cache ignored non-indexed conditions, giving wrong results when those appeared in condition expressions. This has been fixed. Closes #206.

PyTables Related Software