Python Playground

I am hoping for some help in opening a corrupted HDF5 file. I am accessing PyTables via Pandas, but… Read more Opening A Corrupted Pytables Hdf5 File

I have one some data which looks something like this: Generated by trjconv : P/L=1/400 t= 0.00000… Read more How To Split The Data Among The Multiple Groups In Hdf5 File?

I'm on pandas 0.14.1. Assume I need to index data by two timestamps in a hierarchical index usi… Read more Losing Timezone-awareness When Saving Hyerarchical Pandas Datetimeindex To Hdf5 In Python

Using Numpy and h5py, it is possible to create ‘compound datatype’ datasets to be stored in an hdf5… Read more H5py: Compound Datatypes And Scale-offset In The Compression Pipeline

I just tried using the IncrementalPCA from sklearn.decomposition, but it threw a MemoryError just l… Read more Incremental Pca On Big Data

Is there any way to store an array in an hdf5 file, which is too big to load in memory? if I do som… Read more How To Store An Array In Hdf5 File Which Is Too Big To Load In Memory?

I am trying to store about 3000 numpy arrays using HDF5 data format. Arrays vary in length from 530… Read more Saving With H5py Arrays Of Different Sizes

I'm running into trouble reading a hdf5 matlab 7.3 file with Python. I'm using h5py 2.0.1. … Read more Loading Hdf5 Matlab Strings Into Python

I've spent the day trying to get the h5py module of python working, but without success. I'… Read more Installing H5py On Os X

Got a big data-set that I want to shuffle. The entire set won't fit into RAM so it would be goo… Read more Python: Can I Write To A File Without Loading Its Contents In Ram?

i cant do the isntall of tables lib in my windows enviorment and cant found a solution, the error i… Read more Error To Install Lib Tables, Cant Find Hdf5 In Windows

There is a dramatic slowdown when inserting many datasets into a group. I have found that the slowd… Read more Inserting Many Hdf5 Datasets Very Slow

I'm trying to create some simple HDF5 datasets that contain attributes with a compound datatype… Read more Creating Hdf5 Compound Attributes Using H5py

I have several big HDF5 file stored on an SSD (lzf compressed file size is 10–15 GB, uncompressed s… Read more How To Speed Up Reading From Compressed Hdf5 Files

I am trying to read a .h5 file data.h5, which has 2 datasets, 'Data' and 'metaData'… Read more Python H5py - Why Do I Get A Broadcast Error?

How to open a HDF5 file with pandas.read_hdf when the keys are not known? from pandas.io.pytables … Read more Typeerror: Read_hdf() Takes Exactly 2 Arguments (1 Given)

I was able to modify the cache settings of an HDF5 file by combining both the high and low level Py… Read more How To Close An Hdf5 Using Low Level Python Api?

Does anyone know how to make the modification of the following code so that I can read the specific… Read more Read Specific Z Component Slice Of 3D HDF From Python

I am collecting a large amount of data that will be saved into individual H5 files using h5py. I wo… Read more Generating Pcolormesh Images From Very Large Data Sets Saved In H5 Files With Python

How to open a HDF5 file with pandas.read_hdf when the keys are not known? from pandas.io.pytables … Read more TypeError: Read_hdf() Takes Exactly 2 Arguments (1 Given)