blob: f8cc23caf0da41a1d3e5450ab73ba5af72575134 [file] [log] [blame] [view]
<!-- This file is machine generated: DO NOT EDIT! -->
# Data IO (Python functions)
[TOC]
## Data IO (Python Functions)
A TFRecords file represents a sequence of (binary) strings. The format is not
random access, so it is suitable for streaming large amounts of data but not
suitable if fast sharding or other non-sequential access is desired.
- - -
### `class tf.python_io.TFRecordWriter` {#TFRecordWriter}
A class to write records to a TFRecords file.
This class implements `__enter__` and `__exit__`, and can be used
in `with` blocks like a normal file.
- - -
#### `tf.python_io.TFRecordWriter.__init__(path, options=None)` {#TFRecordWriter.__init__}
Opens file `path` and creates a `TFRecordWriter` writing to it.
##### Args:
* <b>`path`</b>: The path to the TFRecords file.
* <b>`options`</b>: (optional) A TFRecordOptions object.
##### Raises:
* <b>`IOError`</b>: If `path` cannot be opened for writing.
- - -
#### `tf.python_io.TFRecordWriter.write(record)` {#TFRecordWriter.write}
Write a string record to the file.
##### Args:
* <b>`record`</b>: str
- - -
#### `tf.python_io.TFRecordWriter.close()` {#TFRecordWriter.close}
Close the file.
#### Other Methods
- - -
#### `tf.python_io.TFRecordWriter.__enter__()` {#TFRecordWriter.__enter__}
Enter a `with` block.
- - -
#### `tf.python_io.TFRecordWriter.__exit__(unused_type, unused_value, unused_traceback)` {#TFRecordWriter.__exit__}
Exit a `with` block, closing the file.
- - -
### `tf.python_io.tf_record_iterator(path, options=None)` {#tf_record_iterator}
An iterator that read the records from a TFRecords file.
##### Args:
* <b>`path`</b>: The path to the TFRecords file.
* <b>`options`</b>: (optional) A TFRecordOptions object.
##### Yields:
Strings.
##### Raises:
* <b>`IOError`</b>: If `path` cannot be opened for reading.
- - -
### TFRecords Format Details
A TFRecords file contains a sequence of strings with CRC hashes. Each record
has the format
uint64 length
uint32 masked_crc32_of_length
byte data[length]
uint32 masked_crc32_of_data
and the records are concatenated together to produce the file. The CRC32s
are [described here](https://en.wikipedia.org/wiki/Cyclic_redundancy_check),
and the mask of a CRC is
masked_crc = ((crc >> 15) | (crc << 17)) + 0xa282ead8ul