[PgPy] [ python-Bugs-1000359 ] External VARATT/TOAST Support

[noreply at pgfoundry.org]

Bugs item #1000359, was opened at 2005-07-05 03:36
You can respond by visiting: 
http://pgfoundry.org/tracker/?func=detail&atid=442&aid=1000359&group_id=1000094

Category: Backend
Group: To do
Status: Open
Resolution: None
Priority: 5
Submitted By: James Pye (jwp)
Assigned to: James Pye (jwp)
Summary: External VARATT/TOAST Support

Initial Comment:
Currently, the Object interface only provides support for untoasted Datums. This  has the potential to put a substantial burden on memory in situations such as large, externally stored bytea's.

The solution to this problem would be to provide a subtype of Object called ExternalObject. Instances of ExternalObjects would be used/created by lower level instantiation routines when VARATT_IS_EXTERNAL() returns true.

The ExternalObject type would then provide all the necessary conveniences for accessing the data through the appropriate facilities. A new getitem, and probably a file object like interface. read, write, seek, tell, etc...

It seems unlikely that plpy could ever really use compressed attributes. However, it might be nice to have them flagged as compressed and decompress only when accessed so as to save some processing time if the object is not directly interacted with.

----------------------------------------------------------------------

You can respond by visiting: 
http://pgfoundry.org/tracker/?func=detail&atid=442&aid=1000359&group_id=1000094