Cognite extractor-utils package
The extractor-utils package is an extension of the Cognite Python SDK intended to simplify the development of data extractors for Cognite Data Fusion.
Installation
To install this package:
pip install cognite-extractor-utils
If the Cognite SDK is not already installed, the installation will automatically fetch and install it as well.
To get going, consult the Quickstart
Contents
- Quickstart
- Remote configuration
- Package reference
- Base class for extractors
configtools
- Utilities for reading, parsing and validating config filesthrottle
- Tools for throttlingmetrics
- Automatic pushers of performance metricsstatestore
- Storing extractor state between runs locally or remotelyAbstractStateStore
AbstractStateStore.delete_state()
AbstractStateStore.expand_state()
AbstractStateStore.get_state()
AbstractStateStore.initialize()
AbstractStateStore.outside_state()
AbstractStateStore.post_upload_handler()
AbstractStateStore.set_state()
AbstractStateStore.start()
AbstractStateStore.stop()
AbstractStateStore.synchronize()
LocalStateStore
NoStateStore
RawStateStore
uploader
- Batching upload queues with automatic upload triggersutil
- Miscellaneous utilities