wq.io 0.7.0

wq.io 0.7.0 brings a few API improvements and minor new features.

New Classes

• ZipFileLoader & ZipNetLoader: Automatically extract data from a file stored in a compressed archive.

API improvements

• GIS submodule: Support for as_dataframe() (returns a GeoDataFrame with some help from GeoPandas).
• XmlParser: Search for root_tag (if specified) when parsing XML documents
• New scan_fields option to ensure fields are properly detected for datasets with different fields in each row

wq.io 0.6.2

API Improvements

• Add a as_dataframe() function to BaseIO (#7)
• Always use StringIO.StringIO in Python 2.7

wq.io 0.6.1

• Fix minor issue with exception strings.

wq.io 0.6.0

API Improvements

• Python 3 support (#2)
• Use requests for NetLoader (#3)
• Read and write support in all *FileIO classes (CsvFileIO, JsonFileIO, XmlFileIO, and ExcelFileIO)
• Comprehensive test suite
• More robust pickle support
• Complete docs on extending wq.io

wq.io 0.5.1

API Improvements

• Add Exception subclasses to report common error cases (e.g. LoadFailed, ParseFailed, NoData) - see heigeo/climata-viewer#5
• Make TupleMapper instances pickleable - see heigeo/climata-viewer#8

wq.io 0.5.0

API Improvements

• Formalize notion of a nested IO, or an IO where each record contains a pointer to another IO. This concept is used extensively by the climata library, for example in climata.acis.StationDataIO.
• Added a utility function, flattened(), that converts nested IOs into single-level IOs through denormalization
• Other minor improvements

wq.io 0.4.2

API Improvements

• Don't crash when attempting to parse a non-existent (or empty) CSV file (#5)
• Restore CSV field_names functionality for files without headers (#6)

wq.io 0.4.1

API Improvements

• Cache index in BaseIO to speed up lookups when used as a dict
• Use an array instead of a generator in CsvParser

wq.io 0.4.0

Breaking Changes

• Moved domain-specific contrib modules (cocorahs and hydromet) to the climata library

API Improvements

• Full read-write support for GIS data via the Fiona and Shapely libraries. (#1)
• NetLoaders now send a custom user-agent string.
• Improved guess_type which is now utilized by wq.db.contrib.files.
• Switch to built-in Python XML library to speed up pip install (#4)

wq.io 0.3.0

New Classes & Modules

• TimeSeriesMapper: Automatically maps text values containing dates or numbers to appropriate Python types. TimeSeriesMapper also includes a notion of "key fields" (e.g. date, time, location) as opposed to "parameter fields", or the actual data being recorded in the series.
• make_date_mapper(fmt): Returns a function that parses dates with the provided format string.
• SkipPreludeReader: Subclass of csv.DictReader that allows ingestion of CSV files with non-CSV header preludes.
• contrib.hydromet: IOs for retrieving Hydromet and Agrimet data from http://www.usbr.gov

API improvements

• contrib.cocorahs: CocorahsIO Now utilizes new TimeSeriesMapper

You may also be interested in climata, a new wq.io-based library for loading Applied Climate Information System (ACIS) data.