Metadata-Version: 2.1
Name: monkey.crawler
Version: 1.0.0.dev4
Summary: Small framework to crawl misc data sources and process records.
Home-page: https://bitbucket.org/monkeytechnologies/monkey-crawler
Author: Xavier ROY
Author-email: xavier@regbuddy.eu
License: Apache License, Version 2.0
Platform: UNKNOWN
Classifier: Programming Language :: Python
Classifier: Development Status :: 1 - Planning
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3.8
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Intended Audience :: Developers
License-File: LICENSE.txt

Monkey Crawler
==============

Small framework to crawl misc data sources and process records.

Installation guide
------------------

::

    pip install monkey.crawler

User guide
----------

Crawler attributes
-source_name: the name that identifies the data source
-handler: the handler that will process every record
-offset: the number of record that will be skipped by the crawler before to start


CSV Crawler
_SOURCE_DELIMITER_KEY = 'source_delimiter'
_SOURCE_FILE_ENCODING_KEY = 'source_encoding'
_SOURCE_FILE_KEY = 'source_file'
_SOURCE_QUOTE_CHAR_KEY = 'source_quote_char'
_COLUMN_MAP_KEY = 'column_map'
_COLUMN_MAP_DELIMITER_KEY = 'column_map_delimiter'
   


