Search results

make context in spider to job_context

Status: Open.

#13 In invana/crawlerflow;

· rrmerugu opened on Jul 23, 2019

Writing a dry run test case mandatory.

Status: Open.

#12 In invana/crawlerflow;

· rrmerugu opened on Jul 18, 2019

use regex for traversals

hot issues

Status: Open.

#11 In invana/crawlerflow;

· rrmerugu opened on Jul 18, 2019

allowed_domains for traversal

hot issues

Status: Open.

#10 In invana/crawlerflow;

· rrmerugu opened on Jul 18, 2019

make settings specific to individual crawlers instead of global settings

Status: Open.

#9 In invana/crawlerflow;

· rrmerugu opened on Apr 10, 2019

specify data type to the extracted data in the data_selectors config

Status: Open.

#7 In invana/crawlerflow;

· rrmerugu opened on Feb 13, 2019

documentation

Status: Open.

#4 In invana/crawlerflow;

· rrmerugu opened on Mar 31, 2018

add expiry of the cache to the feed crawling

Status: Open.

#3 In invana/crawlerflow;

· rrmerugu opened on Mar 18, 2018

determine the url type ?

Status: Open.

#2 In invana/crawlerflow;

· rrmerugu opened on Mar 11, 2018

write unit tests

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1 In invana/crawlerflow;

· rrmerugu opened on Jan 7, 2018