2023-09-07 10:41:53 [scrapy.core.engine] ERROR: Scraper close failure Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/twisted/internet/defer.py", line 892, in _runCallbacks current.result = callback( # type: ignore[misc] File "/Users/luojunhui/cyber/gzh_spider/gzh_spider/pipelines.py", line 41, in close_spider with open(self.queue_path, "w", encoding="utf-8") as f: OSError: [Errno 30] Read-only file system: '/message_queue_2.json' 2023-09-07 17:37:05 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): User timeout caused connection failure: Getting https://mp.weixin.qq.com/cgi-bin/searchbiz took longer than 180.0 seconds.. 2023-09-07 17:37:25 [scrapy.core.scraper] ERROR: Error downloading Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/twisted/internet/defer.py", line 1693, in _inlineCallbacks result = context.run( File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/twisted/python/failure.py", line 518, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/downloader/middleware.py", line 54, in process_request return (yield download_func(request=request, spider=spider)) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/twisted/internet/defer.py", line 892, in _runCallbacks current.result = callback( # type: ignore[misc] File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/downloader/handlers/http11.py", line 397, in _cb_timeout raise TimeoutError(f"Getting {url} took longer than {timeout} seconds.") twisted.internet.error.TimeoutError: User timeout caused connection failure: Getting https://mp.weixin.qq.com/cgi-bin/searchbiz took longer than 180.0 seconds.. 2023-09-08 16:20:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:16 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:20 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:20 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:22 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:22 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:26 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:26 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:26 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:29 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:29 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:29 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:32 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:32 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:35 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:35 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:37 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:39 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:42 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:45 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:48 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:50 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:53 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:55 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:20:59 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:01 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:03 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:05 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:16 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:20 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:23 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:27 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:30 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:34 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:37 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:39 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:41 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:44 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:48 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:50 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:52 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:55 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:21:59 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:22:01 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:22:04 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:22:05 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:22:05 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code 2023-09-08 16:22:05 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/defer.py", line 74, in mustbe_deferred result = f(*args, **kw) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 94, in _process_spider_input return scrape_func(response, request, spider) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/core/scraper.py", line 209, in call_spider warn_on_generator_with_return_value(spider, callback) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 263, in warn_on_generator_with_return_value if is_generator_with_return_value(callable): File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/site-packages/scrapy/utils/misc.py", line 239, in is_generator_with_return_value src = inspect.getsource(func) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1024, in getsource lines, lnum = getsourcelines(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 1006, in getsourcelines lines, lnum = findsource(object) File "/Users/luojunhui/miniconda3/envs/Spider/lib/python3.9/inspect.py", line 835, in findsource raise OSError('could not get source code') OSError: could not get source code