2023-09-05 18:10:20 [scrapy.utils.log] INFO: Scrapy 1.5.0 started (bot: magic_mirror) 2023-09-05 18:10:20 [scrapy.utils.log] INFO: Versions: lxml 4.5.1.0, libxml2 2.9.10, cssselect 1.1.0, parsel 1.6.0, w3lib 1.22.0, Twisted 18.9.0, Python 3.6.7 (default, Oct 22 2018, 11:32:17) - [GCC 8.2.0], pyOpenSSL 19.1.0 (OpenSSL 1.1.1g 21 Apr 2020), cryptography 2.9.2, Platform Linux-4.15.0-29-generic-x86_64-with-Ubuntu-18.04-bionic 2023-09-05 18:10:20 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'magic_mirror', 'DOWNLOAD_DELAY': 3, 'DOWNLOAD_TIMEOUT': 200, 'DUPEFILTER_CLASS': 'scrapy_redis.dupefilter.RFPDupeFilter', 'LOG_FILE': '/home/ubuntu/project/spider/logs/magic_mirror/awtmt/5f5c6df14bd411ee9fbdfa163e6898ec.log', 'NEWSPIDER_MODULE': 'magic_mirror.spiders', 'RETRY_HTTP_CODES': [500, 503, 504, 400, 403, 404, 408, 302, 304], 'RETRY_TIMES': 5, 'SCHEDULER': 'scrapy_redis.scheduler.Scheduler', 'SPIDER_MODULES': ['magic_mirror.spiders']} 2023-09-05 18:10:20 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats'] 2023-09-05 18:10:20 [py.warnings] WARNING: /home/ubuntu/.local/lib/python3.6/site-packages/scrapy/utils/deprecate.py:156: ScrapyDeprecationWarning: `scrapy.contrib.downloadermiddleware.useragent.UserAgentMiddleware` class is deprecated, use `scrapy.downloadermiddlewares.useragent.UserAgentMiddleware` instead ScrapyDeprecationWarning) 2023-09-05 18:10:20 [py.warnings] WARNING: /home/ubuntu/.local/lib/python3.6/site-packages/scrapy/utils/deprecate.py:156: ScrapyDeprecationWarning: `scrapy.contrib.downloadermiddleware.httpproxy.HttpProxyMiddleware` class is deprecated, use `scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware` instead ScrapyDeprecationWarning) 2023-09-05 18:10:20 [py.warnings] WARNING: /home/ubuntu/.local/lib/python3.6/site-packages/scrapy/utils/deprecate.py:156: ScrapyDeprecationWarning: `scrapy.contrib.downloadermiddleware.retry.RetryMiddleware` class is deprecated, use `scrapy.downloadermiddlewares.retry.RetryMiddleware` instead ScrapyDeprecationWarning) 2023-09-05 18:10:20 [py.warnings] WARNING: /home/ubuntu/.local/lib/python3.6/site-packages/scrapy/utils/deprecate.py:156: ScrapyDeprecationWarning: `scrapy.contrib.downloadermiddleware.cookies.CookiesMiddleware` class is deprecated, use `scrapy.downloadermiddlewares.cookies.CookiesMiddleware` instead ScrapyDeprecationWarning) 2023-09-05 18:10:20 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'magic_mirror.spiders.random_proxy.RandomProxy', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'magic_mirror.spiders.rotate_useragent.RotateUserAgentMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2023-09-05 18:10:20 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2023-09-05 18:10:20 [scrapy.middleware] INFO: Enabled item pipelines: ['magic_mirror.pipelines.MongoPipeline', 'scrapy_redis.pipelines.RedisPipeline'] 2023-09-05 18:10:20 [scrapy.core.engine] INFO: Spider opened 2023-09-05 18:10:20 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:10:20 [scrapy.extensions.telnet] DEBUG: Telnet console listening on 127.0.0.1:6026 2023-09-05 18:10:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2023-09-05 18:10:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 5, 14, 49, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '机器能否在股票投资上全面取代人类？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697165'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697165" } 2023-09-05 18:10:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 5, 12, 45, 56, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“严监管时代”来了！欧洲要“重锤”科技巨头，苹果、微软高举反抗大旗', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697164'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697164" } 2023-09-05 18:10:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 5, 9, 8, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Arm上市前夕估值不及预期，成不了下一个英伟达，但仍是今年全球最大IPO', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697126'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697126" } 2023-09-05 18:10:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 5, 4, 41, 4, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '火遍美国的诺和诺德减肥神药登陆英国，售价不到美国的五分之一', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697133'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697133" } 2023-09-05 18:10:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 5, 3, 0, 32, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '科大讯飞宣布讯飞星火即日起向全民开放，成A股首家获批大模型', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697130'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697130" } 2023-09-05 18:10:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:42 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 4, 21, 43, 20, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达最大的风险，在很少人关注的角落里！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697092'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697092" } 2023-09-05 18:10:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:46 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 4, 16, 14, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '谁捏住了英伟达的命门？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697095'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697095" } 2023-09-05 18:10:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 4, 15, 43, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '任正非最新讲话：华为“储备人才不储备美元”，领袖是自然成长起来的', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697089'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697089" } 2023-09-05 18:10:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 4, 14, 1, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '疯狂的H100', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697082'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697082" } 2023-09-05 18:10:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:56 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 3, 9, 16, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 剑指台积电：英特尔重注押宝先进封装', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697033'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697033" } 2023-09-05 18:10:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:10:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 2, 21, 7, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '中概9月“开门红”：政策迭出之际、财报也在超预期，市场开始回应了吗？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697025'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697025" } 2023-09-05 18:11:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:11:03 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 2, 16, 43, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 谷歌力图撼动英伟达帝国', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697024'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697024" } 2023-09-05 18:11:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:11:06 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 2, 13, 20, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '联手谷歌、扶持CoreWeave，英伟达全力打造“AI云”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697017'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697017" } 2023-09-05 18:11:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:11:09 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 2, 11, 42, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '【会议纪要】广发策略戴康：从日本经验看未来中国投资机会', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697018'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697018" } 2023-09-05 18:11:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform) 2023-09-05 18:11:13 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 2, 7, 17, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '苹果和英伟达将成为Arm美国IPO的战略投资者，估值或在500亿至600亿美元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697012'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697012" } 2023-09-05 18:11:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:17 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 2, 6, 48, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国科技IPO市场重启的又一例证，微软支持的Rubrik有望年内上市', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3697011'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3697011" } 2023-09-05 18:11:20 [scrapy.extensions.logstats] INFO: Crawled 20 pages (at 20 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:11:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:20 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 21, 54, 40, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 荣耀折叠新势力崛起', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696994'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696994" } 2023-09-05 18:11:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:24 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 21, 41, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '造车新势力8月排位赛：理想交付同比翻7倍，蔚来销量企稳，小鹏G6发力', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696991'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696991" } 2023-09-05 18:11:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 20, 40, 33, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '万亿英伟达背后，市场还有个隐藏AI大玩家', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696986'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696986" } 2023-09-05 18:11:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 17, 55, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '国内大模型进入公开赛', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696974'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696974" } 2023-09-05 18:11:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 10, 8, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '俞敏洪的反叛与迁徙', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696937'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696937" } 2023-09-05 18:11:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 8, 13, 50, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'PC市场复苏有望？戴尔第二财季业绩、下季度指引大超预期，盘后一度大涨超10%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696900'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696900" } 2023-09-05 18:11:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:43 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 7, 6, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '看好PC市场复苏，英特尔CEO预计Q3实现超预期指引，股价一度跳涨3%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696917'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696917" } 2023-09-05 18:11:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 7, 3, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '博通第三财季营收小幅超预期，第四财季营收指引不及预期，盘后跌近5%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696914'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696914" } 2023-09-05 18:11:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 4, 3, 19, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '汽车工人大罢工威胁之际，美国政府将提供120亿美元帮助传统车厂转型', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696904'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696904" } 2023-09-05 18:11:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 9, 1, 1, 51, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '特斯拉新款Model 3，明天真来', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696909'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696909" } 2023-09-05 18:11:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:11:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 20, 3, 58, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '蔚小理的价格战打到哪儿了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696884'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696884" } 2023-09-05 18:12:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:12:03 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 18, 9, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '当华尔街遇上大模型', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696872'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696872" } 2023-09-05 18:12:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:12:08 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 16, 16, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '分析师：相比其他科技巨头，英伟达还是“太便宜”，目标价730美元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696848'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696848" } 2023-09-05 18:12:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693610237) 2023-09-05 18:12:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 15, 54, 20, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '拒绝大牌代工的服装厂，正通过阿里出海', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696852'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696852" } 2023-09-05 18:12:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 11, 52, 10, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '《狂飙》后爱奇艺难成奈飞', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696828'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696828" } 2023-09-05 18:12:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 11, 41, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI焦点：力推TPU的谷歌为何仍携手英伟达、OpenAI的10亿营收意味着什么？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696827'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696827" } 2023-09-05 18:12:20 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:12:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:22 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 11, 34, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '亚马逊AWS是如何给微软创造了ChatGPT机会的？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696805'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696805" } 2023-09-05 18:12:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:26 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 9, 33, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '估值14亿美元！OpenAI挑战者中又出现一只独角兽', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696816'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696816" } 2023-09-05 18:12:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:30 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 5, 37, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '苹果之后谷歌新机也要来了：官宣10月4日发布会，暗示AI功能', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696803'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696803" } 2023-09-05 18:12:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 3, 51, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '又一房企中报：远洋集团上半年营业额降11%，董事局不建议派中期股息', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696800'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696800" } 2023-09-05 18:12:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 2, 44, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '华为大反攻：上半年净利激增两倍至465亿元、超去年全年，研发投入826亿', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696799'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696799" } 2023-09-05 18:12:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 31, 2, 43, 33, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '生产方式重大改变！苹果尝试用3D打印技术生产智能手表的钢质底盘', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696798'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696798" } 2023-09-05 18:12:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:44 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 17, 42, 13, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '写《乔布斯传》的人，又写了马斯克', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696757'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696757" } 2023-09-05 18:12:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:48 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 15, 23, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '谁卡了英伟达的脖子？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696734'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696734" } 2023-09-05 18:12:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:52 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 14, 46, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '资深行业高管：这一轮AI浪潮才开始，距离峰值还远着呢', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696654'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696654" } 2023-09-05 18:12:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 14, 11, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Mate 60与iPhone 15同台竞技，华为与苹果，9月一战！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696727'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696727" } 2023-09-05 18:12:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:12:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 9, 21, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '2023年中报｜利润下降近8成后，歌尔股份还能否“起死回生”？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696714'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696714" } 2023-09-05 18:13:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:13:02 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 8, 59, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '这些大“杀器”一现身，谷歌的野心再藏不住了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696711'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696711" } 2023-09-05 18:13:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693468460) 2023-09-05 18:13:06 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 8, 29, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '疯狂变现！报道：Open AI未来一年收入10亿美元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696710'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696710" } 2023-09-05 18:13:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:09 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 8, 12, 35, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '华为扔下一枚重磅炸弹', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696704'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696704" } 2023-09-05 18:13:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:12 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 5, 11, 34, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国法院为比特币现货ETF扫清障碍，比特币盘中暴拉2000美元，概念股两位数大涨', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696692'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696692" } 2023-09-05 18:13:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:16 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 2, 55, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'iPhone 15两周后首秀！苹果官宣9月12日举行发布会', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696691'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696691" } 2023-09-05 18:13:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 30, 1, 41, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '蔚来电话会：目标月销3万台，蔚来手机9月交付，阿尔卑斯明年下半年发首款车', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696672'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696672" } 2023-09-05 18:13:20 [scrapy.extensions.logstats] INFO: Crawled 55 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:13:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:24 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 22, 21, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '小米电话会：过去几年取得长足进步 友商最新发布的5G芯片不会有太大影响', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696674'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696674" } 2023-09-05 18:13:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 19, 28, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '小米二季度营收逆市环比增长13.2%，高端化稳步推进 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696646'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696646" } 2023-09-05 18:13:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 18, 2, 32, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'OpenAI最强“企业版”炸场，B端大模型市场会“赢家通吃”吗？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696651'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696651" } 2023-09-05 18:13:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 17, 42, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '华为Mate 60 Pro突击开卖', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696647'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696647" } 2023-09-05 18:13:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 16, 45, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '免费、开源且堪比GPT 4！Meta在训练Llama 3了？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696631'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696631" } 2023-09-05 18:13:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:44 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 15, 20, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '目标英伟达！这八家初创公司要挑战“GPU霸主”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696615'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696615" } 2023-09-05 18:13:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:48 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 14, 22, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '大摩：今年还有13个“AI时间点”，最近的就在今天', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696597'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696597" } 2023-09-05 18:13:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 14, 0, 16, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '侵吞全球算力！谷歌Gemini被曝算力达GPT-4五倍，手握TPU王牌碾压OpenAI', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696617'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696617" } 2023-09-05 18:13:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 13, 54, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '3亿刀，特斯拉1万个H100集群上线！超算Dojo7月已经开工，全力加速L4自动驾驶', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696618'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696618" } 2023-09-05 18:13:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:13:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 12, 11, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'A股再融资“紧箍咒”冲击调查', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696609'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696609" } 2023-09-05 18:14:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693355357) 2023-09-05 18:14:03 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 9, 21, 16, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'ChatGPT以来最重要产品发布！OpenAI“杀入B端，全力搞钱”，直接跟微软竞争', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696594'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696594" } 2023-09-05 18:14:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 6, 54, 50, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '采用M3芯片、OLED显示屏，苹果计划明年推出iPad Pro重大升级版本', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696579'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696579" } 2023-09-05 18:14:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 29, 2, 17, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'ChatGPT企业版来了！普通GPT-4两倍速度、窗口更大、保护安全隐私、定制专属GPT', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696574'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696574" } 2023-09-05 18:14:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 28, 22, 16, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '王兴还是赢了张一鸣', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696558'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696558" } 2023-09-05 18:14:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 28, 21, 3, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '打响828，华为云拼了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696550'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696550" } 2023-09-05 18:14:20 [scrapy.extensions.logstats] INFO: Crawled 71 pages (at 16 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:14:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 28, 19, 0, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“卖铲子”给英伟达！这家韩国芯片巨头今年涨超50%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696541'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696541" } 2023-09-05 18:14:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 28, 13, 54, 34, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI要被卡脖子了？训练大模型的数据或在2026年耗尽', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696511'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696511" } 2023-09-05 18:14:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 28, 13, 27, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '小鹏和滴滴，到底谁更需要谁？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696508'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696508" } 2023-09-05 18:14:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:34 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 27, 18, 58, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '本周重磅日程：美国非农、中国PMI揭晓，比亚迪拼多多财报，美商务部长访华', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696455'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696455" } 2023-09-05 18:14:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:38 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 27, 16, 45, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '250亿美元回购！为何是此刻？英伟达的股东也懵了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696463'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696463" } 2023-09-05 18:14:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:41 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 27, 11, 13, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达说未来4年数据中心升级开支1万亿美元，问题是：谁来买单？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696448'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696448" } 2023-09-05 18:14:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:46 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 27, 7, 34, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '牟一凌：策略思考总结——水晶球还是仪表盘？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694893'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694893" } 2023-09-05 18:14:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:48 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 26, 15, 45, 35, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达确实猛、鲍威尔也没掀桌，但AI还行不行的争论更激烈了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696443'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696443" } 2023-09-05 18:14:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:52 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 26, 14, 54, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '发布一天，Code Llama代码能力突飞猛进，微调版HumanEval得分超GPT-4', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696440'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696440" } 2023-09-05 18:14:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:56 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 26, 9, 50, 9, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美股“超级独角兽”DataBricks估值再提高！公司洽谈按430亿美元估值进行融资', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696428'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696428" } 2023-09-05 18:14:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1693272076) 2023-09-05 18:14:58 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 25, 21, 56, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI概念股陷盈利困境？浪潮信息上半年净利同比大降约66%，拓尔思同比下滑6%｜财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696407'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696407" } 2023-09-05 18:14:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 25, 19, 44, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '行业整体仍处库存消化阶段 中芯国际上半年净利润同比下降34.1% | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696399'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696399" } 2023-09-05 18:15:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:05 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 25, 11, 8, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“小破站”翻起了电商后浪', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696367'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696367" } 2023-09-05 18:15:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:09 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 25, 8, 50, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '报道称英伟达2024年GPU产量扩大三倍：H100将达到200万块', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696358'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696358" } 2023-09-05 18:15:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:12 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 25, 8, 23, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '可商业化，最强开源文本生成代码模型！Code Llama重磅发布', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696355'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696355" } 2023-09-05 18:15:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:16 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 25, 8, 11, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '因为说错一句话，马斯克“赔了4000万美元”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696349'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696349" } 2023-09-05 18:15:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 25, 4, 32, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '苹果态度大转变：支持加州维修权法案', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696345'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696345" } 2023-09-05 18:15:20 [scrapy.extensions.logstats] INFO: Crawled 89 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:15:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:22 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 25, 1, 11, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国经济的不祥之兆？T-Mobile计划裁员5000人', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696336'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696336" } 2023-09-05 18:15:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 21, 58, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美团电话会：第三季度增长可能会放缓，线上消费的频率会更高', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696328'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696328" } 2023-09-05 18:15:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 21, 41, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI概念股中报业绩“冰火两重天”：海光信息净利同比高增42%，昆仑万维净利下滑44%| 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696296'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696296" } 2023-09-05 18:15:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 20, 57, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '雷军造车箭在弦上', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696325'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696325" } 2023-09-05 18:15:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 19, 0, 2, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '网易Q2营收同比增3.7%不及预期 净利润增长67％超预期 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696300'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696300" } 2023-09-05 18:15:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 18, 5, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '线下消费复苏显著！美团二季度营收增长33.4%，股价今日已大涨7% | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696299'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696299" } 2023-09-05 18:15:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:41 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 14, 29, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国法院最新判例：完全由AI创作的艺术作品没有版权', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696274'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696274" } 2023-09-05 18:15:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:45 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 11, 14, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达：再次炸裂，AI王者的“独角戏”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696267'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696267" } 2023-09-05 18:15:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692971788) 2023-09-05 18:15:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 10, 47, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '单季爆赚67亿美元！“AI的钱”都被英伟达赚走了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696265'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696265" } 2023-09-05 18:15:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:15:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:15:52 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 9, 4, 18, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '小米汽车进入生产阶段：开始急招大量工人，五大操作工种缺口达百人', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696258'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696258" } 2023-09-05 18:15:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:15:54 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 8, 51, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '不只是英伟达的GPU，AI产业链上多个环节都在短缺', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696257'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696257" } 2023-09-05 18:15:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:15:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 6, 7, 20, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '碾压预期！英伟达Q2收入利润翻倍，指引爆表，拟回购250亿，盘后一度涨10% | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696243'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696243" } 2023-09-05 18:16:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:02 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 24, 1, 24, 19, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '全球股市“黑八月”来袭！市场情绪急转，重要股指一个也没逃过下跌', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696236'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696236" } 2023-09-05 18:16:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 22, 1, 3, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '这颗博通芯片，涨到14万', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696228'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696228" } 2023-09-05 18:16:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 21, 59, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '李彦宏狂奔在大模型路上', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696230'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696230" } 2023-09-05 18:16:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 21, 57, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '当升科技上半年营收同比下降7.8% 净利润实现逆势增长 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696226'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696226" } 2023-09-05 18:16:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 21, 3, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '10年烧掉47亿，欧盟「人脑计划」宣告失败？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696222'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696222" } 2023-09-05 18:16:20 [scrapy.extensions.logstats] INFO: Crawled 107 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:16:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 20, 7, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '信达生物2023年上半年营收同比增加20.6% 净亏损大幅收窄85.4%｜财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696210'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696210" } 2023-09-05 18:16:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 16, 57, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '今晚属于英伟达！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696200'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696200" } 2023-09-05 18:16:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 16, 23, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '豪赌英伟达！超过1000亿美元期权下注，60%看涨、“短期合约”创新高，也赌股价大波动', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696189'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696189" } 2023-09-05 18:16:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:31 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 16, 3, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '12.5万一架的无人机要卖给谁？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696193'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696193" } 2023-09-05 18:16:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 14, 35, 10, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '对冲基金有多爱英伟达？今晚注定很疯狂', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696183'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696183" } 2023-09-05 18:16:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 13, 35, 43, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '边砍边省，快手终于赚钱了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696176'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696176" } 2023-09-05 18:16:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692845277) 2023-09-05 18:16:38 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 9, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Salesforce领投！AI初创公司Hugging Face新一轮融资估值超40亿美元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696167'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696167" } 2023-09-05 18:16:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:16:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:16:42 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 23, 5, 1, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“越南特斯拉”VinFast暴涨近170%，市值超1000亿美元成全球第三大车企', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696144'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696144" } 2023-09-05 18:16:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:16:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 22, 38, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '爱奇艺跌近5%，Q2营收78亿元同比增长17%，会员数环比下滑｜财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696132'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696132" } 2023-09-05 18:16:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:16:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 22, 3, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软暴雪再做关键让步！为平息监管担忧 “舍弃”云游戏版权', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696121'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696121" } 2023-09-05 18:16:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:16:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 21, 1, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '一文读懂美股今年最大IPO：Arm已提交招股书 中国收入占25%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696122'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696122" } 2023-09-05 18:16:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:16:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 18, 21, 6, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“有能力接力土地财政”！资产入表正式落地，数据要素产业化大时代开启', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696089'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696089" } 2023-09-05 18:17:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 17, 57, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '盈利能力爆发！快手二季度IFRS净利润14.8亿元，上市后首次转正 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696107'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696107" } 2023-09-05 18:17:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:08 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 12, 15, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '670万人“养活”唯品会', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696077'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696077" } 2023-09-05 18:17:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 8, 6, 54, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英国被曝调查企业在华投资情况，专家：若对华“脱钩”，其产能无法有效释放', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696054'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696054" } 2023-09-05 18:17:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 6, 41, 3, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'ZOOM二财季业绩超预期，上调全财年业绩指引，盘后一度涨近10%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696048'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696048" } 2023-09-05 18:17:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 6, 10, 47, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '今年美股最大IPO乘AI东风到来，软银旗下Arm申请上市', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696046'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696046" } 2023-09-05 18:17:20 [scrapy.extensions.logstats] INFO: Crawled 125 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:17:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:21 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 22, 4, 49, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“AI最重要财报”前夕，华尔街上调英伟达目标价！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3696044'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3696044" } 2023-09-05 18:17:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 21, 15, 27, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英国计划斥资1亿英镑购入数千颗AI芯片，已与英伟达进入谈判后期', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695998'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695998" } 2023-09-05 18:17:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 21, 13, 49, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '耗时2年，Meta联手CMU打造最强”通用机器人智能体“！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695991'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695991" } 2023-09-05 18:17:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 21, 11, 37, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 雷军：小米高端实现阶段突破', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695984'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695984" } 2023-09-05 18:17:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692755700) 2023-09-05 18:17:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 20, 18, 29, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '下周重磅日程：一场会议、一个财报，“敏感时刻”酝酿风暴？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695932'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695932" } 2023-09-05 18:17:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:17:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:17:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 20, 14, 37, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '1000+AI智能体复活，OpenAI版元宇宙上线？ ChatGPT+VR百分百还原「西部世界」', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695934'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695934" } 2023-09-05 18:17:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:17:43 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 19, 22, 39, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '又一家大厂向内动刀', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695920'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695920" } 2023-09-05 18:17:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:17:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 19, 14, 29, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Llama2开源后，国产大模型在卷什么？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695912'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695912" } 2023-09-05 18:17:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:17:52 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 19, 11, 18, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '「万字干货」深度对话Quentin Anthony：GPU不足，如何优雅地训练大模型？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695909'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695909" } 2023-09-05 18:17:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:17:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 19, 8, 0, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '出师不利：旧金山刚放宽无人驾驶车上路就出车祸', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695904'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695904" } 2023-09-05 18:17:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:17:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 19, 7, 26, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '智能手机市场疲软拖累今年最大IPO，Arm上财年营收下降1%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695901'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695901" } 2023-09-05 18:18:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:18:02 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 19, 4, 4, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '小鹏电话会：9月G6交付量将显著提升，四季度毛利率转正', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695883'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695883" } 2023-09-05 18:18:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:18:05 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 23, 31, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '银河证券交易策略公开赛揭晓 私募舵手激辩ChatGPT量化应用的“优与劣”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695893'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695893" } 2023-09-05 18:18:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:18:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 21, 45, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI能取代你的工作吗？50%受访美国人：能！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695888'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695888" } 2023-09-05 18:18:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:18:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 20, 40, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '恒瑞医药上半年扣非净利润同比增长12%，创新药驱动收入增长|财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695884'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695884" } 2023-09-05 18:18:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:18:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 16, 59, 40, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马化腾的电商梦有了盼头', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695856'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695856" } 2023-09-05 18:18:20 [scrapy.extensions.logstats] INFO: Crawled 142 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:18:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:18:22 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 14, 46, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'H100利润率1000%！英伟达堪比“印钞机”？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695845'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695845" } 2023-09-05 18:18:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:18:26 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 13, 32, 7, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '抖音VS拼多多：两个1.5亿DAU的错位战争', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695838'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695838" } 2023-09-05 18:18:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:18:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 12, 35, 18, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI怀疑论蔓延！Bing没有赢谷歌，Office AI版成败备受关注', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695837'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695837" } 2023-09-05 18:18:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692527395) 2023-09-05 18:18:31 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 8, 57, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI需求爆涨，为何剑桥科技Q2营收环比-38%？| 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695821'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695821" } 2023-09-05 18:18:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:18:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:18:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 8, 45, 53, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '去年收入翻倍，一季度15亿美元收入、5500万美元利润！SpaceX财务数据罕见曝光', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695819'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695819" } 2023-09-05 18:18:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:18:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 18, 8, 37, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国全民热衷减肥药，重塑丹麦经济', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695811'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695811" } 2023-09-05 18:18:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:18:43 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 21, 31, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI进军咨询圈！麦肯锡GPT来了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695782'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695782" } 2023-09-05 18:18:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:18:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 20, 52, 34, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“猪茅”牧原股份上半年净亏损缩窄58% 拟设立子公司开展新能源相关业务｜财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695776'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695776" } 2023-09-05 18:18:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:18:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 20, 40, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'B站美股盘前涨7% 公司Q2营收同比增长8%超预期 调整后净亏损同比收窄51%| 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695772'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695772" } 2023-09-05 18:18:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:18:54 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 19, 50, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“数字疗法第一股”脑动极光IPO：认知障碍的“题库生意”前景几何', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695778'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695778" } 2023-09-05 18:18:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:18:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 16, 33, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '充电10分钟续航200公里，“宁王”开启电动车超充时代', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695750'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695750" } 2023-09-05 18:19:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:19:03 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 14, 56, 53, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '董事长“秒回”：对方要讹诈！癌症早筛龙头被指“九成收入作假”，谁在做空？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695749'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695749" } 2023-09-05 18:19:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:19:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 14, 7, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'OpenAI官宣第一笔收购！开源「我的世界」8人顶级团队加盟，押注AI智能体', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695743'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695743" } 2023-09-05 18:19:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:19:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 10, 14, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '用ChatGPT分析法律合同！全球法律技术领导者Litera与微软合作', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695726'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695726" } 2023-09-05 18:19:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:19:13 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 10, 3, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '刘强东赢回了一局？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695732'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695732" } 2023-09-05 18:19:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:19:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 8, 7, 20, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '内地卷不动，到海外淘金？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695689'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695689" } 2023-09-05 18:19:20 [scrapy.extensions.logstats] INFO: Crawled 159 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:19:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:19:22 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 8, 6, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英特尔放弃收购以色列代工芯片制造商，因中国未批准？专家回应', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695719'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695719" } 2023-09-05 18:19:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:19:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 17, 3, 57, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI市场有多火爆？英伟达今年或卖出55万个H100 GPU', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695707'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695707" } 2023-09-05 18:19:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692320251) 2023-09-05 18:19:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 16, 22, 3, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '京东电话会：百亿补贴对低频用户有明显拉升作用，下半年最重要的KPI是GMV、利润和现金流', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695693'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695693" } 2023-09-05 18:19:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:19:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:19:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 16, 20, 46, 50, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '京东Q2营收同比增长7.6% 净利润同比增长31.9% 零售部门表现低迷 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695676'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695676" } 2023-09-05 18:19:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:19:37 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 16, 18, 13, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '李书福接下李彦宏“造车梦”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695677'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695677" } 2023-09-05 18:19:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:19:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 16, 15, 37, 22, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '腾讯音乐：成长的烦恼', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695660'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695660" } 2023-09-05 18:19:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:19:44 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 16, 15, 34, 58, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '阿里云上市前夕，钉钉“单飞”了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695659'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695659" } 2023-09-05 18:19:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:19:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 16, 15, 34, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '腾讯Q2业绩前瞻：视频号有望提振广告业务 游戏业务或季节性回落 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695650'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695650" } 2023-09-05 18:19:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:19:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 16, 14, 20, 59, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Sensor Tower：7月腾讯《王者荣耀》蝉联全球手游畅销榜冠军', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695653'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695653" } 2023-09-05 18:19:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:19:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 16, 5, 42, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '暴涨超250%！越南版特斯拉VinFast上市首日市值超美国三大车厂和宝马、本田等', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695614'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695614" } 2023-09-05 18:19:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:19:58 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 16, 2, 45, 34, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '一天完成六个月工作！OpenAI曝光GPT-4新功能内容审核', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695618'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695618" } 2023-09-05 18:20:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:20:00 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 21, 55, 6, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '快手杀出了一条血路', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695604'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695604" } 2023-09-05 18:20:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:20:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 21, 0, 18, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '招募本地运营团队，特斯拉部署全自动驾驶方案入华', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695600'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695600" } 2023-09-05 18:20:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:20:09 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 20, 35, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '抄中十倍股后，王亚伟又现“颠覆式”换仓！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695601'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695601" } 2023-09-05 18:20:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:20:13 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 19, 47, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '如果AI没那么厉害呢？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695579'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695579" } 2023-09-05 18:20:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:20:16 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 19, 9, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Isaacson新书《马斯克传》：马斯克不是超人，而是扮成了超人！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695594'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695594" } 2023-09-05 18:20:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:20:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 16, 20, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI听键盘声就能偷你密码，准确率高达95%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695568'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695568" } 2023-09-05 18:20:20 [scrapy.extensions.logstats] INFO: Crawled 177 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:20:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692194592) 2023-09-05 18:20:21 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 11, 56, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '半导体“寒气”比预期更久 | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695550'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695550" } 2023-09-05 18:20:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 8, 47, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达大涨背后：大摩推荐抄底，沙特阿联酋争抢GPU', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695535'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695535" } 2023-09-05 18:20:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:30 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 8, 19, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '二季度对冲基金大幅加仓大型科技股，但抛售英特尔', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695524'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695524" } 2023-09-05 18:20:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:34 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 1, 24, 3, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '智能手机寒冬继续？富士康二季度业绩下滑、下调全年营收预期丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695512'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695512" } 2023-09-05 18:20:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:37 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 15, 0, 56, 10, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '京东否认刘强东夫妇移民美国', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695517'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695517" } 2023-09-05 18:20:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:42 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 14, 23, 27, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '雷军终于“干翻”了华为', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695502'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695502" } 2023-09-05 18:20:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:45 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 14, 22, 32, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '600万年薪抢人！AI热潮向招聘市场蔓延', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695501'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695501" } 2023-09-05 18:20:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 14, 20, 12, 40, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '准备过冬？马斯克据报道未来一年半内不再投资建厂', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695492'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695492" } 2023-09-05 18:20:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 14, 19, 53, 22, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '下游需求缓慢恢复 锂电隔膜龙头星源材质上半年净利润同比增长3% | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695503'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695503" } 2023-09-05 18:20:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:20:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 14, 19, 5, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '抖音新成立一个文娱部门，整合直播节目、音乐等多个业务', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695490'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695490" } 2023-09-05 18:21:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:21:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 14, 15, 37, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '日烧70万美元，OpenAI 2024年破产？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695465'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695465" } 2023-09-05 18:21:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:21:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 14, 11, 30, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '新华社研究院发布国产大模型报告：讯飞星火第一，百度文心第二', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695443'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695443" } 2023-09-05 18:21:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:21:08 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 13, 19, 21, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美股科技股的危险信号：包括英伟达在内，一些AI龙头股已调整了10%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695405'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695405" } 2023-09-05 18:21:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:21:12 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 13, 16, 56, 33, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '本周重磅日程：MLF是否降息？关注中国7月经济数据、腾讯京东B站财报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695400'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695400" } 2023-09-05 18:21:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:21:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 13, 13, 54, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '终究是C端产品 ，扛下科大讯飞的“梦想” | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695394'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695394" } 2023-09-05 18:21:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1692071788) 2023-09-05 18:21:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 12, 17, 50, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '年内暴涨180%，市盈率超210倍，英伟达太贵了吗？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695380'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695380" } 2023-09-05 18:21:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:20 [scrapy.extensions.logstats] INFO: Crawled 195 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:21:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:24 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 12, 12, 38, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '【万字硬核实录】陈天奇：A卡跑大模型，iphone跑70B，打爆英伟达GPU算力困境', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695376'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695376" } 2023-09-05 18:21:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 12, 10, 7, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '华为开启了大反攻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695369'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695369" } 2023-09-05 18:21:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:30 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 12, 6, 59, 9, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马斯克与扎克伯格决斗将在意大利“史诗般的地点”进行 网友：罗马斗兽场吗？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695360'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695360" } 2023-09-05 18:21:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 12, 6, 8, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '桥水二季度增持拼多多和中国ETF，重仓美股和新兴市场ETF，清仓奈飞和黄金ETF', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695362'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695362" } 2023-09-05 18:21:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 23, 1, 16, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '华为杀回来了！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695353'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695353" } 2023-09-05 18:21:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 22, 7, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '云从科技上半年营收同比下降58.16% 净亏损约3.04亿元｜财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695350'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695350" } 2023-09-05 18:21:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:43 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 20, 56, 9, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '科大讯飞上半年净利润同比下降73.54%，二季度净利润和毛利均正向增长｜财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695342'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695342" } 2023-09-05 18:21:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:48 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 20, 10, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“券茅”东方财富：上半年营收、净利个位数下滑，正大力拥抱AI浪潮 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695343'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695343" } 2023-09-05 18:21:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:52 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 17, 54, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '刘强东不忘金融梦', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695329'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695329" } 2023-09-05 18:21:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:21:56 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 16, 31, 32, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '商业化拐点临近！旧金山允许无人驾驶出租车不受限行驶', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695324'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695324" } 2023-09-05 18:22:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:22:00 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 16, 9, 14, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '华为：上半年实现销售收入3109亿元人民币，同比增长3.1%，净利润率15.0%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695323'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695323" } 2023-09-05 18:22:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:22:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 15, 50, 7, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI热潮是另一场互联网泡沫吗？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695314'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695314" } 2023-09-05 18:22:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:22:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 14, 52, 7, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 释放生产力：讯飞智能办公本X3怎么做？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695315'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695315" } 2023-09-05 18:22:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:22:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 14, 18, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 2023H1净利巨增：阅文集团做了什么？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695313'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695313" } 2023-09-05 18:22:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691833837) 2023-09-05 18:22:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 13, 41, 56, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '三大运营商的23H1：All in 云计算+AI | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695309'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695309" } 2023-09-05 18:22:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 13, 31, 39, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '欧洲芯片，疯狂搞事', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695304'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695304" } 2023-09-05 18:22:20 [scrapy.extensions.logstats] INFO: Crawled 212 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:22:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 10, 31, 42, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '妙鸭不只想成为网红', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695302'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695302" } 2023-09-05 18:22:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:27 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 10, 22, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '阿里电商王者归来？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695301'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695301" } 2023-09-05 18:22:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 5, 35, 16, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国传统车厂的新麻烦！工会或“狮子大开口”，通用、福特重挫', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695281'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695281" } 2023-09-05 18:22:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 11, 0, 38, 7, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '喊话广告商！X公司CEO：我在马斯克的领导下拥有“自主权”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695271'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695271" } 2023-09-05 18:22:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:38 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 19, 40, 47, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '并行科技北交所IPO暂缓审议B面：未盈利之殇', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695256'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695256" } 2023-09-05 18:22:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:42 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 18, 47, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '中芯国际Q2营收同比下滑18%，预计下半年业绩将有所回暖 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695249'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695249" } 2023-09-05 18:22:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:45 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 15, 26, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '减肥神药助力！诺和诺德上半年营收、利润双增30%，同时上调全年业绩指引 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695228'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695228" } 2023-09-05 18:22:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:48 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 13, 47, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '改款Model 3被曝10月交付：预估售价20万左右，续航与辅助驾驶双提高', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695222'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695222" } 2023-09-05 18:22:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 13, 14, 53, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 华为5G若回归：荣耀将怎样应对？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695219'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695219" } 2023-09-05 18:22:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:22:56 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 9, 2, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '薇娅正在制造“虚拟薇娅”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695204'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695204" } 2023-09-05 18:23:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:23:00 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 8, 42, 7, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '迪士尼上财季流媒体用户流失、乐园业务表现优异、Disney+将涨价27%，盘后涨超4%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695193'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695193" } 2023-09-05 18:23:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:23:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 8, 33, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '可控核聚变：初探商业化进展', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695200'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695200" } 2023-09-05 18:23:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:23:08 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 5, 44, 7, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '中国互联网大厂订购50亿美元英伟达芯片，全球GPU短缺暂难缓解', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695189'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695189" } 2023-09-05 18:23:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691732516) 2023-09-05 18:23:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 10, 4, 7, 53, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '警惕！美国新能源车初创公司破产潮恐怕要来了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695187'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695187" } 2023-09-05 18:23:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 21, 44, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '抢锂大战进行时！四川李家沟北锂矿勘查权竞拍首日升值已超663倍', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695176'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695176" } 2023-09-05 18:23:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 21, 42, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '亚马逊参投！AI热潮下，即将上市的ARM遭科技巨头热捧', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695171'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695171" } 2023-09-05 18:23:20 [scrapy.extensions.logstats] INFO: Crawled 229 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:23:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:22 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 19, 49, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马云也入了马斯克的局', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695163'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695163" } 2023-09-05 18:23:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:26 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 19, 40, 43, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '40年来反垄断第一大案！谷歌是否会被肢解？下月揭晓', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695161'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695161" } 2023-09-05 18:23:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:30 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 13, 21, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '因与果：资产负债表衰退的本质是什么？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694868'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694868" } 2023-09-05 18:23:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:34 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 12, 25, 47, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'SEC主席警告：AI将处于下一场金融危机的中心', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695124'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695124" } 2023-09-05 18:23:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 10, 54, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '对话华福证券首席经济学家燕翔：“资产负债表衰退”为何不适用于中国', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695114'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695114" } 2023-09-05 18:23:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 9, 32, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达的野心：“AI原生”彻底颠覆数据中心', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695107'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695107" } 2023-09-05 18:23:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:45 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 8, 52, 39, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '黄仁勋：五年前就开始豪赌AI，一切才刚刚开始', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695106'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695106" } 2023-09-05 18:23:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:48 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 7, 27, 40, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '特斯拉劲敌Rivian上调全年业绩指引，二季度业绩超预期丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695094'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695094" } 2023-09-05 18:23:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 6, 7, 4, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '共享办公巨头WeWork：“严重怀疑”公司能否继续经营，盘后暴跌30%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695095'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695095" } 2023-09-05 18:23:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:23:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 3, 21, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '理想电话会：四季度可实现月交付4万辆，明年有望成为第一豪车品牌', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695082'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695082" } 2023-09-05 18:24:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:24:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 9, 2, 1, 33, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '生成式AI添利器！英伟达推出超级芯片GH200 Grace，内存增3.5倍、带宽增三倍', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695091'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695091" } 2023-09-05 18:24:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:24:05 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 8, 21, 40, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '官宣！台积电与3家企业合资在德国建厂 总投资超100亿欧元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695080'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695080" } 2023-09-05 18:24:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691611673) 2023-09-05 18:24:08 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 8, 19, 42, 43, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'ChatGPT后下一个AI焦点：Agent，又有产品落地了！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695054'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695054" } 2023-09-05 18:24:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:12 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 8, 17, 47, 35, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '理想Q2创史上最佳季度盈利，预计Q3交付将突破10万辆 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695057'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695057" } 2023-09-05 18:24:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 8, 15, 12, 19, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '室温超导被判死刑？北大国科大等力证LK-99半悬浮样品不是超导，竟是铁磁材料', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695046'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695046" } 2023-09-05 18:24:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 8, 5, 26, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'FTC起诉亚马逊倒计时！亚马逊将与FTC官员进行最后的“仪式性”会面', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695006'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695006" } 2023-09-05 18:24:20 [scrapy.extensions.logstats] INFO: Crawled 246 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:24:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 8, 5, 26, 22, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '摩根士丹利警告：看看英伟达，美股AI大牛市可能接近顶峰', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695008'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695008" } 2023-09-05 18:24:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 8, 3, 3, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '苹果给iPhone 15 Pro 3纳米芯片省了几十亿美元！据称不良成本全由台积电承担', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3695004'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3695004" } 2023-09-05 18:24:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 7, 20, 43, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '彻底摆脱英特尔，苹果已经是“芯片巨头”了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694986'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694986" } 2023-09-05 18:24:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 7, 17, 47, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '人格模拟！大模型进入“个性化”时代', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694961'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694961" } 2023-09-05 18:24:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:37 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 7, 14, 42, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '年度最绝融资：拿英伟达H100抵押贷款165亿，买更多英伟达GPU扩建10个数据中心', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694946'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694946" } 2023-09-05 18:24:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:41 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 7, 14, 41, 58, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '零碳发电临近？美国核聚变发电再次实现突破', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694947'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694947" } 2023-09-05 18:24:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:45 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 6, 18, 7, 9, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '本周重磅日程：超级数据周来袭！阿里、理想财报揭晓', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694899'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694899" } 2023-09-05 18:24:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 6, 15, 32, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 华为和苹果入局端侧AI大模型', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694896'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694896" } 2023-09-05 18:24:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:52 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 6, 14, 20, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '招聘“泄露天机”！苹果要研发手机端运行AI大模型，而非云端', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694891'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694891" } 2023-09-05 18:24:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:56 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 6, 12, 37, 59, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '第一个LK-99完全悬浮的视频出现了，具备磁通钉扎特性？技术细节即将公布', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694890'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694890" } 2023-09-05 18:24:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:24:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 5, 19, 17, 2, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '资深投资人：AI已过了“太酷了”，走向“有什么用”阶段，要学习互联网的经验', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694877'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694877" } 2023-09-05 18:25:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691494963) 2023-09-05 18:25:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 5, 15, 23, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '张勇发起了一次奇袭', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694855'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694855" } 2023-09-05 18:25:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:06 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 5, 15, 22, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 再下RSIC-V一城：高通剑指何处？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694880'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694880" } 2023-09-05 18:25:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 5, 10, 58, 14, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马化腾“掘金”房地产', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694873'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694873" } 2023-09-05 18:25:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:12 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 4, 19, 7, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Nvidia H100 GPU 供需现状：保守估计，还差43万张！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694844'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694844" } 2023-09-05 18:25:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:17 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 4, 18, 35, 14, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '消费需求低迷 三安光电上半年净利润同比下降81.76%| 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694840'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694840" } 2023-09-05 18:25:20 [scrapy.extensions.logstats] INFO: Crawled 263 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:25:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:20 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 4, 14, 38, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '「妙鸭」产品负责人：AIGC 的产品第一天不收钱，就可能收不到钱', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694822'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694822" } 2023-09-05 18:25:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 4, 13, 40, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '室温超导又反转了！韩国团队放出第二段LK-99悬浮视频，华科大新论文首证抗磁性', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694820'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694820" } 2023-09-05 18:25:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:27 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 4, 13, 30, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'ChatGPT当“律师”！全球最大律师事务所与微软合作，推出法律GPT', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694817'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694817" } 2023-09-05 18:25:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:31 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 4, 13, 30, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '苹果Q2电话会：对AI依然保持“克制”，称Vision Pro是“工程奇迹”，预计Q3 iPad和Mac收入两位数下滑', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694816'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694816" } 2023-09-05 18:25:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 4, 6, 37, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '亚马逊二季度业绩超预期、告别盈利衰退、三季度指引炸裂！盘后大涨超10%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694787'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694787" } 2023-09-05 18:25:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 4, 1, 52, 43, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '国内AI大模型“安卓时刻”到来！阿里云通义千问免费、开源、可商用', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694780'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694780" } 2023-09-05 18:25:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:44 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 21, 24, 16, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '室温超导疑云：韩国学界初步判断LK-99并非超导体，研究团队背后为私营公司，涉嫌捏造合作关系', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694752'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694752" } 2023-09-05 18:25:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:48 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 20, 52, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '风投“退烧”，向量数据库“降温”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694755'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694755" } 2023-09-05 18:25:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 16, 28, 3, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '高盛：2025年全球人工智能投资有望增至2000亿美元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694737'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694737" } 2023-09-05 18:25:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:56 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 13, 31, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '中日汽车之战，爆发在泰国？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694726'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694726" } 2023-09-05 18:25:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691220232) 2023-09-05 18:25:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 10, 55, 34, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达也从蔚小理挖人了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694718'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694718" } 2023-09-05 18:25:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:03 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 7, 56, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '在AI领域更进一步！Meta推出新款音频和音乐生成式AI工具AudioCraft', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694699'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694699" } 2023-09-05 18:26:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 6, 31, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '高盛支持的“苹果版余额宝”持续火爆，推出仅三个多月存款余额已达100亿美元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694697'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694697" } 2023-09-05 18:26:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:09 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 6, 7, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '手机市场仍拉垮，高通二季度营收超预期下降23%，指引逊于预期，盘后一度跌超8% | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694698'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694698" } 2023-09-05 18:26:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:13 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 2, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '一夜之间突然熄火！韩国室温超导论文爆出缺陷，美国超导概念股大跌近30%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694693'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694693" } 2023-09-05 18:26:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:17 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 3, 1, 21, 22, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '137亿超级收购以来最大日杂改革！亚马逊要整合各类电商、非Prime会员也送生鲜', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694692'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694692" } 2023-09-05 18:26:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 2, 21, 59, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '吴新宙与何小鹏的告别，智能驾驶的竞争新时代', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694680'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694680" } 2023-09-05 18:26:20 [scrapy.extensions.logstats] INFO: Crawled 281 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:26:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 2, 19, 15, 40, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '台股AI股、韩股电池股双双重挫！亚洲今年两大科技泡沫要破了？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694654'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694654" } 2023-09-05 18:26:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 2, 17, 42, 50, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '刘强东正在下一盘大棋', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694660'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694660" } 2023-09-05 18:26:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:31 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 2, 17, 30, 2, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '估值飙升超600亿美元！AI热潮下，即将上市的ARM成了香饽饽', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694651'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694651" } 2023-09-05 18:26:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 2, 9, 19, 2, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '乐刻要做中国健身业的“贝壳”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694572'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694572" } 2023-09-05 18:26:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 2, 6, 0, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AMD传市场回暖喜讯，三季度PC业务料将环比两位数大增，盘后一度涨超5% | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694606'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694606" } 2023-09-05 18:26:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:43 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 2, 4, 15, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Uber二季度首次实现营业利润但营收逊色，CFO将离职，股价一度跌7% | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694604'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694604" } 2023-09-05 18:26:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:46 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 1, 21, 39, 50, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '京东有没有收购永辉的需求？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694590'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694590" } 2023-09-05 18:26:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 1, 20, 56, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“室温超导”又火爆全球！物理学“圣杯”将开启第四次工业革命？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694571'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694571" } 2023-09-05 18:26:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1691031334) 2023-09-05 18:26:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 1, 16, 7, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'PC也疯狂！戴尔：联手英伟达，全力开发生成式AI', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694559'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694559" } 2023-09-05 18:26:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:26:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:26:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 1, 15, 5, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'GPT-5要来了？OpenAI向美国专利局提交商标申请', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694552'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694552" } 2023-09-05 18:27:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 1, 14, 49, 53, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '室温超导复现失败？北航连发两文未发现超导磁悬浮，但美国国家实验室计算证实理论上存在', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694553'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694553" } 2023-09-05 18:27:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 1, 14, 39, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '百亿美金的平台扳手腕，云数据的生成式AI之争', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694551'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694551" } 2023-09-05 18:27:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 1, 13, 46, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“木头姐”：为什么我看好还要减持特斯拉', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694549'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694549" } 2023-09-05 18:27:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 1, 8, 39, 6, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '四巨头订单就够季度目标！华尔街发现英伟达“需求远超预期”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694528'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694528" } 2023-09-05 18:27:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:13 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 8, 1, 5, 1, 10, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '撤出芯片项目后还在印度发力？富士康据称拟投资5亿美元建多座零部件厂', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694515'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694515" } 2023-09-05 18:27:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 31, 14, 17, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 破袭：2023 H1，OPPO出货量份额中国市场第一', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694453'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694453" } 2023-09-05 18:27:20 [scrapy.extensions.logstats] INFO: Crawled 298 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:27:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:21 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 31, 13, 36, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '谷歌AGI机器人大招：用大模型给机器人造“大脑”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694448'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694448" } 2023-09-05 18:27:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 31, 9, 4, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“地产标杆”黑石转向了！卖房转投AI数据中心', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694428'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694428" } 2023-09-05 18:27:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 31, 8, 56, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | Q2销量称雄中国市场：vivo何以达成？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694431'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694431" } 2023-09-05 18:27:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 31, 8, 6, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '下周重磅日程：美国非农、中国PMI揭晓，苹果、AMD财报，国新办促消费发布会', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694396'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694396" } 2023-09-05 18:27:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 30, 19, 46, 59, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '云计算整体减速，但微软和谷歌的“AI云斗法”才刚刚开始', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694404'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694404" } 2023-09-05 18:27:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 30, 10, 46, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '事必躬亲！黄仁勋的英伟达管理风格', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694388'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694388" } 2023-09-05 18:27:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:43 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 30, 9, 45, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马斯克：两年内将从“缺硅”变到“缺电”，阻碍AI发展', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694386'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694386" } 2023-09-05 18:27:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690877261) 2023-09-05 18:27:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 29, 19, 59, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI行业薪资门槛一起卷？两家巨头的招聘启事，得罪了所有人', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694379'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694379" } 2023-09-05 18:27:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:27:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:27:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 29, 19, 15, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '未来每个芯片平台都将加入AI！英特尔CEO：AI不必与云绑定', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694376'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694376" } 2023-09-05 18:27:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:27:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 29, 17, 41, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '被罚超70亿后，20多天时间蚂蚁集团都干了啥？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694375'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694375" } 2023-09-05 18:27:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:27:58 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 29, 14, 53, 50, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '数据、C端应用挤下大模型成为AI【必争之地】', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694286'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694286" } 2023-09-05 18:28:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:02 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 29, 13, 21, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '为什么是GPU？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694368'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694368" } 2023-09-05 18:28:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:05 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 29, 9, 3, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '机器人可“自我学习”！谷歌DeepMind发布首个机器人算法模型，“潘多拉魔盒”打开了？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694359'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694359" } 2023-09-05 18:28:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 29, 8, 36, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '为什么苹果谈AI这么少？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694357'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694357" } 2023-09-05 18:28:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:13 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 29, 5, 23, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '越南电动车出海美国！VinFast官宣首家美国工厂动工，赴美上市亦获批', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694354'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694354" } 2023-09-05 18:28:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 29, 3, 2, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软警告：如果无法获得足够GPU，云服务可能会中断', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694353'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694353" } 2023-09-05 18:28:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 21, 46, 35, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '芯片王者归来？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694343'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694343" } 2023-09-05 18:28:20 [scrapy.extensions.logstats] INFO: Crawled 316 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:28:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 21, 30, 14, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '东方甄选遭抖音封杀？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694340'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694340" } 2023-09-05 18:28:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:27 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 21, 4, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '拐点已至？从英特尔到三星，全球芯片制造商发出了相同的信号', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694337'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694337" } 2023-09-05 18:28:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:31 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 20, 51, 20, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '证监会终于对“套路式离婚”出手了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694335'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694335" } 2023-09-05 18:28:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 17, 16, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Photoshop最新“扩图”玩法：对话交互，一键扩图，让想象力「无限拓展」', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694318'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694318" } 2023-09-05 18:28:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:38 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 14, 31, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '充电桩集体涨价，开电车不划算了？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694304'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694304" } 2023-09-05 18:28:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690631966) 2023-09-05 18:28:42 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 10, 9, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '民生牟一凌：对待AI浪潮，当下最重要的是区分“革命”与“革新”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694273'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694273" } 2023-09-05 18:28:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:28:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:28:46 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 8, 53, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软、谷歌、Meta：AI巨头「三国争霸」| 【硬AI】', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694224'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694224" } 2023-09-05 18:28:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:28:50 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 7, 33, 40, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '中国汽车业迎里程碑时刻！又一起头部车企重磅合作！这一次是上汽和奥迪', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694266'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694266" } 2023-09-05 18:28:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:28:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 6, 6, 3, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '重回盈利！英特尔二季度业绩及三季度指引超预期，股价盘后涨超7%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694263'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694263" } 2023-09-05 18:28:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:28:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 28, 0, 54, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '为上市预热？Shein披露今年上半年净利润创历史新高', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694259'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694259" } 2023-09-05 18:29:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 19, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '中国汽车历史时刻：大众入股小鹏，最大赢家竟是合肥？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694234'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694234" } 2023-09-05 18:29:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:06 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 18, 59, 2, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '拐点来了？三星预计下半年消费电子需求回升', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694228'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694228" } 2023-09-05 18:29:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 16, 12, 56, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '一块炒到50万元，大厂疯狂囤芯，批量买要走后门，中国版英伟达在哪？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694206'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694206" } 2023-09-05 18:29:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 13, 59, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '首个室温常压超导掀全球热度，数万人正在围观这个中国团队的复现进度', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694201'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694201" } 2023-09-05 18:29:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 13, 45, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '「人造太阳」精准放电！DeepMind实现AI可控核聚变新突破', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694200'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694200" } 2023-09-05 18:29:20 [scrapy.extensions.logstats] INFO: Crawled 332 pages (at 16 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:29:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:22 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 10, 43, 54, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '好莱坞最害怕的事发生了：AI独立搞出了一集《南方公园》', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694187'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694187" } 2023-09-05 18:29:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 8, 37, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软Q4财报：虽有一时失利，但破局之道「呼之欲出」| 【硬AI】', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694173'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694173" } 2023-09-05 18:29:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 6, 43, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '加入AI医疗和企业服务战局！亚马逊新工具总结就诊、帮客户打造自有ChatGPT', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694164'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694164" } 2023-09-05 18:29:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 6, 8, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '发力AI助广告“吸金”：Meta二季度收入超预期猛增11%，盘后涨超7%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694163'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694163" } 2023-09-05 18:29:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 5, 8, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '航空巨头Q2业绩优于预期，空客战术调整，波音现金流意外高涨，股价涨近9% | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694156'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694156" } 2023-09-05 18:29:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690510164) 2023-09-05 18:29:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 2, 42, 20, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '注意了！AI热潮席卷到美国生物科技股', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694155'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694155" } 2023-09-05 18:29:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:29:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:29:43 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 27, 0, 59, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '北美另一充电巨头浮现！欧美日韩七大车企联手打造电动车充电网络', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694152'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694152" } 2023-09-05 18:29:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:29:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 21, 54, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '推进人工智能安全研究，美国“AI四大天王”牵头成立行业机构', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694137'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694137" } 2023-09-05 18:29:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:29:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 21, 52, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软奔向20万亿帝国', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694148'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694148" } 2023-09-05 18:29:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:29:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 21, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '需求太夸张！“减肥神药”全面缺货', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694147'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694147" } 2023-09-05 18:29:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:29:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 21, 1, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '小鹏股价狂飙超30%！大众集团计划7亿美元入股小鹏汽车 成第三大股东', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694146'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694146" } 2023-09-05 18:30:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:02 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 20, 49, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI应用难在哪？财富1000强公司：钱，人才，技术，时间...', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694141'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694141" } 2023-09-05 18:30:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:06 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 16, 59, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'ChatGPT下架官方检测工具，承认AI文字无法鉴别', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694112'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694112" } 2023-09-05 18:30:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 15, 51, 54, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '折叠屏手机火起来了？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694106'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694106" } 2023-09-05 18:30:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 11, 46, 4, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '谷歌Q2财报电话会：LLM重构搜索，Android 14将融合AI工具！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694090'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694090" } 2023-09-05 18:30:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 8, 21, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软谷歌同时交作业，谷歌绝地反击“赢麻”了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694076'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694076" } 2023-09-05 18:30:20 [scrapy.extensions.logstats] INFO: Crawled 349 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:30:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:22 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 7, 35, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '最多五折！马斯克的X下调广告费用', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694067'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694067" } 2023-09-05 18:30:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:26 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 6, 26, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI收入尚未发力、云业务增速持续放缓，微软第四财季不温不火，盘后跌超4%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694065'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694065" } 2023-09-05 18:30:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 5, 56, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'GPT冲击不足惧！二季度谷歌搜索收入加速增长，云业务猛增意外未放缓，盘后一度涨超7% | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694066'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694066" } 2023-09-05 18:30:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 3, 49, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '苹果又被欧洲反垄断监管方盯上，这次是法国', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694063'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694063" } 2023-09-05 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690396940) 2023-09-05 18:30:37 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 26, 2, 24, 16, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '安卓版ChatGPT App来了，率先登陆美印等四国', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694060'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694060" } 2023-09-05 18:30:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:30:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:30:41 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 19, 31, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '特斯拉中国市场二季度营收57亿美元，同比增长超五成', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694037'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694037" } 2023-09-05 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:30:44 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 15, 43, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '谷歌财报前瞻：“AI信仰”继续？广告、云收入是关键', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694014'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694014" } 2023-09-05 18:30:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:30:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 15, 25, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '蔚来子品牌新增单电机方案，积极攻入20万+市场', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694015'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694015" } 2023-09-05 18:30:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:30:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 12, 4, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Chrome和Safari可以用Bing聊天机器人了，微软为了AI走出封闭', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693990'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693990" } 2023-09-05 18:30:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:30:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 11, 38, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '分析师：英伟达的优势是“统治级的”，未来五年AI收入将达3000亿美元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3694000'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3694000" } 2023-09-05 18:31:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 6, 54, 10, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '苹果给开发者尝鲜：上海等地现在可借用Vision Pro，明年归还', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693977'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693977" } 2023-09-05 18:31:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 2, 50, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马斯克对推特又有大动作！小蓝鸟LOGO换X', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693972'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693972" } 2023-09-05 18:31:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 1, 50, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '加不了量就加价？市场不景气，苹果可能给iPhone 15涨价', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693973'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693973" } 2023-09-05 18:31:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 1, 9, 43, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '不忙对外发布但苹果已经给自家GPT“派活”：帮忙设计功能，可能做客服帮手', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693970'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693970" } 2023-09-05 18:31:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 25, 0, 53, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '德国计划推出200亿欧元芯片生产补贴 英特尔、台积电已“锁定”75%资金', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693969'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693969" } 2023-09-05 18:31:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:17 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 24, 16, 3, 59, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI到底行不行？本周，微软迎来多年最重要财报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693916'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693916" } 2023-09-05 18:31:20 [scrapy.extensions.logstats] INFO: Crawled 366 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:31:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:21 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 24, 15, 39, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI将如何打造一种全新的游戏类型？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693914'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693914" } 2023-09-05 18:31:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:24 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 24, 10, 17, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'OpenAI如何赚钱？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693897'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693897" } 2023-09-05 18:31:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 23, 15, 16, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '下周重磅日程：对于全球市场都极度重要的一周来了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693860'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693860" } 2023-09-05 18:31:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690309456) 2023-09-05 18:31:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 23, 10, 36, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软、谷歌、Meta财报下周见！“AI信仰”的关键验证来了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693855'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693855" } 2023-09-05 18:31:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:31:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:31:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 23, 10, 0, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '对话「面壁智能」CEO李大海：国内大模型不要谈竞争，先追上GPT再说！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693674'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693674" } 2023-09-05 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:31:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 23, 9, 17, 43, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 端侧AI模型：Meta加入角逐', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693852'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693852" } 2023-09-05 18:31:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:31:42 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 22, 17, 18, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“正值AI领域关键时刻”！OpenAI信任与安全主管离职', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693847'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693847" } 2023-09-05 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:31:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 22, 16, 18, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '蒋凡重回阿里合伙人', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693846'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693846" } 2023-09-05 18:31:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:31:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 22, 15, 25, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'ChatGPT后，AI下一个“杀手级应用”是什么？硅谷已经All In了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693845'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693845" } 2023-09-05 18:31:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:31:54 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 22, 10, 8, 7, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '开源大模型LLaMA 2会扮演类似Android的角色么？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693838'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693838" } 2023-09-05 18:31:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:31:58 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 22, 8, 48, 4, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '安卓版ChatGPT下周发布！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693835'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693835" } 2023-09-05 18:32:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:32:02 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 22, 3, 40, 32, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI巨头“自控”条例出台，承诺确保产品安全，拜登放话必须警惕AI威胁', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693828'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693828" } 2023-09-05 18:32:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:32:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 22, 1, 43, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '比英伟达有潜力！摩根大通逆势唱多：亚洲芯片股涨势将追上美国芯片股', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693824'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693824" } 2023-09-05 18:32:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:32:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 21, 21, 58, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '联合创始人布林回归，谷歌紧锣密鼓酝酿AI"杀手锏"：最强大模型Gemini最快今年可用！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693810'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693810" } 2023-09-05 18:32:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:32:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 21, 21, 10, 6, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '百度给“百模大战”泼了盆冷水', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693812'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693812" } 2023-09-05 18:32:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:32:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 21, 15, 34, 6, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'ChatGPT重磅上新！教练、营养师人格任你选，自定义指令秒变「高级个人AI助理」', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693786'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693786" } 2023-09-05 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:32:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 21, 13, 43, 54, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赵晓光：过去四个月，AI发生了什么变化？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693777'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693777" } 2023-09-05 18:32:20 [scrapy.extensions.logstats] INFO: Crawled 384 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:32:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:32:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 21, 3, 16, 53, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'iPhone高端机型显示器生产遇阻，苹果新款手机或将面临供货短缺', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693744'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693744" } 2023-09-05 18:32:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1690079772) 2023-09-05 18:32:27 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 21, 3, 13, 4, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '立法未至“自控”先行：AI巨头将承诺产品安全，OpenAI支持发牌批准AI系统开发', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693747'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693747" } 2023-09-05 18:32:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:31 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 21, 47, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '规模超2000亿元！刚刚，全球史上最大并购基金诞生', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693736'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693736" } 2023-09-05 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 20, 22, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '研究论证GPT-4变笨了：数学能力雪崩，代码能力也变差了！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693729'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693729" } 2023-09-05 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 18, 21, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '京东云想打一场翻身仗', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693715'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693715" } 2023-09-05 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:44 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 18, 8, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '苹果AppleGPT，来啦! OpenAI 福利，下周! | 【硬AI】日报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693690'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693690" } 2023-09-05 18:32:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 16, 8, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '身处AI风口、券商列为标杆应用、融资超过1亿美元后，Jasper裁员了！AI“其实不容易”？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693699'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693699" } 2023-09-05 18:32:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:50 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 15, 46, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI救不了台积电，四年来首次季度盈利衰退，下调全年指引 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693684'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693684" } 2023-09-05 18:32:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 15, 26, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '国产豪车也要薅“中产”的羊毛了？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693695'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693695" } 2023-09-05 18:32:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:56 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 14, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '全国算力不到chatgpt的1/10，日本很紧张', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693687'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693687" } 2023-09-05 18:32:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:32:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 13, 59, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '手机端运行AI大模型？Meta和高通达成协议，2024年推出“手机版Llama 2”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693604'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693604" } 2023-09-05 18:33:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:33:03 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 13, 57, 33, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '硅谷AI圈“刷屏文”：VC如何投资AI', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693683'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693683" } 2023-09-05 18:33:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:33:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 6, 46, 39, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '奈飞二季度营收和业绩指引逊于预期，用户增长大超预期，盘后大跌9%丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693649'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693649" } 2023-09-05 18:33:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:33:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 6, 29, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '特斯拉二季度营收超预期劲增47%创历史新高，降价冲击下毛利率创四年新低 | 财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693650'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693650" } 2023-09-05 18:33:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:33:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 20, 0, 4, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '市值几秒暴增600亿！苹果被曝测试苹果GPT、发力生成式AI工具挑战OpenAI', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693642'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693642" } 2023-09-05 18:33:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:33:20 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 21, 58, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '狂热再现！科技股领涨风险资产，散户大军卷土重来，什么信号？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693631'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693631" } 2023-09-05 18:33:20 [scrapy.extensions.logstats] INFO: Crawled 401 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:33:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689880384) 2023-09-05 18:33:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 21, 48, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '分析师：特斯拉自动驾驶出租车最高价值8700亿美元，将颠覆汽车行业！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693616'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693616" } 2023-09-05 18:33:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:27 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 21, 0, 40, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达最大的对手出现了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693628'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693628" } 2023-09-05 18:33:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:31 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 20, 48, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '特斯拉“财报日”来了！除了“价格战”下的利润率，市场还关注这些事', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693626'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693626" } 2023-09-05 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 18, 58, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '联手Meta，微软“背刺”OpenAI！暴涨6倍，Copilot定价涨翻天！\xa0|\xa0【硬AI】\xa0日报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693599'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693599" } 2023-09-05 18:33:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:37 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 11, 4, 40, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达布局GPU云，接近收购LambdaLabs', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693571'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693571" } 2023-09-05 18:33:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:42 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 9, 6, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '溢价远高于预期，华尔街如何看微软的AI定价策略', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693559'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693559" } 2023-09-05 18:33:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:44 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 7, 59, 47, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Office AI版“超贵定价”，GPT4应用逐步落地，微软 CEO：未来AI将增加7-10%全球GDP', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693557'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693557" } 2023-09-05 18:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 7, 49, 43, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '更强的Llama 2开源，可直接商用：一夜之间，大模型格局变了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693556'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693556" } 2023-09-05 18:33:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 7, 15, 53, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国监管对AI密集表态，这一次是美联储', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693552'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693552" } 2023-09-05 18:33:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 6, 41, 22, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美银调查：软着陆押注增加，做多大型科技股成最拥挤交易', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693547'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693547" } 2023-09-05 18:33:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:33:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 5, 16, 33, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '股价涨超10%！嘉信理财Q2业绩下滑仍强于预期，6月客户“撤资”显著放缓丨财报见闻', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693542'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693542" } 2023-09-05 18:34:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:34:03 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 3, 37, 56, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Office 365 AI助手定价昂贵，联手Meta推AI新服务，微软股价创新高', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693540'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693540" } 2023-09-05 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:34:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 19, 2, 29, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '跨境电商大战进行时！Temu在美起诉Shein垄断、“霸凌”供应商', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693544'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693544" } 2023-09-05 18:34:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:34:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 21, 4, 35, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '兴业证券：半导体是成长股中的“顺周期资产”，当前已处于周期底部', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693526'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693526" } 2023-09-05 18:34:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:34:13 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 20, 59, 39, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '解密美国制造业“超级周期”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693522'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693522" } 2023-09-05 18:34:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689774507) 2023-09-05 18:34:16 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 20, 9, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国科技股的“坏消息”：大型基金持仓触碰上限！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693514'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693514" } 2023-09-05 18:34:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:20 [scrapy.extensions.logstats] INFO: Crawled 419 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:34:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:20 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 19, 35, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '纳指“特殊调权”临近！微软、英伟达预计下调比例最大， 博通、Adobe或成最大赢家', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693517'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693517" } 2023-09-05 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:24 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 18, 58, 33, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '报道：SpaceX预计今年营收翻倍至80亿美元 最新估值已近1500亿美元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693503'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693503" } 2023-09-05 18:34:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:27 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 18, 57, 10, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '1万亿美元的“黄金矿”，还是“黄金泡沫”? 大模型挑选指南”新鲜出炉 | 【硬AI】 日报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693487'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693487" } 2023-09-05 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:30 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 17, 49, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '颠覆之间：AI时代的4个猜想', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693485'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693485" } 2023-09-05 18:34:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 13, 45, 19, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '对话「小佩宠物」CEO：抖音营销我不行，但拆解产品，我非常自信 | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693482'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693482" } 2023-09-05 18:34:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 10, 35, 3, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国国务卿会见芯片三巨头高管：听取对在中国开展业务看法', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693475'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693475" } 2023-09-05 18:34:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 6, 13, 35, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软收购动视暴雪再进一步但成交或推迟，巴菲特大举套现', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693455'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693455" } 2023-09-05 18:34:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:42 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 18, 6, 11, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '新规渐行渐近！美国SEC主席警告人工智能给金融稳定带来风险', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693457'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693457" } 2023-09-05 18:34:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:46 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 17, 21, 56, 58, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '宁德时代成立新矿业公司，或有意竞拍四川两处优质锂矿探矿权', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693444'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693444" } 2023-09-05 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:50 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 17, 21, 11, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '千亿芯片巨头突然换帅！中芯国际宣布：董事长辞职', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693438'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693438" } 2023-09-05 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 17, 18, 12, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '对“AI收割”说不！好莱坞掀起60年来最大规模罢工', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693420'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693420" } 2023-09-05 18:34:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:34:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 17, 16, 11, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '担心错过AI风口？德银重磅报告：一切才刚开始', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692703'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692703" } 2023-09-05 18:35:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:35:00 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 17, 15, 53, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '木头姐：英伟达很棒，但这家公司才是AI的未来赢家', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693401'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693401" } 2023-09-05 18:35:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:35:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 17, 13, 20, 33, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '对话无界AI创始人长铗：AI的创业机会在应用层丨创新者Innovator', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693384'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693384" } 2023-09-05 18:35:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689682176) 2023-09-05 18:35:08 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 17, 11, 18, 56, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '中国6月规模以上工业增加值同比增4.4%，上半年同比增3.8%，新能源汽车产量增35%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693376'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693376" } 2023-09-05 18:35:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 16, 19, 40, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Bard、Cladue、GPT掀起海外大模型"混战"，OpenAI开始反内卷？Meta击败 Midjourney | 【硬AI】周报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693347'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693347" } 2023-09-05 18:35:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 16, 19, 24, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“谷歌帮”闪耀AI，大模型奠基之作Transformer论文作者全部离职创业', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693349'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693349" } 2023-09-05 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 16, 15, 44, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | AI大模型向智能移动端侧狂奔', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693342'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693342" } 2023-09-05 18:35:20 [scrapy.extensions.logstats] INFO: Crawled 438 pages (at 19 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:35:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 16, 15, 7, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'GPT-4突然降智，爆料OpenAI重新设计构架，用MOE降本增效', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693340'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693340" } 2023-09-05 18:35:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:26 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 16, 15, 1, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '本周重磅日程：中国上半年经济成绩单，LPR和MLF会降息吗？特斯拉、台积电迎财报大考', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693339'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693339" } 2023-09-05 18:35:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 16, 12, 26, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '量子霸权里程碑！谷歌量子计算机6秒内完成47年计算，超越世界第一超算', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693338'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693338" } 2023-09-05 18:35:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 16, 9, 8, 39, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '印度吹了三年的半导体，就这？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693334'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693334" } 2023-09-05 18:35:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:37 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 16, 8, 44, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '锂电一哥，四川崛起', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693331'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693331" } 2023-09-05 18:35:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:41 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 15, 20, 11, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '终于，特斯拉首辆Cybertruck下线，“丑陋的玩具”还是“冲击成本极限的油车大杀器”？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693328'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693328" } 2023-09-05 18:35:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:45 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 15, 17, 5, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '华为这次又跑在了前面？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693326'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693326" } 2023-09-05 18:35:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 15, 15, 15, 16, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | “双英”开战中国AGI市场', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693319'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693319" } 2023-09-05 18:35:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 15, 13, 13, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马斯克披露xAI细节：6年实现AGI，特斯拉推特资源都能用！2万块N卡被曝已到位', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693318'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693318" } 2023-09-05 18:35:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 15, 4, 58, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '来得快去得更快！Threads炒作暂歇，日活用户下降、用户时长腰斩', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693302'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693302" } 2023-09-05 18:35:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:35:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 15, 3, 18, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '中报几家欢喜几家愁：晶科能源净利增三倍、比亚迪增两倍，锂矿、半导体公司两位数剧减', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693300'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693300" } 2023-09-05 18:36:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689563936) 2023-09-05 18:36:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 15, 0, 44, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“最强苹果分析师”：新款Watch Ultra部分钛金属机械部件或用3D打印', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693294'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693294" } 2023-09-05 18:36:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:05 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 14, 19, 56, 39, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '两小时完成大模型部署！华为AI存储新品有什么亮点？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693285'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693285" } 2023-09-05 18:36:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 14, 16, 49, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '印度车市大战在即？报道称比亚迪将投资10亿美元印度建厂', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693269'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693269" } 2023-09-05 18:36:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 14, 15, 16, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '张勇要再造一个“阿里”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693262'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693262" } 2023-09-05 18:36:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 14, 15, 16, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '阿里P9跌落神坛', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693263'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693263" } 2023-09-05 18:36:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 14, 14, 20, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '高盛深度报告：生成式AI是炒作，还是真变革？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693209'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693209" } 2023-09-05 18:36:20 [scrapy.extensions.logstats] INFO: Crawled 456 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:36:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:21 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 14, 9, 8, 3, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国新能源车股躁动继续！一张50辆车的小订单，令屡遭做空的Nikola大涨61%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693229'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693229" } 2023-09-05 18:36:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 14, 6, 34, 22, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '拦路虎再来！美国FTC寻求采取紧急措施，试图推迟微软收购动视暴雪交易', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693222'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693222" } 2023-09-05 18:36:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:28 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 14, 5, 29, 13, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国监管机构首次正式调查ChatGPT！FTC朝OpenAI“开火”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693226'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693226" } 2023-09-05 18:36:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 14, 1, 44, 54, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '谷歌Bard“史上最大更新”！终于会说会读图，支持中文等40多种语言', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693221'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693221" } 2023-09-05 18:36:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 13, 21, 58, 42, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI，正在疯狂污染全球互联网', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693198'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693198" } 2023-09-05 18:36:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:40 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 13, 21, 49, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '奥迪“求助”中国车企', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693208'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693208" } 2023-09-05 18:36:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:44 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 13, 20, 15, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '大模型「百团大战」，网信办「上道保险」 | 【硬 AI】日报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693193'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693193" } 2023-09-05 18:36:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:48 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 13, 18, 20, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马斯克妥协了？报道：特斯拉商谈在印度建厂，年产能或达50万辆', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693175'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693175" } 2023-09-05 18:36:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:52 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 13, 15, 56, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '开源大模型的“安卓时刻”要来了！Meta将发布商用版LLaMA', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692963'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692963" } 2023-09-05 18:36:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689353041) 2023-09-05 18:36:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 13, 15, 4, 36, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '国家网信办等七部门联合公布《生成式人工智能服务管理暂行办法》', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693161'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693161" } 2023-09-05 18:36:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 13, 8, 29, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美股AI热开始退潮？散户投资者开始远离AI', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693124'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693124" } 2023-09-05 18:37:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:05 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 13, 3, 30, 56, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马斯克官宣成立xAI人工智能公司，目标是理解“宇宙的真实本质”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693115'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693115" } 2023-09-05 18:37:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 13, 2, 42, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '进一步押注医药AI，英伟达向生物科技公司Recursion投资5000万美元', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693119'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693119" } 2023-09-05 18:37:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 12, 21, 54, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '全球首款液氧甲烷火箭发射成功，下一步是什么？何时商业化？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693103'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693103" } 2023-09-05 18:37:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 12, 20, 0, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“类似十年前的英特尔！”花旗看好英伟达：将占据90%的AI芯片份额', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693089'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693089" } 2023-09-05 18:37:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:17 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 12, 19, 10, 40, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'ChatGPT最强竞品重磅升级，但我们发现一些小缺点 | 【硬 AI】 日报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693088'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693088" } 2023-09-05 18:37:20 [scrapy.extensions.logstats] INFO: Crawled 473 pages (at 17 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:37:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:21 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 12, 18, 20, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '媲美人类医生！谷歌医疗AI大模型“大显身手', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693079'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693079" } 2023-09-05 18:37:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 12, 15, 16, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美股二季报焦点：AI是下一个互联网，还是如元宇宙昙花一现？市场将紧盯这些财报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693059'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693059" } 2023-09-05 18:37:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 12, 7, 52, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '经合组织警告：超四分之一工作有风险，人工智能将引发劳动力市场动荡！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693028'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693028" } 2023-09-05 18:37:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 12, 2, 55, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '光伏龙头半年报预喜，晶澳科技净利翻倍增长，亿晶光电净利增十倍但终止13亿定增', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693020'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693020" } 2023-09-05 18:37:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:37 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 11, 22, 17, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“快递首富”要冲击港交所了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693008'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693008" } 2023-09-05 18:37:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:41 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 11, 22, 4, 11, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '七年最差！新加坡淡马锡2023财年回报率为-5.1％', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3693006'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3693006" } 2023-09-05 18:37:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:45 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 11, 20, 19, 59, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '扎克伯格“大战”马斯克，Code interpreter被玩出花 | 【硬 AI】 日报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692995'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692995" } 2023-09-05 18:37:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 11, 19, 50, 59, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '5天1亿用户，但Threads取代不了Twitter', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692993'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692993" } 2023-09-05 18:37:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689231876) 2023-09-05 18:37:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 11, 16, 34, 5, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Model 2要来了？特斯拉据报道已完成新一代平价电动车设计', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692969'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692969" } 2023-09-05 18:37:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:37:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:37:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 11, 16, 28, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'GPT-4“终极大揭秘”：1.8万亿巨量参数、训练一次6300万美元！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692958'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692958" } 2023-09-05 18:38:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:02 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 11, 16, 27, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '科技部：强化企业科技创新主体地位，加快培育科技领军企业', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692975'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692975" } 2023-09-05 18:38:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:06 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 11, 14, 29, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI引爆，HBM崛起', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692961'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692961" } 2023-09-05 18:38:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 10, 21, 55, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达A800芯片售价超十万元！有经销商惜售，涨幅最高三成', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692920'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692920" } 2023-09-05 18:38:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:13 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 10, 21, 7, 22, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '刚刚！“天气预报”有救了，牛津、剑桥“纷纷投降” | 【硬 AI】 日报', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692913'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692913" } 2023-09-05 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 10, 15, 30, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI炒作引爆芯片需求，台积电二季度营收超预期', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692877'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692877" } 2023-09-05 18:38:20 [scrapy.extensions.logstats] INFO: Crawled 489 pages (at 16 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:38:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:22 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 10, 15, 16, 4, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '软银“转守为攻”第一笔投资：机器人', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692867'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692867" } 2023-09-05 18:38:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:24 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 10, 13, 59, 14, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '「GPT-4.5」来了！地表最强Code Interpreter与Midjourney联动，5分做出大片', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692860'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692860" } 2023-09-05 18:38:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:27 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 10, 13, 29, 20, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '证监会科技监管局局长：关于大模型生态建设的若干思考', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692861'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692861" } 2023-09-05 18:38:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:31 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 9, 21, 52, 30, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI一周见闻：OpenAI放出史诗级更新，小工具们要玩完了？腾讯云MaaS再升级，阿里发布【通义万相】 | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692826'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692826" } 2023-09-05 18:38:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 9, 14, 33, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '逆天“魔法”正式解禁！GPT-4以来最强应用“代码解释器”上线！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692799'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692799" } 2023-09-05 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 9, 13, 49, 18, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '本周重磅日程：中国金融数据、中美CPI出炉，美联储公布经济褐皮书', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692792'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692792" } 2023-09-05 18:38:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:41 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 19, 34, 24, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '华为加入大模型之战', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692785'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692785" } 2023-09-05 18:38:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:45 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 17, 47, 6, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软新出热乎论文：Transformer扩展到10亿token', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692782'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692782" } 2023-09-05 18:38:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1689064445) 2023-09-05 18:38:49 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 15, 3, 21, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '13000亿！中东北非五国的绿氢野心，正创造下一个石油时代！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692774'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692774" } 2023-09-05 18:38:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:38:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:38:52 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 13, 34, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '黄仁勋是如何管理万亿英伟达的', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692772'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692772" } 2023-09-05 18:38:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:38:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 10, 49, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '定了！隆基、通威、晶科等9大光伏巨头正式统一矩形硅片组件尺寸', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692762'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692762" } 2023-09-05 18:39:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 10, 21, 42, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '重磅！ChatGPT新增超级功能，人人都是数据分析师！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692761'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692761" } 2023-09-05 18:39:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:05 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 9, 10, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“终极能源”竞赛：全球首个全高温超导核聚变实验装置，中核五公司官宣承建', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692757'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692757" } 2023-09-05 18:39:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:09 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 6, 30, 22, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '放慢生产速度还不够？苹果打算让用户先预约再购买头显Vision Pro', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692754'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692754" } 2023-09-05 18:39:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:11 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 5, 8, 2, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '爱因斯坦、马斯克光环加持！Character.AI火爆，下载量已达数百万', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692749'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692749" } 2023-09-05 18:39:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:15 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 4, 54, 57, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '冰火两重天！AI繁荣尚未打破存储芯片的低迷状态', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692748'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692748" } 2023-09-05 18:39:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 3, 56, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“不降价联盟”成立次日就有车企降价，上汽大众ID.3最高降23%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692752'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692752" } 2023-09-05 18:39:20 [scrapy.extensions.logstats] INFO: Crawled 507 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 8, 1, 27, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '推特劲敌Threads注册破7000万，真假马斯克怎么回应？本尊含笑不语，冒牌喊话打一架', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692745'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692745" } 2023-09-05 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:27 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 22, 22, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '启明创投周志峰：AI2.0将重建整个产业架构，新科技浪潮催生新巨头', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692740'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692740" } 2023-09-05 18:39:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:30 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 22, 0, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '刚承诺不打"价格战"就变相降价？特斯拉在全球范围推出推荐购车现金奖励', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692738'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692738" } 2023-09-05 18:39:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:35 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 21, 24, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI大模型激烈混战！一天之内，华为、阿里、腾讯等巨头纷纷出手', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692735'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692735" } 2023-09-05 18:39:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 15, 50, 26, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '持仓五年后，“估值大师”卖出英伟达，他看到了什么?', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692573'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692573" } 2023-09-05 18:39:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:43 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 15, 48, 21, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '特斯拉门店可能启动机器人卖车？也许不是你想的那样', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692699'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692699" } 2023-09-05 18:39:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688799801) 2023-09-05 18:39:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 14, 44, 10, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '历史经验对AI产业β的启示录', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692533'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692533" } 2023-09-05 18:39:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:39:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:39:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 14, 43, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '启明创投：最迟2024中国GPT4将诞生，长文本是大语言模型关键', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692688'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692688" } 2023-09-05 18:39:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:39:55 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 10, 51, 58, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美股全线下跌的这天，微软为何不跌？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692674'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692674" } 2023-09-05 18:39:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:39:59 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 8, 57, 58, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '中信证券：如何看待ChatGPT近期热度持续回落？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692670'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692670" } 2023-09-05 18:40:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 6, 55, 13, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '美国FDA批准阿尔茨海默病药品Leqembi，有望成为首个纳入医疗保险的此类药物', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692656'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692656" } 2023-09-05 18:40:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:06 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 2, 31, 31, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '推特劲敌来势汹汹！Meta上线Threads 16小时超3000万人注册', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692654'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692654" } 2023-09-05 18:40:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 1, 46, 55, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '新浪潮已来！AI意外成了美国科技业的救命稻草', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692645'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692645" } 2023-09-05 18:40:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 7, 1, 5, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '特斯拉之后车企连传佳音，二季度丰田在美销售增近15%、通用增近19%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692543'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692543" } 2023-09-05 18:40:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:17 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 19, 57, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '押注新浪潮！韩国目标成为全球第三大AI强国', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692630'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692630" } 2023-09-05 18:40:20 [scrapy.extensions.logstats] INFO: Crawled 523 pages (at 16 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:21 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 19, 55, 59, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI见闻日报：OpenAI又找到了AI的下一个竟争地；马斯克扬言：年底自动驾驶就能全面落地 | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692629'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692629" } 2023-09-05 18:40:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:26 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 18, 2, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '《流浪地球》导演谈AI危机：对AI好点，给自己留条后路', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692620'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692620" } 2023-09-05 18:40:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 16, 53, 38, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'WPS AI来了——我们不生产大模型，而是大模型最好的应用者 | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692598'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692598" } 2023-09-05 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:33 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 16, 39, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软大中华区董事长：未来每一个应用程序都将由AI驱动，这是六大重点应用场景', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692599'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692599" } 2023-09-05 18:40:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 15, 34, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '用22000个英伟达H100入局AI，初创企业的豪赌', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692595'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692595" } 2023-09-05 18:40:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:41 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 15, 33, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI智能体卷爆大模型！AutoGPT等4大Agent打擂，「西部世界」谁将成为软件2.0？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692597'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692597" } 2023-09-05 18:40:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688712250) 2023-09-05 18:40:44 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 15, 20, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '数周调研后，知名分析师预判：“AI货币化”快于预期，微软明年上“三万亿”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692590'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692590" } 2023-09-05 18:40:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:40:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:40:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 14, 39, 2, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 腾讯云的AGI基建：用向量数据库助推LLM', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692592'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692592" } 2023-09-05 18:40:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:40:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 14, 10, 44, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '图灵奖得主杨立昆：不喜欢AGI，让AI安全的长远方案是开源', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692589'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692589" } 2023-09-05 18:40:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:40:54 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 11, 35, 13, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '胡厚崑介绍华为AI战略：下一阶段深耕算力和大模型，盘古大模型3.0即将发布', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692580'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692580" } 2023-09-05 18:40:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:40:58 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 6, 6, 18, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '一周内OpenAI再遇官司！两位作家起诉ChatGPT侵犯版权', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692547'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692547" } 2023-09-05 18:41:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:02 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 5, 21, 5, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '张宏江：AI大爆炸至少将持续十年', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692523'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692523" } 2023-09-05 18:41:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:06 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 5, 20, 32, 10, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“增长中枢下滑的十年”，日本三类科技股如何表现？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692520'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692520" } 2023-09-05 18:41:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:08 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 5, 19, 55, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '这场重磅大会上，阿里巴巴、网易同台发声！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692516'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692516" } 2023-09-05 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:12 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 5, 19, 16, 56, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI见闻日报：AI智能体成为科技巨头争抢的新风口 | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692514'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692514" } 2023-09-05 18:41:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:16 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 5, 14, 54, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '进军南美！比亚迪豪掷45亿在巴西设厂，亚洲之外首次建厂', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692485'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692485" } 2023-09-05 18:41:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 5, 14, 20, 48, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '科学家发现「返老还童」蛋白！Nature：抗衰老蛋白让老年猴子恢复记忆', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692479'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692479" } 2023-09-05 18:41:20 [scrapy.extensions.logstats] INFO: Crawled 541 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:41:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:22 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 5, 7, 8, 29, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '特斯拉6月中国产汽车销量达93680辆 同比大增近20%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692454'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692454" } 2023-09-05 18:41:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:26 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 5, 1, 7, 51, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '比亚迪泰国卖爆了，奇瑞、长安、上汽和合众都要去！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692444'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692444" } 2023-09-05 18:41:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 21, 31, 3, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '大摩：特斯拉今年交付量有望达190万', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692436'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692436" } 2023-09-05 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 21, 7, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '活在算法里? meta重磅公开：算法将你精准拿捏', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692214'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692214" } 2023-09-05 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688628037) 2023-09-05 18:41:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 19, 3, 23, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI见闻日报：GPT4的自我修复机制震惊英伟达科学家；Ai新玩法-用心跳分析提高用户推荐率 | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692426'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692426" } 2023-09-05 18:41:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:41:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 15, 22, 46, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | OPPO高端破局：新旗舰店里的攻略密码', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692406'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692406" } 2023-09-05 18:41:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:41:42 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 14, 54, 4, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Stability AI CEO放出豪言：5年内，人类程序员将不复存在', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692402'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692402" } 2023-09-05 18:41:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:41:45 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 11, 37, 37, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Rokid联合创始人向文杰：所有AR厂商都期待苹果加入 | 创新者Innovator', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692381'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692381" } 2023-09-05 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:41:50 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 11, 34, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '特斯拉光鲜背后的隐忧：连续五个季度，产量超过交付量', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692377'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692377" } 2023-09-05 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:41:53 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 10, 35, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '实控人遭留置、多次陷行贿风波：卫宁健康“医疗+AI”前景难料', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692389'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692389" } 2023-09-05 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:41:57 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 9, 38, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '事关“芯片粮食”！两部门出手：对两大稀有金属出口管制！影响有多大？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692378'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692378" } 2023-09-05 18:42:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:42:01 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 8, 28, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '桥水如何投资AI？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692367'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692367" } 2023-09-05 18:42:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:42:04 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 6, 37, 49, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '不只特斯拉，Rivian二季度交付超预期，股价暴涨超17%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692363'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692363" } 2023-09-05 18:42:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:42:08 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 2, 30, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '英伟达“狂投”AI独角兽，“钱+GPU”组建最强AI产业联盟？', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692360'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692360" } 2023-09-05 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:42:12 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 4, 0, 31, 18, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '全球亿万富翁上半年成绩单：马斯克和小扎领衔净值增长，阿达尼和伊坎垫底', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692357'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692357" } 2023-09-05 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:42:16 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 21, 16, 45, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '被AI死死压制，美股红利股遭遇2009年来“最惨半年”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692346'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692346" } 2023-09-05 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:42:19 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 20, 23, 47, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '进军中国市场！报道称Meta与腾讯在VR头显合作方面取得进展', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692341'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692341" } 2023-09-05 18:42:20 [scrapy.extensions.logstats] INFO: Crawled 559 pages (at 18 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:42:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:42:23 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 19, 6, 17, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI见闻日报：准独角兽释放出新信号—模型厂布局下游应用正成为趋势 | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692334'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692334" } 2023-09-05 18:42:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:42:27 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 18, 10, 1, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '360创始人周鸿祎：大模型不是风口和泡沫，真正的机会在企业级市场', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692329'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692329" } 2023-09-05 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688468603) 2023-09-05 18:42:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 16, 13, 52, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '22人估值10亿！对话Character.ai CEO：与其直接研究医学，不如研究人工智能', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692209'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692209" } 2023-09-05 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:42:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:42:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 16, 1, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '陶哲轩转赞！ChatGPT自动证明重大突破，10年后AI将称霸数学界', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692312'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692312" } 2023-09-05 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:42:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 15, 43, 6, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '报道：苹果大幅下调Vision Pro头显产量预期，不及之前目标一半', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692310'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692310" } 2023-09-05 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:42:43 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 14, 51, 27, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '马斯克奇葩新规激怒用户！网友气炸狂喷，推特大宕机', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692306'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692306" } 2023-09-05 18:42:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:42:47 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 14, 34, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '景林“内部信”曝光：AI板块必须参与', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692305'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692305" } 2023-09-05 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:42:51 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 13, 34, 12, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI 2.0：十年之后我们还能做什么', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692303'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692303" } 2023-09-05 18:42:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:42:56 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 13, 28, 10, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '微软、谷歌、亚马逊，正在打响大模型时代的云战争', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692302'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692302" } 2023-09-05 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:43:00 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 11, 56, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '赛道Hyper | 荣耀赵明：告别苹果一家独大是时候了！', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692299'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692299" } 2023-09-05 18:43:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:43:03 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 11, 20, 28, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '万字长文，当机器人拥抱大模型', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692296'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692296" } 2023-09-05 18:43:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:43:07 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 8, 49, 34, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '价格战+新补贴，特斯拉二季度交付再创纪录！同比大涨83%', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692287'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692287" } 2023-09-05 18:43:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:43:10 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 3, 8, 2, 32, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '人民日报：推动虚拟人产业健康规范发展', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692283'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692283" } 2023-09-05 18:43:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:43:14 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 2, 19, 50, 41, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '“做多中国”进行中', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692265'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692265" } 2023-09-05 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:43:18 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 2, 18, 15, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '对冲基金Coatue详解2023：一半是海水，一半是火焰', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692261'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692261" } 2023-09-05 18:43:20 [scrapy.extensions.logstats] INFO: Crawled 575 pages (at 16 pages/min), scraped 0 items (at 0 items/min) 2023-09-05 18:43:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:43:21 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 2, 17, 12, 25, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '软件巨头拥抱AI的范本：Adobe如何一步步完成“AI转型”', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692253'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692253" } 2023-09-05 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:43:25 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 2, 16, 34, 8, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'AI一周见闻：微软win11启动AI变革；英伟达助力办公软件降本23%；视频训练成为机器人重要学习路径 | 见智研究', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692258'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692258" } 2023-09-05 18:43:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688372032) 2023-09-05 18:43:29 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 2, 13, 45, 32, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '拆解光年之外交易：美团兜底，王慧文5000万美元没了', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692254'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692254" } 2023-09-05 18:43:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688276732) 2023-09-05 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688276732) 2023-09-05 18:43:32 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 2, 10, 8, 59, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '两轮光伏周期的全方位比较', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692248'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692248" } 2023-09-05 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688276732) 2023-09-05 18:43:36 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 1, 17, 6, 47, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': '造车新势力6月成绩单：埃安继续攀高，理想首次突破三万，蔚来重回万辆，小鹏依旧掉队', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692242'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error raise DuplicateKeyError(error.get("errmsg"), 11000, error) pymongo.errors.DuplicateKeyError: E11000 duplicate key error collection: magic_mirror_article.articles index: url_1 dup key: { : "https://awtmt.com/articles/3692242" } 2023-09-05 18:43:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://api-prod.wallstreetcn.com/apiv1/content/articles?limit=15&platform=tech-platform&cursor=1693896585,1688276732) 2023-09-05 18:43:39 [scrapy.core.scraper] ERROR: Error processing {'content': '', 'date': datetime.datetime(2023, 7, 1, 15, 25, 6, tzinfo=datetime.timezone(datetime.timedelta(0, 28800))), 'title': 'Windows Copilot抢先上手！GPT-4全线接入Win11，重新定义操作系统', 'type': 'awtmt', 'url': 'https://awtmt.com/articles/3692238'} Traceback (most recent call last): File "/home/ubuntu/.local/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/pipelines.py", line 36, in process_item File "/tmp/magic_mirror-1641895723-yww0s1fv.egg/magic_mirror/db/db_helper.py", line 81, in insert_article File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert check_keys, manipulate, write_concern) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 599, in _insert bypass_doc_val, session) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/collection.py", line 580, in _insert_one _check_write_command_response(result) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 207, in _check_write_command_response _raise_last_write_error(write_errors) File "/home/ubuntu/.local/lib/python3.6/site-packages/pymongo/helpers.py", line 188