Amazon Metadata Download Failing: No Cached Page

[Skates]

Version: 7.2
OS: Windows 11

Issue Description:

While trying to Download Metadata, Amazon.com as a source is constantly failing when performing a meta search. The predominant message is "Ignoring ... as it has no cached page"

However, when taking the search string and copying it to a web browser, the pages are cached.

Web Search Example: https://www.google.com/search?q=Atomic+Habits+James+Clear+site%3Awww.amazon.com

1st Result is Correct and Cache Works: https://webcache.googleusercontent.com/search?q=cache:6KofreUAPSQJ:https://www.amazon.com/Atomic-Habits-Proven-Build-Break/dp/0735211299&hl=en&gl=us

For some reason, Calibre is not able to see the cached page. This is just one example but happens in 80-90% of my library searches.

Attached is one example:

calibre, version 7.2.0
ERROR: No matches found: <p>Failed to find any books that match your search. Try making the search <b>less specific</b>. For example, use only the author's last name and a single distinctive word from the title.<p>To see the full log, click "Show details".

Running identify query with parameters:
{'title': 'Atomic Habits', 'authors': ['James Clear'], 'identifiers': {'isbn': '9781039515307', 'google': '50bTzgEACAAJ'}, 'timeout': 30}
Using plugins: Amazon.com (1, 3, 5)
The log from individual plugins is below

****************************** Amazon.com (1, 3, 5) ******************************
Found 0 results
Downloading from Amazon.com took 3.08135986328125
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=%289781039515307+or+978-1039515307%29+site%3Awww.amazon.com
Failed to find any results on results page, with title: (9781039515307 or 978-1039515307) site:www.amazon.com - Google Search
No search engine results for terms: (9781039515307 OR 978-1039515307)
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%289781039515307+or+978-1039515307%29+site%3Awww.amazon.com
Failed to find any results on results page, with title: (9781039515307 or 978-1039515307) site:www.amazon.com - Search
No search engine results for terms: (9781039515307 OR 978-1039515307)
No matches found with identifiers, retrying using only title and authors. Query: ['(9781039515307', 'OR', '978-1039515307)']
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Atomic+Habits+James+Clear+site%3Awww.amazon.com
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habitsamazon.comhttps://www.amazon.com › atomic-habits › k=atomic+...' as it has no cached page
Ignoring 'Atomic Habitsamazon.comhttps://www.amazon.com › atomic-habits › k=atomic+...' as it has no cached page
Ignoring 'Atomic Habitsamazon.comhttps://www.amazon.com › atomic-habits › k=atomic+...' as it has no cached page
Ignoring 'Atomic Habitsamazon.comhttps://www.amazon.com › atomic-habits › k=atomic+...' as it has no cached page
Ignoring 'Atomic Habitsamazon.comhttps://www.amazon.com › atomic-habits › k=atomic+...' as it has no cached page
Ignoring 'Atomic Habitsamazon.comhttps://www.amazon.com › atomic-habits › k=atomic+...' as it has no cached page
Ignoring 'Atomic Habits: An Easy and Proven Way... by James Clearamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy and Proven Way... by James Clearamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy and Proven Way... by James Clearamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy and Proven Way... by James Clearamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy and Proven Way... by James Clearamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy and Proven Way... by James Clearamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Bui...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-James-Clea...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-James-Clea...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-James-Clea...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-James-Clea...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-James-Clea...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-James-Clea...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-James-Clea...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build... ... - Amazonamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build... ... - Amazonamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build... ... - Amazonamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build... ... - Amazonamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build... ... - Amazonamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build... ... - Amazonamazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring '[By James Clear ] Atomic Habits (Paperback ...amazon.comhttps://www.amazon.com › Atomic-Habits-Paperback-...' as it has no cached page
Ignoring '[By James Clear ] Atomic Habits (Paperback ...amazon.comhttps://www.amazon.com › Atomic-Habits-Paperback-...' as it has no cached page
Ignoring '[By James Clear ] Atomic Habits (Paperback ...amazon.comhttps://www.amazon.com › Atomic-Habits-Paperback-...' as it has no cached page
Ignoring '[By James Clear ] Atomic Habits (Paperback ...amazon.comhttps://www.amazon.com › Atomic-Habits-Paperback-...' as it has no cached page
Ignoring '[By James Clear ] Atomic Habits (Paperback ...amazon.comhttps://www.amazon.com › Atomic-Habits-Paperback-...' as it has no cached page
Ignoring '[By James Clear ] Atomic Habits (Paperback ...amazon.comhttps://www.amazon.com › Atomic-Habits-Paperback-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring 'Atomic Habits: An Easy & Proven Way to Build Good ...amazon.comhttps://www.amazon.com › Atomic-Habits-Proven-Build-...' as it has no cached page
Ignoring '[By James Clear] Atomic Habits: An Easy & Proven Way to ...amazon.comhttps://www.amazon.com › James-Clear-Atomic-Habit...' as it has no cached page
Ignoring '[By James Clear] Atomic Habits: An Easy & Proven Way to ...amazon.comhttps://www.amazon.com › James-Clear-Atomic-Habit...' as it has no cached page
Ignoring '[By James Clear] Atomic Habits: An Easy & Proven Way to ...amazon.comhttps://www.amazon.com › James-Clear-Atomic-Habit...' as it has no cached page
Ignoring '[By James Clear] Atomic Habits: An Easy & Proven Way to ...amazon.comhttps://www.amazon.com › James-Clear-Atomic-Habit...' as it has no cached page
Ignoring '[By James Clear] Atomic Habits: An Easy & Proven Way to ...amazon.comhttps://www.amazon.com › James-Clear-Atomic-Habit...' as it has no cached page
Ignoring '[By James Clear] Atomic Habits: An Easy & Proven Way to ...amazon.comhttps://www.amazon.com › James-Clear-Atomic-Habit...' as it has no cached page
Ignoring 'Atomic Habit By James Clear.. Paperbackamazon.comhttps://www.amazon.com › Atomic-Habit-James-Clear-Pa...' as it has no cached page
Ignoring 'Atomic Habit By James Clear.. Paperbackamazon.comhttps://www.amazon.com › Atomic-Habit-James-Clear-Pa...' as it has no cached page
Ignoring 'Atomic Habit By James Clear.. Paperbackamazon.comhttps://www.amazon.com › Atomic-Habit-James-Clear-Pa...' as it has no cached page
Ignoring 'Atomic Habit By James Clear.. Paperbackamazon.comhttps://www.amazon.com › Atomic-Habit-James-Clear-Pa...' as it has no cached page
Ignoring 'Atomic Habit By James Clear.. Paperbackamazon.comhttps://www.amazon.com › Atomic-Habit-James-Clear-Pa...' as it has no cached page
Ignoring 'Atomic Habit By James Clear.. Paperbackamazon.comhttps://www.amazon.com › Atomic-Habit-James-Clear-Pa...' as it has no cached page
Ignoring 'Atomic Habit By James Clear.. Paperbackamazon.comhttps://www.amazon.com › Atomic-Habit-James-Clear-Pa...' as it has no cached page
Failed to find any results on results page, with title: Atomic Habits James Clear site:www.amazon.com - Google Search
No search engine results for terms: Atomic Habits James Clear
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Atomic+Habits+James+Clear+site%3Awww.amazon.com
Failed to find any results on results page, with title: Atomic Habits James Clear site:www.amazon.com - Search
No search engine results for terms: Atomic Habits James Clear
No matches found with query: ['Atomic', 'Habits', 'James', 'Clear']

********************************************************************************
The identify phase took 3.21 seconds
The longest time (3.081360) was taken by: Amazon.com
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[Kovid Goyal (kovid)]

Fixed in branch master. The fix will be in the next release. calibre is usually released every alternate Friday.