Page 1 of 1

GetPage function broken for rotten tomatoes

Posted: 2017-09-04 09:27:20
by daws0n
Last year I made a script to scrape rotten tomatoes movie URLs for ratings etc... It worked well, but broke suddenly when the site became SSL only.

I updated Ant Movie Catalog to 4.2.1 beta for SSL compatibility, however the get page function for this site is still broken (it works for other websites).

E.g

page := GetPage('https://www.rottentomatoes.com/m/sixth_sense')

I get a persistent error: "error connecting with SSL"

Does anyone know of a potential work around?

Thanks

Posted: 2017-09-04 16:32:08
by antp
I don't remember having encountered that problem with another site :/

Posted: 2017-09-06 21:38:44
by daws0n
Strange isn't it? The getpage works fine with all other SSL sites I have tried except this one. Not sure what makes this site different. Maybe they have some strict user agent criteria?

Posted: 2017-09-07 16:54:46
by antp
Or some special type of certificate/encryption, less common and not supported by AMC.