GetPage function broken for rotten tomatoes

daws0n · Post by **daws0n** » 2017-09-04 09:27:20

Last year I made a script to scrape rotten tomatoes movie URLs for ratings etc... It worked well, but broke suddenly when the site became SSL only.

I updated Ant Movie Catalog to 4.2.1 beta for SSL compatibility, however the get page function for this site is still broken (it works for other websites).

E.g

page := GetPage('https://www.rottentomatoes.com/m/sixth_sense')

I get a persistent error: "error connecting with SSL"

Does anyone know of a potential work around?

Thanks

Post by **antp** » 2017-09-04 16:32:08

I don't remember having encountered that problem with another site

daws0n · Post by **daws0n** » 2017-09-06 21:38:44

Strange isn't it? The getpage works fine with all other SSL sites I have tried except this one. Not sure what makes this site different. Maybe they have some strict user agent criteria?

Post by **antp** » 2017-09-07 16:54:46

Or some special type of certificate/encryption, less common and not supported by AMC.