The Client's Need
RankPeek is a web application that allows marketers to track their product reviews and rating across multiple e-tailers. It also allows user to post replies to those reviews from within the application.
When we were onboarded on to the project, RankPeek was only collecting reviews from Amazon. Their aim was to cover a much wider range of product reviews from many different e-commerce websites.
Crafting the Ideal Solution
Our work involved writing crawlers for scraping reviews from BestBuy, Walmart, Target & NewEgg. We also updated the client facing module to reflect the addition and the changes made in the scraping scripts.
The crawlers were written in NodeJS and deployed on an Amazon EC2 instance. The front-end module was built on Laravel and JS.