What do you like best about the product?
I liked that you could get real feedback on your website, and that it was usually pretty detailed as well. Being able to set your own questions that the tester would have to answer/navigate to was really helpful because in some ways you are better able to get targeted guidance rather then generic.
What do you dislike about the product?
My biggest frustration was with the people chosen to interact with my site. I specifically set up "pre-screening" questions because I have a really niche market. Multiple times I got people who either had no clue what my site was about (I am a tarot reader) or they disagree with my profession so they would leave really short answers. And when you are having to pay a significant amount of money for those videos it is hard when you are not getting quality testing.
I really miss the free option that the company used to have. I imagine that there were people who would take advantage of it but for a small business it can be really cost prohibitive to take a risk on a video that may not be at all helpful. Having a free option, even to just get a feel for how the platform works, makes it less frustrating if the test turns out to be not useable. It was frustrating enough that I never paid for more then 3 tests (which was a significant amount of money for what I ended up getting.
I also found that it was frustrating too when people gave brief answers to questions you set, or completely ignored the question. For example I might ask how easy it was to locate something and they would instead talk about how they felt about a color or an image. Still important feedback, but not what I was most concerned about, if that makes sense. Maybe a bit more attention to who gets to do the testing?
Recommendations to others considering the product:
This has a lot of potential to be helpful if you have a site that is in a more mainstream industry. More niche industries seem to be hard to place open-minded testers on. Expect that at least one test will likely be less then helpful. As of last look there is no free option any longer, so expect to pay $50-$100 just to get started.
What problems is the product solving and how is that benefiting you?
The helpful tests that I did get were key to me seeing what path needed to be taken to get to a particular place - ie, if it was easy for clients to locate. I also learned what color schemes seemed to frustrate people as well as what images they would expect to see. After implementing the changes most often submitted I saw a sales increase of 113% the first year. I have also been able to look at my site with a more critical eye.