Theme images by Storman. Powered by Blogger.

Software Testing

[best practices][feat1]

Recent

recentposts

Popular

Comments

recentcomments

Most Recent

Random Posts

randomposts

Facebook

page/http://facebook.com/letztest

Wednesday, March 23, 2016

Is maintenance of Selenium Scripts - a hell ???

Most times we find ourselves scratching our heads and thinking, 'Why did it fail? It was working perfectly in the local server....'. Timeout or 'Session ID is null or Element not found' (my favorite) errors can be especially annoying when we are currently working on the most famous testing task: make all test pass. Let's analyze together how to fix this unhealthy situation.

First of all we need to redefine our task with management. Why so? Having dummy test methods is definitely not what we want to achieve (and not what managers expect from us). Our real task can be defined as:

Make your tests cover as many functionalities as possible, but avoid false results at ALL COSTS.

I emphasized 'all costs' because I want to make a point which you may find controversial:

Even the most important tests should be excluded from automated suite if they are unstable. After exclusion we need to:

a) prioritize test-fixing task (according to test importance/coverage)
b) perform manual test until automated one isn't stable

Certainly do not run test locally (and do not force programmers to do that...). This approach leads to nowhere.

I know we shouldn't, but what if we depend on other services, DBs, factors?Automated test dependencies should be verified before test execution, and if such one exists test should be ignored.

There is one thing which we often forget about. As a QAs/testers we are responsible for building trust in automated tests throughout team/company. False test results are the single most important factor which reduces (or even destroys) this trust.

Even from the most selfish perspective there is important argument against non-stable tests. Writing/maintaining tests with false results will combine you work image in the eyes of others with word 'FAILURE'. Avoid it at all costs.

0 on: "Is maintenance of Selenium Scripts - a hell ???"