Friday, September 16, 2011

Difference Between Performance Testing, Load Testing and Stress Testing – With Examples

← Tips for Writing Test Cases
Q. What is difference between Performance Testing, Load Testing and Stress Testing?
1) Performance Testing:
Performance testing is the testing, which is performed, to ascertain how the components of a system are performing, given a particular situation. Resource usage, scalability and reliability of the product are also validated under this testing. This testing is the subset of performance engineering, which is focused on addressing performance issues in the design and architecture of software product.

Performance Testing Goal:

The primary goal of performance testing includes establishing the benchmark behaviour of the system. There are a number of industry-defined benchmarks, which should be met during performance testing.

Performance testing does not aim to find defects in the application, it address a little more critical task of testing the benchmark and standard set for the application. Accuracy and close monitoring of the performance and results of the test is the primary characteristic of performance testing.

Example:

For instance, you can test the application network performance on Connection Speed vs. Latency chart. Latency is the time difference between the data to reach from source to destination. Thus, a 70kb page would take not more than 15 seconds to load for a worst connection of 28.8kbps modem (latency=1000 milliseconds), while the page of same size would appear within 5 seconds, for the average connection of 256kbps DSL (latency=100 milliseconds). 1.5mbps T1 connection (latency=50 milliseconds) would have the performance benchmark set within 1 second to achieve this target.

For example, the time difference between the generation of request and acknowledgement of response should be in the range of x ms (milliseconds) and y ms, where x and y are standard digits. A successful performance testing should project most of the performance issues, which could be related to database, network, software, hardware etc…



2) Load Testing:
Load testing is meant to test the system by constantly and steadily increasing the load on the system till the time it reaches the threshold limit. It is the simplest form of testing which employs the use of automation tools such as LoadRunner or any other good tools, which are available. Load testing is also famous by the names like volume testing and endurance testing.

The sole purpose of load testing is to assign the system the largest job it could possible handle to test the endurance and monitoring the results. An interesting fact is that sometimes the system is fed with empty task to determine the behaviour of system in zero-load situation.

Load Testing Goal:

The goals of load testing are to expose the defects in application related to buffer overflow, memory leaks and mismanagement of memory. Another target of load testing is to determine the upper limit of all the components of application like database, hardware and network etc… so that it could manage the anticipated load in future. The issues that would eventually come out as the result of load testing may include load balancing problems, bandwidth issues, capacity of the existing system etc…

Example:

For example, to check the email functionality of an application, it could be flooded with 1000 users at a time. Now, 1000 users can fire the email transactions (read, send, delete, forward, reply) in many different ways. If we take one transaction per user per hour, then it would be 1000 transactions per hour. By simulating 10 transactions/user, we could load test the email server by occupying it with 10000 transactions/hour.



3) Stress testing
Under stress testing, various activities to overload the existing resources with excess jobs are carried out in an attempt to break the system down. Negative testing, which includes removal of the components from the system is also done as a part of stress testing. Also known as fatigue testing, this testing should capture the stability of the application by testing it beyond its bandwidth capacity.

The purpose behind stress testing is to ascertain the failure of system and to monitor how the system recovers back gracefully. The challenge here is to set up a controlled environment before launching the test so that you could precisely capture the behaviour of system repeatedly, under the most unpredictable scenarios.

Stress Testing Goal:

The goal of the stress testing is to analyse post-crash reports to define the behaviour of application after failure. The biggest issue is to ensure that the system does not compromise with the security of sensitive data after the failure. In a successful stress testing, the system will come back to normality along with all its components, after even the most terrible break down.

Example:

As an example, a word processor like Writer1.1.0 by OpenOffice.org is utilized in development of letters, presentations, spread sheets etc… Purpose of our stress testing is to load it with the excess of characters.

To do this, we will repeatedly paste a line of data, till it reaches its threshold limit of handling large volume of text. As soon as the character size reaches 65,535 characters, it would simply refuse to accept more data. The result of stress testing on Writer 1.1.0 produces the result that, it does not crash under the stress and that it handle the situation gracefully, which make sure that application is working correctly even under rigorous stress conditions.

How to be a good tester?

It’s a every testers question. How to be a good tester? Apart from the technical knowledge, testing skills, tester should have some personal level skills which will help them to build a good rapport in the testing team.

What are these abilities , skills which make a tester as a good tester? Well, I was reading Dave Whalen’s article “Ugly Baby Syndrome!” and found it very interesting. Dave compared software developers with the parents who deliver a baby (software) with countless efforts. Naturally the product managers, architectures, developers spent their countless time on developing application for the customer. Then they show it to us (testers) and asks: “ How is the baby (Application)? “ And testers tell them often that they have and ugly baby. (Application with Bugs!)

Testers don’t want to tell them that they have ugly baby, but unfortunately its our job. So effectively tester can convey the message to the developers without hurting them. How can be this done? Ya that is the skill of a good tester!

Here are the tips sated by Dave to handle such a delicate situation:

Be honest and Responsive:
Tell developers what are your plans to attack their application.

Be open and available:
If any dev ask you to have a look at the application developed by him before the release, then politely give feedback on it and report any extra efforts needed. Don’t log the bug’s for these notes.

Let them review your tests:
If you have designed or wrote some test cases from the requirement specifications then just show them those test cases. Let them know your stuff as you are going to critic on developers work!

Use of Bug tracker:
Some testers have habit to report each and everything publicly. This attitude hurts the developers. So if you have logged any bug then let the bug tracking system report it to respective developers and managers. Also don’t each time rely on bug tracker, talk personally to developers what you logged and why you logged?

Finally some good personal points:

Don’t take it personally:
Do the job of messenger. You could be a close target always. So build a thick skin!

Be prepared:
A good message in the end, Be prepared for everything! If worst things might not happened till now but they can happen at any moment in your career. So be ready to face them.

[Thougt of the Day: When a virtually flawless application is delivered to a customer, no one says how well tested it was. Development teams will always get the credit. However, if it is delivered with bugs, everyone will wonder who tested it! - - Dave Whalen]

Thinking Out of the Box While Testing Software!

This is a phrase that you come across dozens of times a day, ‘Creative Thinking’ or ‘Out of the Box Thinking’.

Do we know what it actually means when we say ‘Thinking out of the Box’?

As per Wikipedia:

“Thinking outside the box is to think differently, unconventionally or from a new perspective. This phrase often refers to novel or creative thinking”

But the above definition could be extended when we relate it to our field, Software Testing.

When we step into the field of software testing the first thing we are taught or we learn are the Two Boxes, a white box and a black box. Since then all we do is either black box or white box testing. This has limited our mind from thinking beyond the boxes. Did we ever think that going beyond these could help us in gaining a higher pace towards a solid career in software testing?

Below we will be discussing a few techniques which I follow and many of my Mentors follow as well,

Rapid Fire Test Case Creation:
This technique, as the name suggests is about rapidly creating test cases. The first thing that comes to our mind when we talk about test case creation is a Requirement Document, an Excel Sheet and some guidelines provided by the organization. For once keep aside all the things, get an idea about what you think you are about to test , Pick up a Pen and a Paper and write as many scenarios you can write within 60 seconds. Repeat the process till you are not able to think of more scenarios or ideas and finally review them.

You will definitely be surprised by the number of ideas you already have without looking into the requirement document.

Cross Testing Ideas(Analogy):

While testing an application, treat it like an entirely different application which you have used before and then start testing. Doing this you might come across issues which are not part of the requirements but is just a common/generic feature which should be present and often overlooked.

For Example: If you are testing a portal, use it like you use your E mail program or any application which you worked on before and see how the application behaves.

I remember exploring a critical defect using this technique. I was testing a secure login of a finance application and tried altering the URL and navigating to a different page (which was a defect in my last tested application). By doing this I was able to bypass the login mechanism using Secure ID and this was neither a test case nor any other team member thought that this could be one of the scenarios.



Reverse or Backward Testing Ideas:

What is the normal work flow you follow while testing? Isn’t it the exact same steps which were used while developing the application, Requirements >> Unit Cases >> Integration Testing >> System Testing or any other approach?

The minds of the people working on the development of an application are bound to think in the direction which will cover more positive testing. The End User might not do the same every time that is the reason why Production Defects or UAT Defects exists even after extensive rounds of Unit Tests, Integration test and System Tests.

For Example: Requirement says you can upload a file which does not exceed file size of 10 MB. The most testers will follow uploading a 1MB, 2MB, 3 MB and so on till 10 MB is reached or error message is displayed. Why not start with 10MB and then try 11MB and then 9 MB. This example is nothing but a BVA but how many of us have tried using BVA in scenarios other then an input box.



Questioning:

Ideally every QA engineer should know the purpose of a requirement. Putting up questions will help a QA Engineer to refine his purpose of testing. If a QA Engineer is good at questioning he/she will be good at testing by default. You need to make sure none of the questions how so ever small or silly is ignored.

And in turn questioning will also enhance the domain knowledge of the person performing the testing.



Researching:

Researching proves to be very beneficial before starting the testing, just be aware of the issues which other people faced while doing similar assignment. Say you have to start a cross browser testing as one of your assignments. Before starting the tests researching the issues which other people encountered while using the same browser will help you find defects before starting the actual testing.



Pause: an ice breaker

Testing sometimes could be a monotonous process and the ideas may begin to saturate, you might start feeling that none of the solutions are working out or you might even run out of ideas. In such cases an effective Pause can do a lot of wonders and could help you kick start from where you left.

A Pause could be a Coffee or simply gazing out of the window.

Apart from being Creative, timing, speed of implementation of ideas and their execution are of high importance. You might get an excellent idea but what if it is too late to implement it.

Listed above are just a few ideas which will help you generate more ideas in turn.

Wednesday, April 6, 2011

My Favorite collection

1. Baby I like it by Enrique Iglesias:- Good funky lyrics and great singing from enrique makes this one to remember for a long time.. I LIKE TOO!!
2. Just Dance by Lady Gaga:- You’ve so much reason to go GAGA over this performance.. Lady gaga rocks the dance floor with this song.. GR8!!
3. My love by West life (Coast to Coast):- A great Anthem of LOVE!!.. Great lyrics.. beautifully sung.. One song that will stay in my heart FOREVER!!
4. Boulevard of broken dreams by Greenday:- This is a Grammy winner for the Record of the Year!! Fantastic song from Greenday one of my favorite band..! Gr8 lyrics.. And classy singing especially in the HUMMING !!
5. Wake me up when September ends by Greenday:- Another great song from Greenday!! This one brings me back to my old days…
6. Somebody is me by Enrique Iglesias:- This guy has got a great Voice.. It touches my heart when he is singing and when it has gr8 lyrics like this one has… Just perfect!!
7. When you were young by The Killers:- My Most favorite Band is THE KILLERS.. No doubt.. This is from their album Sam’s town which got a mixed reaction all over… But it has got gr8 songs like this one and Read my mid etc…!
8. With or without you by U2:- I’m sure ’U Too’ will like it!!
9. Heal the world by Michael Jackson:- A tribute to the Legend Michael… Who passed away last year but he still lives in our hearts…!!!
10. In the end by Linkin park:-
“ I tried so hard and got so far but in the end it doesn’t even matter” I think it’s the best lyrics in their song… ‘I tried so hard’ to skip this one from my list But In the End it matters a lot to me.. Ha! Ha!
11. When you say nothing at all by Ronan keating:- “ Its amazing how you can speak right to my heart without saying a word… You say it best when you say nothing at all”.. When I have a girlfriend I will surely sing this one for her… Such an honest song from Ronan..!!
12. Truly Madly deeply by Savage garden:- I am “TRULY MADLY DEEEEPLY” in love with this song… Fantastic lyrics… Magnificent singing!!!
13. Someday by Nickelback:- This one is all about Mid-blowing singing… Nickel has got a gr8 Voice.. It will stay in my heart not SOMEDAY but Always..!!
14. Love story by Taylor swift:- She has got a beautiful voice… And its released on Feb 14th !! And what a special occasion for a Special song..!!
15. No matter what by Boyzone:- No matter what happens this will always remain in my top 20 for sure…!!
16. You belong with me by Taylor swift:- This one got the Grammy for The best country album.. And very deservingly so…!!
17. Viva la vida by Cold play:- Gr8 Lyrics… I really love the humming in the last portion…!!
18. Bad romance by Lady gaga:- She got the Grammy for this one…!! She really is such a great performer.. I wish I was in the Grammy’s to see her performance..!!

"Drinking Habits Among youngsters" A SURVEY....

Last weekend I worked for a Market Research Company in which I had to conduct a small survey and had to collect Interviews of 175 youngsters ranging between 21-35 years of age….. Of course a person aged 35 is not a youngster but that was the upper limit.
When I first read the requirement notice by the company, it was clearly mentioned that they require 3 people for the survey… I thought it’s very easy and we two friends in a team will do the entire thing in one day…. We had a deadline…. Till Sunday 3pm we had to submit the data….
We approached the person concerned and got to know that we had to go through a short briefing before the survey…. We went for briefing and came to know that we had to visit different corners of Delhi in order to collect the data and that’s so through personal interviews…. Different corners meant different universities in Delhi which are poles apart… I sometimes wonder how I met someone so CRAZY like me… And we enthusiastically accepted the work…. Hell yeeah.... ENTHUSIASTICALLY…. Ha ha
It started, Saturday morning…. We hired a cab (of course we were paid well for that) and started with our work… We thought of starting with South Delhi… Since its admission season it was difficult to find people above 21 years of age 70% were ranging between 17-20… But then work is work….
Started with Venky college…. Came across many people… here i am elaborating a few…. One guy was there for his younger brother’s admission I interviewed him (main highlights):

Me: what comes to your mind when you hear the word “liquor”?
He: (with a smile on his face and sparkle in his eyes) Liquor… Whiskey…. Where is the bottle… it excites me
(his expression was loud enough to say it all)
Me: your perception/opinion about Liquor?
He: Well, in my opinion it’s one of the best creation of Man and everyone must drink it…..
(and before I could say anything) it should be neat, on the rocks (lots of ice), a girl to serve it…
Me: (Before he could continue I prompted) you are done FULL STOP. Thank you. (After a pause) You are here for your brother’s admission, right? Does he know your views and all about liquor…?
He: NOOOOO……. He doesn't know anything !!
Me: :P

I met girls too asked them the same set of Questions…. I am glad to say at least girls are more sensible and intelligent when it comes to “Liquor”... they too drink (some of them) but wisely…. Unlike guys who are desperate every now and then to grab a bottle :P
I collected data from venky and headed towards another college….. I am skipping ARSD…. Lets talk about MLNC, there I entered in one classroom where admission was going on…. And most of the people were busy filling forms… I approached a guy from North east (first target in that college and the first and last one who rejected to give interview :P)

Me: (Smiling face :P) Hello… You are here for the admission, Right?
He: (Looked at me as if am an Alien, speaking Chinese :P)
Me: Can I take your two minutes if you don’t mind?
He: NO!



I studied with a North Eastern guy in my graduation, I understand... he had no knowledge of hindi, so I consider all north easties as Zero in Hindi…(though few can speak very well in Hindi)…. But Hello… I was talking English dude…. Gemme a break….!!
I walked straight out of the class…. Was sitting alone on the stairs of the college and was just observing people moving here and there with no interest in asking any further Q to anyone… A guy approached

He: Hi, are you here for admission?
Me: No.
He: For Mark sheet?
Me: No
He: Actually, i saw that you are sitting here alone since quite sometime. May I help you, I am a final year student Political science, I am here to help students coming for admission.
Me: I explained the whole thing...….
He: Iam Faiz, you can take my interview
(I conducted his interview and we started chit chatting)
He: I cleared TOEFL and am going to Germany after my Exams
Me: that’s good
(We continued to talk for some more time)
He: how many more interviews you need?
Me: 20 more from here
He: Only? Just gemme sometime and be here
Me: okay!!

After sometime I was surrounded by guys too happy to give their interview :D
It wasn’t difficult at all…. All credit goes to Faiz….
I thanked him and moved to North campus, A place where I spent 3 most precious years of my life….. A place which makes me nostalgic everytime i go there............
I first headed towards my college, Hansraj, conducted few interviews, roamed in college and went to my science faculty…. Got few people for interview and in the end I moved to the Arts faculty, and there I met an interesting personality… His name was Varun
My team mate approached their group (2 guys and 1 girl)
He started with the interview of one guy, I with the other

Me: (After filling the details) first thing comes to your mind when you hear the word “Liquor”?
(Sorry but I don’t remember precisely what he replied)
After few usual survey questions… He started with his Questions,
He: what are you doing? Is this your job?
Me: Nopes, m a student it’s some research work m doing for experience
He: studying what?
Me: MBA
He: I am also a MBA graduate from Amity. Which semester and college?
Me: IIIrd (gemme a break, i am the one who is supposed to asked Qs not u :P)
He: what’s your name?
Me: Deepika
He: full name
Me: Deepika Gupta
He: Delhiite?
Me: yess, k tel me which of the following drinks do you consume? (i had a list of drinks)
He: I have tried all…. Do you drink? (Again his Qs started)
Me: NO
He: Seriously? Actually I also don’t drink….. actually in past 6 months since I joined office….. blah blah
Me: :P….. it’s okay!! Don’t worry, your name is not going to be there in the magazine it’s a general survey
He: I don’t care even if it’s gonna be there
Me: Thank you.

He was the last interview of that day…. Pheww!!! Hell it was Tiring….
After that we submitted the data collected….
Well, I dunno when the data analysis will be out… What I can say is… guys are more into drinking…. Than girls…. They love Whiskey(most), beer and Vodka…. Whereas most preferred drink among girls is Vodka…
My last weekend was good… I have already started looking for work for this weekend and further weekends… I can’t sit idle for two complete days… As far as hanging out, chilling is concerned… I do it daily…. Remember, m still in college and I still have an option of bunking ;))
Life Rocks!!!!!! \m/ :D :D

My dream girl.......


Once, when in my deepest thought
With my eyes closed tight for a while
I dreamed of a girl, who loved me madly
And she came into my world, with a smile.
She brightened my life with
her passionate love
And pierced my soul with her spear
When she touched me, I felt it so soothing
As she whispered 'I love you my dear'.
Her fingers gently combed my hair
And she taught me the meaning of love
As she shared her beautiful treasures with me
My heart began fluttering like a dove,
It was then that I knew for certain,
I really was truly in love.
When I woke up It was just but a dream
And my heart was filled with much sorrow
Of course its not the end,
because there's always another tomorrow.

fff

akrviyapaar.com
http://www.facebook.com/Luludotcom/posts/201821646512625