Check list of Testing

 Usability Testing:-

 Usability Test Scenarios:

• Web page content should be correct without any spelling or grammatical errors
• All fonts should be same as per the requirements.
• All the text should be properly aligned.
• All the error messages should be correct without any spelling or grammatical errors and the error message should match with the field label.
• Tool tip text should be there for every field.
• All the fields should be properly aligned.
• Enough space should be provided between field labels, columns, rows, and error messages.
• All the buttons should be in a standard format and size.
• Home link should be there on every single page.
• Disabled fields should be grayed out.
• Check for broken links and images.
• Confirmation message should be displayed for any kind of update and delete operation.
• Check the site on different resolutions (640 x 480, 600x800 etc.?)
• Check the end user can run the system without frustration.
• Check the tab should work properly.
• Scroll bar should appear only if required.
• If there is an error message on submit, the information filled by the user should be there.
• Title should display on each web page
• All fields (Textbox, dropdown, radio button etc) and buttons should be accessible by keyboard shortcuts and the user should be able to perform all operations by using keyboard.
• Check if the dropdown data is not truncated due to the field size and also check whether the data ishardcoded or managed via administrator.

Functional Testing:-

Functional Test Scenarios:

• Test all the mandatory fields should be validated.
• Test the asterisk sign should display for all the mandatory fields.
• Test the system should not display the error message for optional fields.
• Test that leap years are validated correctly & do not cause errors/miscalculations.
• Test the numeric fields should not accept the alphabets and proper error message should display.
• Test for negative numbers if allowed for numeric fields.
• Test division by zero should be handled properly for calculations.
• Test the max length of every field to ensure the data is not truncated.
• Test the pop up message ("This field is limited to 500 characters") should display if the data reaches  the maximum size of the field.
• Test that a confirmation message should display for update and delete operations.
• Test the amount values should display in currency format.
• Test all input fields for special characters.
• Test the timeout functionality.
• Test the Sorting functionality.
• Test the functionality of the buttons available
• Test the Privacy Policy & FAQ is clearly defined and should be available for users.
• Test if any functionality fails the user gets redirected to the custom error page.
• Test all the uploaded documents are opened properly.
• Test the user should be able to download the uploaded files.
• Test the email functionality of the system.
• Test the java script is properly working in different browsers (IE, Firefox, Chrome, safari and Opera).
• Test to see what happens if a user deletes cookies while in the site.
• Test to see what happens if a user deletes cookies after visiting a site.
• Test all the data inside combo/list box is arranged in chronological order.

Compability Testing:- 

Compability Test Scenarios:

• Test the website in different browsers (IE, Firefox, Chrome, Safari and Opera) and ensure the website is displaying properly.
• Test the HTML version being used is compatible with appropriate browser versions.
• Test the images display correctly in different browsers.
• Test the fonts are usable in different browsers.
• Test the java script code is usable in different browsers.
• Test the Animated GIF's across different browsers.

 
Tool for Compatibility Testing:
Spoon.net: Spoon.net provides access to thousands of applications (Browsers) without any installs. This tool helps you to test your application on different browsers on one single machine.


Database Testing:-

Test Scenarios for Database Testing:

• Verify the database name:  The database name should match with the specifications.
• Verify the Tables, columns, column types and defaults: All things should match with the specifications.
• Verify whether the column allows a null or not.
• Verify the Primary and foreign key of each table.
• Verify the Stored Procedure:
• Test whether the Stored procedure is installed or not.
• Verify the Stored procedure name
• Verify the parameter names, types and number of parameters.
• Test the parameters if they are required or not.
• Test the stored procedure by deleting some parameters
• Test when the output is zero, the zero records should be affected.
• Test the stored procedure by writing simple SQL queries.
• Test whether the stored procedure returns the values
• Test the stored procedure with sample input data.
• Verify the behavior of each flag in the table.
• Verify the data gets properly saved into the database after the each page submission.
• Verify the data if the DML (Update, delete and insert) operations are performed.
• Check the length of every field: The field length in the back end and front end must be same.
• Verify the database names of QA, UAT and production. The names should be unique.
• Verify the encrypted data in the database.
• Verify the database size. Also test the response time of each query executed.
• Verify the data displayed on the front end and make sure it is same in the back end.
• Verify the data validity by inserting the invalid data in the database.
• Verify the Triggers.

Security Testing:-

Test Scenarios for Security Testing:

1. Verify the web page which contains important data like password, credit card numbers, secret answers for security question etc should be submitted via HTTPS (SSL).
2. Verify the important information like password, credit card numbers etc should display in encrypted format.
3. Verify password rules are implemented on all authentication pages like Registration, forgot password, change password.
4. Verify if the password is changed the user should not be able to login with the old password.
5. Verify the error messages should not display any important information.
6. Verify if the user is logged out from the system or user session was expired, the user should not be able to navigate the site.
7. Verify to access the secured and non secured web pages directly without login.
8. Verify the “View Source code” option is disabled and should not be visible to the user.
9. Verify the user account gets locked out if the user is entering the wrong password several times.
10. Verify the cookies should not store passwords.
11. Verify if, any functionality is not working, the system should not display any application, server, or database information. Instead, it should display the custom error page.
12. Verify the SQL injection attacks.
13. Verify the user roles and their rights. For Example The requestor should not be able to access the admin page.
14. Verify the important operations are written in log files, and that information should be traceable.
15. Verify the session values are in an encrypted format in the address bar.
16. Verify the cookie information is stored in encrypted format.
17. Verify the application for Brute Force Attacks

Performance Testing:-

General Test scenarios:

• To determine the performance, stability and scalability of an application under different load conditions.
• To determine if the current architecture can support the application at peak user levels.
• To determine which configuration sizing provides the best performance level.
• To identify application and infrastructure bottlenecks.
• To determine if the new version of the software adversely had an impact on response time.
• To evaluate product and/or hardware to determine if it can handle projected load volumes.

How to do Performance testing? By Manual Testing or by Automation

Practically it is not possible to do the performance testing manually because of some drawbacks like:

• More number of resources will be required.
• Simultaneous actions are not possible.
• Proper system monitoring is not available.
• Not easy to perform the repetitive task.

 

Hence to overcome the above problems we should use Performance testing tool. Below is the list of some popular testing tools.

• Apache JMeter
• Load Runner
• Borland Silk Performer.
• Rational Performance Tester
• WAPT
• NEO LOAD

Interview Questions for QA Testing - part 3

What are the dimensions of the Risks? The dimensions of the risk are described below: Schedule: Unrealistic schedules. to develop a huge software in a single day.. Client: Ambiguous requirements definition, requirement and not clear, changes in the requirement etc. Human Resources: Non-availability of sufficient resources with the skill level expected in the project. System Resources: Non-availability of procuring all critical computer resources either hardware and software tools or licenses for software will have an adverse impact. Quality: Compound factors like lack of resources along with a tight delivery schedule and frequent changes to requirements will have an impact on the quality of the product tested.

How to Estimate Testing effort ? Time Estimation method for Testing Process: Step 1 : count number of use cases (NUC) of system Step 2 : Set Avg. Time Test Cases(ATTC) as per test plan Step 3 : Estimate total number of test cases (NTC) Total number of test cases = Number of Use Cases X Avg. Test Cases per a use case Step 4 : Set Avg. Execution Time (AET) per a test case Step 5 : Calculate Total Execution Time (TET) TET = Total number of test cases * AET Step 6 : Calculate Test Case Creation Time (TCCT) Usually we will take 1.5 times of TET as TCCT TCCT = 1.5 * TET Step 7 : Time for Re-Test Case Execution (RTCE) this is for retesting Usually we take 0.5 times of TET RTCE = 0.5 * TET Step 8 : Set Report generation Time (RGT Usually we take 0.2 times of TET RGT = 0.2 * TET Step 9 : Set Test Environment Setup Time (TEST) It also depends on test plan Step 10 : Total Estimation time = TET + TCCT+ RTCE + RGT + TEST + some buffer.

How to create requirements test matrix template? For a requirements test matrix template we perform following step: Step 1: Find out number of requirements. Step 2: Find out number of test cases. Step 3: Create a table based on these. Let we have 10 requirements and 40 test cases, then we create a table of 11 rows and 41 columns. Step 4: On the first column of table copy all your 10 requirement numbers, and paste them into rows 2 through 11 of the table. Step 5: Now copy all 40 test case numbers, and paste them into columns 2 through 41 of the table. Step 6: Examine each of your 40 test cases, determine which of the 10 requirements they satisfy.

Can you perform regression testing performed manually? Yes, we can perform regression testing manually, but it requires lots of effort. To choose the way of doing the regression testing is totally depends on the initial testing approach. If the initial testing approach was manual testing, then the regression testing is usually performed manually. In case, if the initial testing approach was automated testing, then the regression testing is usually performed by automated testing. Automated regression testing is very easy task.

You are a tester. Now How will you choose which defect to remove in 1000000 defects? First thing testers are not responsible for fixing the bug they are only responsible for debugging the bug and prioritizing those bugs. These bugs are now reported in bug report template with the severity and priority of the bug. Tester assigns severity level to the defects depending upon their impact on other parts of application. Every bug has its severity and priority values assign by tester. If a defect does not allow you to go ahead and test the product, it is critical one so it has to be fixed as soon as possible. We have 5 levels as: - Critical - High - Medium - Low - Cosmetic

How do you perform integration testing? Integration testing is black box testing. Integration testing focuses on the interfaces between units, to make sure the units work together. For integration testing we ensure that all units testing of the each component is performed earlier. Integration testing begins only after the unit testing. The purpose of integration testing is to ensure different components of the application interact with each other. So that, components work as per the customer requirements. Test cases are developed with the purpose of exercising the interfaces between the components. Integration testing is considered complete, when actual results and expected results are same.

What is the testing lifecycle? There is no standard testing life cycle, but it is consist of following phases: - Test Planning (Test Strategy, Test Plan, Test Bed Creation) - Test Development (Test Procedures, Test Scenarios, Test Cases) - Test Execution - Result Analysis (compare Expected to Actual results) - Defect Tracking - Reporting

What is good code? A good code is code that works. The good code must not contain the defect or bug and is readable by other developers and easily maintainable. Organizations have coding standards all developers should follow, and also every programmer and software engineer has different ideas about what is best and what are too many or too few rules. We need to keep in mind that excessive use of rules can decrease both productivity and creativity. Peer reviews and code analysis tools can be used to check for problems and enforce standards. What are the main attributes of test automation? The main attributes are discussed below: - Maintainability: For each new release need to update the test automation suites. - Reliability: Accuracy and repeatability of the test automation. - Flexibility: Ease of working with all the different kinds of automation test ware. - Efficiency: Total cost related to the effort needed for the automation. - Portability: Ability of the automated test to run on different environments. - Robustness: Effectiveness of automation on an unstable or rapidly changing system. - Usability: Extent to which automation can be used by different types of user. What could go wrong with test automation? Followings things may be go wrong in test automation: - Ignoring automation, while planning the development phases. - In design Phase not choosing the right technology. - In coding Phase not automating the right test cases. - Tool selection might go wrong. - Test script not be updated when application is continuously changing. - Test data should be unique, if the same data is available on the application then the application will not accept the data that we are going to add via automation. What tools are available to support testing during development of application? Following tools can be used to support testing during development of application: - Test management tools example: Quality Center, JIRA. - Defect management tool example: Bugzilla, Test Director. - Project management: Sharepoint. - Automation tools: QTP, RFT, WinRunner. What are the tests activities that you want to automate in a project? The following testing activities can be automated: - Functional tests: Identify some P1 and P2 cases which are most critical for project success and operations and automate them. After every new build, these scripts will assure the fixes does not broke any of the critical functionality. - Regression test suites: Test the need to be run after each build. - Performance tests: Identical test the need to be run on different browser. - Stress tests - Load tests What is the difference in responsibilities of Programmers and QA analyst? The differences in responsibilities are listed below: - QA is concern for Process Quality and Programmers are concern for Product Quality. - QA ensure that the processes used for developing the product of high quality where as programmers used these processes so that end product is of good quality. - Processes are decided by QA. Programmers are supposed to follow the processes so that they can produce a good quality product. - Any issue found during execution of process by the programmers is communicated to the QA so that they can improve the process. What is the role of Bug Tracking System? The Bug Tracking System role is discussed below: - Testers and developers can know the status of the bug at every stage. - Changes to the Status will be available to all team members. - Developers and Testers can easily interact with bugs. - Repetition of bugs will be avoided. - Easy to distribute the bug among the developer. - It will act as a centralized one for defects. How do you prioritize testing tasks within a project? Test Process are execute in step by step. We cannot skip any of the process defined. Following is the Test Process which are in terms of their priority: 1. Preparation of Test Plan. 2. Preparation of Test Cases. 3. Execution of the Test Cases. 4. Defect report and tracking. 5. Test Report Summary. Describe Bottom-Up and Top-Down approach in Testing. Bottom Up Approach: - The bottom up approach testing approach is carried out with the help of the test driver. The test driver calls a component to be tested. - The modules in the lower level of call hierarchy are tested independently. Then the next level modules are tested that call previously tested modules. This is done repeatedly until all the modules are included in the testing. - Bottom up testing stops when the top module in the call hierarchy is tested with all lower call hierarchy modules. Top Down Approach: - The top down approach is carried out with the help of the test stub. Test stub are the dummy programs. The Stub is called from the software component to be tested. - Tests top layer of controlling subsystem first. Then combine modules that are called by the tested modules and test resulted collection of modules. - Do this until all the modules are combined and tested. What methodologies do you used to develop test cases? For developing the test cases we use following strategies: - Error Guessing: The tester has to guess what fault might occur and to design the tests to represent them. - Equivalence Class Partitioning: The input domain data is divided into different equivalence data classes; take few valid values with 2 invalid values. This is used to reduce the total number of test cases to a finite set of testable test cases. - Boundary value analysis: Boundary value analysis testing technique is used to identify errors at boundaries rather than finding those exist in center of input domain. Boundary value analysis is a next part of Equivalence. What are the differences between test strategy and test plan? The differences between these two are described below: - Test plan is dynamic where as test strategy is static. - Test plan is prepared by the Test Lead where as Test Strategy is prepared by the company management. - Test strategy defines: methods and coverage criteria to be covered test completion criteria, prioritization of the test where as Test plan is a document describing the scope, approach, resources and schedule of intended test activities. - Test Strategy is a high level description of the test levels to be performed where as Test plan is written record of the test strategy and resource planning. What is the need of Test Plan document? Test Plan tells the tester that what needs to be tested and how testing is going to be performed. Test plan also tells that what resources are needed for the execution of the test cases, timelines and risk associated with the test plan. We can also perform the testing without test plan document, but first we have to select test Approach for the testing and go with testing. Many test plans are being created just for the sake of processes. Many tester use test plan documents when test plan document contains the some useful information. Why we do load and performance testing? Load Testing: The reason to perform the load testing is to determine response times of application processes and transactions to establish whether they are within acceptable time limit or not, as per user requirement. It also measures the capability of an application to function correctly under load by measuring the systems key performance indicators. Performance Testing: Performance Testing is performed to determine response time of the some components of the system perform under a particular workload. It is generally measured in terms of response time for the user activity. It is designed to test the overall performance of the system at high load and stress condition What is difference between test effectiveness and test efficiency? - Test Efficiency is the ratio of number of test cases executed by unit of time (generally per hour). - It is the amount of code and testing resources required by a program to perform a particular function. Test Effectiveness evaluates the effect of the test environment on the application. - Test Effectiveness is a measure by the customer response on meeting product requirements where as Test Efficiency is a measure of optimum utilization of resources to create the Software product. What is data driven testing? Data Driven is an automation testing part in which test input or output values, these values are read from data files. It is performed when the values are changing by the time. The different data files may include data pools, csv files, Excel files. The data is then loaded into variables in recorded or manually coded scripts. For data driven testing we use Parameterzing and Regular expression Technique. Ex. Let's say, we want to sign up to create an account in Gmail for 100 users. For this we pet all the user detail in a single excel sheet or use a single script. Can Manual Testing be completely replaced by Automation Testing? Automated testing cannot replace manual testing because of following reason: - Automated testing cannot replace the analytical skills required to conduct testing. It can only enhance or supplement manual testing, - Through manual testing, information can be gathered about the application, and real-time decisions can be made about how to enhance a test that would be too difficult to program into an automated script. - We need a manual tester to analyze and maintain the automated scripts after they can run. Why regression testing is important? Regression Testing: When changes in the code of the software are made to fix the previous bug. Then testing needs to be perform to ensure that it will not generate a new bug in the application and it works as specified and that it has not negatively impacted any functionality that it offered previously. Regression Testing is important because of following reason: - That the application works even after the alteration in the code were made. - The original functionality continues to work as specified even after doing changes in the software application. - The alteration to the software application has not introduced any new bugs. What is Exploratory Testing and Specification-Driven testing? Exploratory testing: means testing an application without a test plan and test script. In exploring testing test explore the application on the basis on his knowledge. The tester has no knowledge about the application previously. He explores the application like an end user and try to use it. While using the application his main motive is to find the bugs which are in the application. Specification-driven testing: means to test the functionality of software according to the user requirements. In this, tester inputs multiple data and monitors the outputs from, the test object. In this testing tester evaluate the showstopper bugs which break the major functionality of the application. This type of testing requires test plan and test. Explain CMM. Capability Maturity Model (CMM) is divided in five levels: 1. Initial: The organization is characterized by an adhoc set of activities. The processes aren't defined and success depends on individual effort and heroics. 2. Repeatable: In this level some processes are repeatable, possibly with consistent results. 3. Defined: In this level, we define all processes are documented for both management and engineering activities, and standards. 4. Managed: Detailed measures of each process are defined and product quality data is routinely collected. Both process and products are quantitatively understood and controlled. 5. Optimizing: In this we optimize the application by following improvement process. How do you decide you have tested enough? The principle of testing says that exhaustive testing is impossible. i.e. testing everything is not feasible. We cannot test till all the defects are debugged and removed, it is simply impossible. We have to stop testing and ship the software. We can decide when to stop is testing based on following points: - When there is no time and budget. - When maximum number of test cases are executed. - All the Requirements are mapped that is RTM is filled completely. - When Test coverage is more than 80%. - When bug rate falls below certain level. What the purpose of testing? Software Testing: is the process of assuring that product which is developed by the manufactured by developer is meeting the user requirement. The motive to perform testing is to find the bugs and make sure that they get fixed. The purposes of testing are following: - Quality assurance, Verification and Validation, - To find the bugs before the product is released to customer. - To improve the quality of the product - The Purpose of Testing is to evaluate that the product is according to requirements

Interview Questions for QA Testing - part 2

What is difference between QA, QC and Software Testing? Quality Assurance (QA): QA refers to the planned and systematic way of monitoring the quality of process which is followed to produce a quality product. QA tracks the outcomes and adjusts the process to meet the expectation. Quality Control (QC): Concern with the quality of the product. QC finds the defects and suggests improvements. The process set by QA is implemented by QC. The QC is the responsibility of the tester. Software Testing: is the process of ensuring that product which is developed by the developer meets the user requirement. The motive to perform testing is to find the bugs and make sure that they get fixed.

When to start QA in a project? A good time to start the QA is from the beginning of the project startup. This will lead to plan the process which will make sure that product coming out meets the customer quality expectation. QA also plays a major role in the communication between teams. It gives time to step up the testing environment. The testing phase starts after the test plans are written, reviewed and approved.

What are verification and validation and difference between these two? Verification: process of evaluating steps which is followed up to development phase to determine whether they meet the specified requirements for that stage. Validation: process of evaluating product during or at the end of the development process to determine whether product meets specified requirements. Difference between Verification and Validation: - Verification is Static Testing where as Validations is Dynamic Testing. - Verification takes place before validation. - Verification evaluates plans, documents, requirements and specifications, where as Validation evaluates product. - Verification inputs are checklist, issues list, walkthroughs and inspection, where as in Validation testing of actual product. - Verification output is set of documents, plans, specifications and requirement documents where as in Validation actual product is output.

What is difference between Smoke testing and Sanity Testing? The difference between smoke and sanity testing is described below: - Sanity testing is performed when new build is released after fixing bugs where as smoke testing is performed to check the major functionalities of the application. - Sanity is performed by the tester or the developer but smoke testing can be performed by the tester or developer. - Smoke testing is performed earlier where as sanity is performed after the smoke testing. - Sanity testing is narrow and deep approach of testing and smoke testing is focused testing based on major functionalities.

What is destructive testing, and what are its benefits? Destructive testing includes methods where material is broken down to evaluate the mechanical properties, such as strength, toughness and hardness. For example, finding the quality of a weld is good enough to withstand extreme pressure and also to verify the properties of a material. Benefits of Destructive Testing (DT) - Verifies properties of a material - Determines quality of welds - Helps you to reduce failures, accidents and costs - Ensures compliance with regulations

What is Testware? The testware is: - The subset of software which helps in performing the testing of application. - Testware are required to plan, design, and execute tests. It contains documents, scripts, inputs, expected results, set-up and additional software or utilities used in testing. - Testware is term given to combination of all utilities and application software that required for testing a software package. Testware is special because it has: 1. Different purpose 2. Different metrics for quality and 3. Different users

What is difference between Retesting and Regression testing? The difference between Retesting and Regression testing are as follows: - Retesting is done to verify defects fixes where as regression is perform to check if the defect fix have not impacted other functionality that was working fine before doing changes in the code. - Retesting is planned testing based on the defect fixes listed where as regression is not be always specific to any defect fix. Also regression can be executed for some modules or all modules. - Retesting concern with executing those test cases that are failed earlier whereas regression concern with executing test cases that was passed in earlier builds. - Retesting has higher priority over regression, but in some case retesting and regression testing are carried out in parallel. Explain bug life cycle. Bug Life Cycle: - When a tester finds a bug .The bug is assigned with NEW or OPEN status. - The bug is assigned to development project manager who will analyze the bug .He will check whether it is a valid defect. If it is not valid bug is rejected, now status is REJECTED. - If not, next the defect is checked whether it is in scope. When bug is not part of the current release .Such defects are POSTPONED - Now, Tester checks whether similar defect was raised earlier. If yes defect is assigned a status DUPLICATE - When bug is assigned to developer. During this stage bug is assigned a status IN-PROGRESS - Once code is fixed. Defect is assigned with FIXED status. - Next the tester will re-test the code. In case the test case passes the defect is CLOSED - If the test case fails again the bug is RE-OPENED and assigned to the developer. That’s all to Bug Life Cycle. What is severity and priority of bug? Give some example. Priority: concern with application from the business point of view. It answers: How quickly we need to fix the bug? Or How soon the bug should get fixed? Severity: concern with functionality of application. It deals with the impact of the bug on the application. How much the bug is affecting the functionality of the application? Ex. High Priority and Low Severity: Company logo is not properly displayed on their website. High Priority and High Severity: Suppose you are doing online shopping and filled payment information, but after submitting the form, you get a message like "Order has been cancelled." Low Priority and High Severity: If we have a typical scenario in which the application get crashed, but that scenario exists rarely. Low Priority and Low Severity: There is a mistake like "You have registered success" instead of successfully, success is written. What are the common problems with software automation? Software problem are listed below: 1. Purchasing the license of tool (QTP, selenium, QC, LR) 2. Lack of skilled Tester to run the tool 3. Expectation that automated tests will find a lot of new defects 4. Maintenance of automated tests 5. Technical problems of tools What is the role of QA in a project development? QA stands for QUALITY ASSURANCE. QA team assures the quality by monitor the whole development process. QA tracks the outcomes and adjusting process to meet the expectation. The role of Quality Assurance is discussed below: - QA team is responsible for monitoring the process to be carried out for development. - Responsibilities of QA team are planning testing execution process. - QA Lead creates the time tables and agrees on a Quality Assurance plan for the product. - QA team communicated QA process to the team members. - QA team ensures traceability of test cases to requirements. What is the difference between build and release? BUILD: is a number given to installable software that is given to testing team for testing by the development team. Build number assigned are incremental and sequential. RELEASE: is a number given to installable software that is handed over to customer by the developer or tester. The information of build, release and version are displayed in software help page. Using this build and release customer can let the customer team know which release version build thet are using. Eg "9.4.123.2" (Release Number.Version Number.Build Number.Patch Number) What are the key challenges of software testing? Following are some challenges of software testing 1. Application should be stable enough to be tested. 2. Testing always under time constraint 3. Understanding requirements, Domain knowledge and business user perspective understanding 4. Which tests to execute first? 5. Testing the Complete Application 6. Regression testing 7. Lack of skilled testers. 8. Changing requirements 9. Lack of resources, tools and training Why you choose automated testing over manual testing? The reasons for choosing automation testing over manual testing are following: 1. Frequency of use of test case 2. Time Comparison (automated script run much faster than manual execution.) 3. Re-usability of Automation Script 4. Adaptability of test case for automation. 5. Exploitation of automation tool. What is the basis for choosing the SDLC model for development of software? The choice of SDLC depends on the various factors and how stable are the requirements: - When the requirements are very clearly known, documented and not subject to change then we can follow the waterfall model. - Most of the companies follow the V mode for the development because this model includes both verification and validation activities and testing is involved in earlier phase. - Iterative model can be used to build application where requirement changes after a period of times or application features or added on with smaller release. When the client is ready for the delivery of the product in parts or phases. Explain bug leakage and bug release. Bug Leakage: When customer or end user discovered a bug which can be detected by the testing team. Or when a bug is detected which can be detected in pervious build then this is called as Bug Leakage. Bug release: is when a build is handed to testing team with knowing that defect is present in the release. The priority and severity of bug is low. It is done when customer want the application on the time. Customer can tolerate the bug in the released then the delay in getting the application and the cost involved in removing that bug. These bugs are mentioned in the Release Notes handed to client for the future improvement chances. What is regression testing? Regression Testing: When changes in the code of the software are made to fix the previous bug. Then testing needs to be perform to ensure that it will not generate a new bug in the application and it works as specified and that it has not negatively impacted any functionality that it offered previously. Regression Testing is important because of following reason: - That the application works even after the alteration in the code were made. - The original functionality continues to work as specified even after doing changes in the software application. - The alteration to the software application has not introduced any new bugs. What is data driven testing? Data Driven is an automation testing part in which test input or output values, these values are read from data files. It is performed when the values are changing by the time. The different data files may include data pools, csv files, Excel files. The data is then loaded into variables in recorded or manually coded scripts. For data driven testing we use Parameterzing and Regular expression Technique. Ex: To evaluate login functionality, we use different user name and password combinations, variables are used to access different username and password. The list of username and password are stored in a data table or excel sheet. What is alpha and beta testing? Alpha testing: is performed by the IN-House developers. After alpha testing the software is handed over to software QA team, for additional testing in an environment that is similar to the client environment. Beta testing: It is performed by end user. So that they can make sure that the product is bug free or working as per the requirement. IN-house developers and software QA team perform alpha testing. The public, a few select prospective customers or the general public performs beta testing. What are test driver and test stub and why we need them? - The Stub is called from the software component to be tested. It is used in top down approach. - The driver calls a component to be tested. It is used in bottom up approach. - Both test stub and test driver are dummy software components. We need test stub and test driver because of following reason: - Suppose we want to test the interface between modules A and B and we have developed only module A. So we cannot test module A but if a dummy module is prepare, using that we can test module A. - Now module B cannot send or receive data from module A directly so, in these cases we have to transfer data from one module to another module by some external features. This external feature used is called Driver. What is Monkey testing? Monkey testing is a type of Black Box Testing used mostly at the Unit Level. In this tester enter the data in any format and check the software is not crashing. In this testing we use Smart monkey and Dumb monkey. - Smart monkeys are used for load and stress testing, they will help in finding the bugs. They are very expensive to develop. - Dumb monkey, are important for basic testing. They help in finding those bugs which are having high severity. Dumb monkey are less expensive as compare to Smart monkeys. Example: In phone number filed Symbols are entered. What is Bug Triage? Bug triage is a process to: - Ensure bug report completeness. - Analyze and assign bug to proper component. - Assign bug to proper bug owner. - Set appropriate bug priority. - Adjust bug severity properly. What is Traceability Matrix? Traceability Matrix is a method used to validate the compliance of product with requirements for that product. The requirement is written in a row of the matrix and the columns of the matrix. Now they are used to identify how and where each requirement has been addressed. It is in the form of table that correlates two base lined documents that require a many-to-many relationship. It is used with high level requirement and detailed requirement of the software product to the matching parts of high level design, detailed design, test plan, and test cases. The relationship to the source documents is required for both backward traceability and forward traceability. Explain paradigms for interfacing module. The paradigms for interfacing modules: - Procedure Call Interface: A procedure from one module calls to procedure of another module. The caller can pass data to the called procedure while calling and also the called procedure can pass data to the caller while returning control back to the caller procedure. - Shared Memory: When a block of memory is shared between two modules. The memory block may be allocated by one of the two modules or third module of the same application. - Message Passing Interface: One module generates a message and sends the message to another module. It helps in building up the communication between different process or modules. What are the factors responsible for the estimation of system integration test cycle and total integration time? The number of system integration test cycle and total integration time are determined by the following parameters: - Number of modules in the system. - Relative complexity of the modules. - Relative complexity of the interface between the modules. - Number of modules needed to be clustered together in each test cycle. - Whether the modules to be integrated have been adequately tested before. - Turnaround time for each test-debug-fix cycle. What are the things the tests ensure? Test must ensure that: - The number of parameters sent in a message agrees with the number of parameters expected to receive. - The parameter order in the message match the order expected. - The field sizes and data type match. - When a message is generated from stored data prior to being sent, the message truly reflects the stored data. - When a received message is stored, data copying is consistent with the received message. What is random testing? When test inputs are selected randomly from the input domain of the system, this is Random Testing. Random testing involves following procedure: - The input domain is selected. - Test inputs are selected independently from the domain. -The system under test is executed on these inputs. The inputs constitute a random test set. - The results are compared to the system specification. The test is a failure if any input leads to incorrect results, otherwise it is a success. What are the benefits of Automated Testing? The benefits of Automation Testing are as below: - Test engineer productivity. - Coverage of regression testing. - Re-usability of test cases. - Consistency in testing. - Test interval reduction - Reduced software maintenance cost - Increased test effectiveness What is Agile Testing? Agile Testing means to quickly validation of the client requirements and make the application of good quality user interface. When the build is released to the testing team, testing of the application is started to find the bugs. As a Tester, we need to focus on the customer or end user requirements. We put the efforts to deliver the quality product in spite of short time frame which will further help in reducing the cost of development and test feedback will be implemented in the code which will avoid the defects coming from the end user. Describe Use Case Testing. Use Case: A use case is a description of the process which is performed by the end user for a particular task. Use case contains a sequence of step which is performed by the end user to complete a specific task or a step by step process that describe how the application and end user interact with each other. Use case is written by the user point of view. Use case Testing: the use case testing uses this use case to evaluate the application. So that, the tester can examines all the functionalities of the application. Use case testing cover whole application, tester performs this testing in step by step process to complete one task. What type of tests you perform on the web based application? For web application we perform following time of test: 1. Functionality Testing. 2. Usability Testing. 3. Navigation Testing. 4. Configuration and Compatibility testing. 5. Reliability and Availability Testing. 6. Performance Testing. 7. Load and Stress Testing. 8. Security Testing What is Gantt Chart? A Gantt Chart is used to represent a project schedule that includes duration of individual tasks or phases, their dependencies and ordering. - It displays the start and end points of each task and the percentage of completion of each task - It allows the planner to assess the duration of a project, identify the resources needed, and lay out the order in which tasks need to be performed. - It is useful in managing the dependencies between tasks. - Using Gantt chart each team member can view the product development schedule. How to find all the Bugs during first round of Testing? There could be several reasons for not debugging the entire bug in the first round of testing process. Debugging the showstopper in the first or second build is almost impossible. A found defect can cover up the other defects in the application. The thread which leads to on defect could be redirected to another defect, as the tester find the bug and lock that bug in report and after fixing of those bugs new bugs may also arises. It is difficult to keep testing on a known defective application. That is the reason we cannot find all the bug in first run and also we cannot perform Exhaustive testing. How would you prepare the Test Plan without SRS? We can prepare a test plan directly without having SRS, When the Requirements and URD(User Requirement Document )are available to us. URD is very helpful to determine the requirement of the user. The SRS document only contains the requirement of the user, but tester can also determine the requirement form the product. Without having SRS document we cannot estimate the Testing effort and cost of testing if we do not have SRS. SRS tell us on which platform our software is going to be used and on basis of this we perform the test on the application. Some time end user want to know what type of testing we are going to execute on the application for this we can send our test plan to the client. What is the purpose of test strategy? We need Test Strategy for the following reason: 1. To have a signed, sealed, and delivered document, where the document contains details about the testing methodology, test plan, and test cases. 2. Test strategy document tells us how the software product will be tested. 3. Test strategy document helps to review the test plan with the project team members. 4. It describes the roles, responsibilities and the resources required for the test and schedule. 5. When we create a test strategy document, we have to put into writing any testing issues requiring resolution. 6. The test strategy is decided first, before lower level decisions are made on the test plan, test design, and other testing issues.

Interview Questions for QA Testing - part 1

1) What is the difference between the QA and software testing?
The role of QA (Quality Assurance) is to monitor the quality of the process to produce a quality of a product. While the software testing, is the process of ensuring the final product and check the functionality of final product and to see whether the final product meets the user’s requirement.

2) What is Testware?
Testware is the subset of software, which helps in performing the testing of application.  It is a term given to the combination of software application and utilities which is required for testing a software package.

3) What is the difference between build and release?
Build: It is a number given to Installable software that is given to testing team by the development team.
Release: It is a number given to Installable software that is handed over to customer by the tester or developer.

4) What are the automation challenges that QA team faces while testing?

• Exploitation of automation tool
• Frequency of use of test case
• Reusability of Automation script
• Adaptability of test case for automation

5) What is bug leakage and bug release?
Bug release is when software or an application is handed over to the testing team knowing that the defect is present in a release.  During this the priority and severity of bug is low, as bug can be removed before the final handover.
Bug leakage is something, when the bug is discovered by the end users or customer, and missed by the testing team to detect, while testing the software.

QA Interview Questions

6) What is data driven testing?
Data driven testing is an automation testing part, which tests the output or input values. These values are read directly from the data files. The data files may include csv files, excel files, data pools and many more. It is performed when the values are changing by the time.

7) Explain the steps for Bug Cycle?

• Once the bug is identified by the tester, it is assigned to the development manager in open status
• If the bug is a valid defect the development team will fix it and if it is not a valid defect, the defect will be ignored and marked as rejected
• The next step will be to check whether it is in scope, if it is happen so that, the bug is not the part of the current release then the defects are postponed
• If the defect or bug is raised earlier then the tester will assigned a DUPLICATE status
• When bug is assigned to developer to fix, it will be given a IN-PROGRESS status
• Once the defect is repaired, the status will changed to FIXED at the end the tester will give CLOSED status if it passes the final test.

8) What does the test strategy include?
The test strategy includes introduction, resource, scope and schedule for test activities, test tools, test priorities, test planning and the types of test that has to be performed.

9) Mention the different types of software testing?

• Unit testing
• Integration testing and regression testing
• Shakeout testing
• Smoke testing
• Functional testing
• Performance testing
• White box and Black box testing
• Alpha and Beta testing
• Load testing and stress testing
• System testing

10) What is branch testing and what is boundary testing?
The testing of all the branches of the application, which is tested once, is known as branch testing.  While the testing, which is focused on the limit conditions of the software is known as boundary testing.

11) What are the contents in test plans and test cases?

• Testing objectives
• Testing scope
• Testing the frame
• The environment
• Reason for testing
• The criteria for entrance and exit
• Deliverables
• Risk factors

12) What is Agile testing and what is the importance of Agile testing?
 Agile testing is software testing, which involves the testing of the software from the customer point of view.  The importance of this testing is that, unlike normal testing process, this testing does not wait for development team to complete the coding first and then doing testing. The coding and testing both goes simultaneously.  It requires continuous customer interaction.
It works on SDLC ( Systems Development Life Cycle) methodologies, it means that the task is divided into different segments and compiled at the end of the task.

13) What is Test case?
Test case is a specific term that is used to test a specific element.  It has information of test steps, prerequisites, test environment and outputs.

14) What is the strategy for Automation Test Plan?

• The strategy for Automation Test Plan
• Preparation of Automation Test Plan
• Recording the scenario
• Error handler incorporation
• Script enhancement by inserting check points and looping constructs
• Debugging the script and fixing the issues
• Rerunning the script
• Reporting the result

15) What is quality audit?
The systematic and independent examination for determining the quality of activities is known as quality audit.  It allows the cross check for the planned arrangements, whether they are properly implemented or not.

16) How does a server or client environment affect software testing?
As the dependencies on the clients are more, the client or server applications are complex.
The testing needs are extensive as servers, communications and hardware are interdependent. Integration and system testing is also for a limited period of time.

17) What are the tools used by a tester while testing?

• Selenium
• Firebug
• OpenSTA
• WinSCP
• YSlow for FireBug
• Web Developer toolbar for firebox

18) Explain stress testing, load testing and volume testing?

• Load Testing: Testing an application under heavy but expected load is known as Load Testing.  Here, the load refers to the large volume of users, messages, requests, data, etc.
• Stress Testing: When the load placed on the system is raised or accelerated beyond the normal range then it is known as Stress Testing.
• Volume Testing:  The process of checking the system, whether the system can handle the required amounts of data, user requests, etc. is known as Volume Testing.

19) What are the five common solutions for software developments problems?

• Setting up the requirements criteria, the requirements of a software should be complete, clear and agreed by all
• The next thing is the realistic schedule like time for planning , designing, testing, fixing bugs and re-testing
• Adequate testing, start the testing immediately after one or more modules development.
• Use rapid prototype during design phase so that it can be easy for customers to find what to expect
• Use of group communication tools

20) What is a ‘USE’ case and what does it include?
The document that describes, the user action and system response, for a particular functionality is known as USE case.  It includes revision history, table of contents, flow of events, cover page, special requirements, pre-conditions and post-conditions.

21) What is CRUD testing and how to test CRUD?
CRUD testing is another name for Black Box testing.  CRUD stands for Create, Read, Update and Delete.
22) What is validation and verification in software testing?
In verification, all the key aspects of software developments are taken in concern like code, specifications, requirements and document plans.  Verification is done on the basis of four things list of issues, checklist, walkthroughs and inspection meetings. Following verification, validation is done, it involves actual testing, and all the verification aspects are checked thoroughly in validation.

23) What is thread testing?
A thread testing is a top-down testing, where the progressive integration of components follows the implementation of subsets of the requirements, as opposed to the integration of components by successively lower levels.

24) What is configuration management?
It is a process to control and document any changes made during the life of a project.  Release control, Change control and Revision control are the important aspects of configuration management.

25) What is Ad Hoc testing?
It is a testing phase where the tester tries to break the system by randomly trying the system’s functionality.  It can include negative testing as well.

26) List out the roles of software Quality Assurance engineer?
A software quality assurance engineer tasks include following things

• Writing source code
• Software design
• Control of source code
• Reviewing code
• Change management
• Configuration management
• Integration of software
• Program testing
• Release management process

27) Explain what are test driver and test stub and why it is required?

• The stub is called from the software component to be tested, it is used in top down approach
• The driver calls a component to be tested, it is used in bottom up approach
• It is required when we need to test the interface between modules X and Y and we have developed only module X. So we cannot just test module X but if there is any dummy module we can use that dummy module to test module X
• Now module B cannot receive or send data from module A directly, so in these case we have to transmit data from one module to another module by some external features. This external feature is referred as Driver

28) Explain what is Bug triage?
A bug triage is a process to

• Ensure bug report completeness
• Assign and analyze the bug
• Assigning bug to proper bug owner
• Adjust bug severity properly
• Set appropriate bug priority

29) List out various tools required to support testing during development of the application?
To support testing during development of application following tools can be used

• Test Management Tools: JIRA, Quality Center etc.
• Defect Management Tools: Test Director, Bugzilla
• Project Management Tools: Sharepoint
• Automation Tools: RFT, QTP, and WinRunner

30) Explain what is a cause effect graph?
A cause effect graph is a graphical representation of inputs and the associated outputs effects that can be used to design test cases.

31) Explain what is Test Metric is software testing and what information does it contains?
In software testing, Test Metric is referred to standard of test measurement. They are the statistics narrating the structure or content of a program.  It contains information like

• Total test
• Test run
• Test passed
• Test failed
• Tests deferred
• Test passed the first time

32) Explain what is traceability matrix?
A test matrix is used to verify the test scripts per specified requirements of test cases.

33) Explain what is the difference between Regression testing and Retesting?
Retesting is carried out to check the defects fixes, while regression testing is performed to check whether the defect fix have any impact on other functionality.

34) List out the software quality practices through the software development cycle?
Software quality practices includes

• Review the requirements before starting the development phase
• Code Review
• Write comprehensive test cases
• Session based testing
• Risk based testing
• Prioritize bug based on usage
• Form a dedicated security and performance testing team
• Run a regression cycle
• Perform sanity tests on production
• Simulate customer accounts on production
• Include software QA Test Reports

35) Explain what is the rule of a “Test Driven Development”?
The rule of a Test Driven Development is to prepare test cases before writing the actual code. Which means you are actually be writing code for the tests before you write code for the application.

36) Mention what are the types of documents in QA?
The types of documents in QA are

• Requirement Document
• Test Metrics
• Test cases and Test plan
• Task distribution flow chart
• Transaction Mix
• User profiles
• Test log
• User profiles
• Test incident report
• Test summary report

37) Explain what should your QA documents should include?
QA testing document should include

• List the number of defects detected as per severity level
• Explain each requirement or business function in detail
• Inspection reports
• Configurations
• Test plans and test cases
• Bug reports
• User manuals
• Prepare separate reports for managers and users

38) Explain what is MR and what information does MR consists of?
MR stands for Modification Request also referred as Defect report, it is written for reporting errors/problems/suggestions in the software.

39) What does the software QA document should include?
Software QA document should include

40) Mention how validation activities should be conducted?
Validation activities should be conducted by following techniques

• Hire third party independent verification and validation
• Assign internal staff members that are not involved in validation and verification activities
• Independent evaluation

Load Testing

How to Load Test your Application 

Load testing is a kind of performance testing which determines a system's performance under real-life load conditions. This testing helps determine how the application behaves when multiple users access it simultaneously.

This testing usually identifies - The maximum operating capacity of an application Determine whether current infrastructure is sufficient to run the application Sustainability of application with respect to peak user load Number of concurrent users that an application can support, and scalability to allow more users to access it. It is a type of non-functional testing. Load testing is commonly used for the Client/Server, Web based applications - both Intranet and Internet.

Need of Load Testing:

Some extremely popular sites have suffered serious downtimes when they get massive traffic volumes. E-commerce websites invest heavily in advertising campaigns, but not in Load Testing to ensure optimal system performance, when that marketing brings in traffic.
Consider the following examples

• Popular toy store Toysrus.com, could not handle the increased traffic generated by their advertising campaign resulting in loss of both marketing dollars, and potential toy sales.
• An Airline website was not able to handle 10000+ users during a festival offer.
• Encyclopedia Britannica declared free access to their online database as a promotional offer. They were not able to keep up with the onslaught of traffic for weeks.

Many sites suffer delayed load times when they encounter heavy traffic. Few Facts - Most users  click away after 8 seconds delay in loading a page $ 4.4 Billion Lost annually  due to poor performance

 

Why Load Testing ?

• Load testing gives confidence in the system & its reliability and performance.
• Load Testing helps identify the bottlenecks in the system under heavy user stress scenarios before they happen in a production environment.
• Load testing gives excellent protection against poor performance and accommodates complementary strategies for performance management and monitoring of a production environment.

 

Goals of Load Testing:

Loading testing identifies the following problems before moving the application to market or Production:

• Response time for each transaction
• Performance of System components under various loads
• Performance of  Database components under different loads
• Network delay between the client and the server
• Software design issues
• Server configuration issues like Web server, application server, database server etc.
• Hardware limitation issues like CPU maximization, memory limitations, network bottleneck, etc.

Load testing will determine whether system needs to be fine-tuned or modification of hardware and software is required to improve performance.

Environment needs to be setup before starting the load testing:

Hardware Platform	Software Configuration
Server Machines Processors Memory Disk Storage Load Machines configuration Network configuration	Operating System Server Software

 

Prerequisites of load testing:

The chief metric for load testing is response time. Before you begin load testing , you must determine -

• Whether the response time is already measured and compared - Quantitative
• Whether the response time is applicable to the business process - Relevant
• Whether the response time is justifiable - Realistic
• Whether the response time is achievable - Achievable
• Whether the response time is measurable using a tool or stopwatch - Measurable

 

Strategies of load Testing:

There are many numbers of ways to perform load testing. Following are a few load testing strategies-

Manual Load Testing: This is one of strategies to execute load testing, but it does not produce repeatable results, cannot provide measurable levels of stress on an application and is an impossible process to coordinate. In house developed load testing tools: An organization, which realizes the importance of load testing, may build their own tools to execute load tests. Open source load testing tools: There are several load testing tools available as open source that are free of charge. They may not be as sophisticated as their paid counterparts, but if you are on a budget, they are the best choice. Enterprise class load testing tools: They usually come with capture/playback facility. They support a large number of protocols. They can simulate an exceptionally large number of users.

 

Load Testing Process:

The load testing process can be briefly described as below -

1. Create a dedicated test environment for load testing
2. Determine the following
3. Load Test Scenarios
4. Determine load testing transactions for an application
   • Prepare Data for each transaction
   • Number of Users accessing the system need to be predicted
   • Determine connection speeds. Some users may be connected via leased lines while others may use dial-up
   • Determine different browsers and operating systems used by the users 
   • Configuration of all the servers like web, application and DB Servers
5. Test Scenario execution and monitoring . Collecting various metrics
6. Analyze the results. Make recommendations
7. Fin-tune the System
8. Re-test

 

Guidelines for load testing:

Load testing should be planned once the application becomes functionally stable. Large number of unique data should be ready in the data pool Number of users should be decided for each scenario or scripts Avoid creation of detailed logs to conserve the disk IO space Try to avoid downloading of images in the site Consistency of response time over elapsed period should be logged & the same should be compared with various test runs

 

Difference between Load and Stress testing:

Load Testing	Stress Testing
Load testing identifies the bottlenecks  in the system under various workloads and checks how the system reacts when the load is gradually increased	Stress testing determines the breaking point of the system to reveal the maximum point after which it breaks.

 

Difference between Functional and Load Testing:

Functional Testing	Load Testing
Results of functional tests are easily predictable as we have proper steps and preconditions defined	Results of load tests are unpredictable
Results of functional tests vary slightly	Load test results vary drastically
Frequency of executing functional testing will be high	Frequency of executing load testing will be low
Results of functional tests are dependent on the test data	Load testing depends on the number of users.

 

Load Testing Tools:

Tools recommended for load testing are: Loadrunner Web Load Astra Load Test Radview's Web Load Studio, Rational Site Load Silk Performer Loadrunner and Web Load are the popular tools. Their features are listed below -

Load Runner:

Load runner is HP tool  used to test the applications under normal and peak load conditions. Load runner generates load by creating virtual users that emulate network traffic. It  simulates real time usage like a production environment and gives graphical results.

Web load:

Web load supports HTTP1.0 and 1.1, including cookies, proxies, SSL, TSL, client certificates, authentications, persistent connections and chunked transfer coding. During execution, Webload gathers results at a per-client, per-transaction and per-instance level from the computers that are generating the load.

 

Advantages and disadvantages of Load testing:

Following are the advantages of Load testing:

• Performance bottlenecks identification before production
• Improves the scalability of the system
• Minimize  risk related to system down time
• Reduced costs of failure
• Increase customer satisfaction

Disadvantages of Load testing:

• Need programming knowledge to use load testing tools.
• Tools can be expensive as pricing depends on the number of virtual users supported.

 

Conclusion:

Load testing typically improves performance bottlenecks, scalability and stability of the application before it is available for production. This testing helps to identify the maximum operating capacity of applications as well as system bottlenecks.