Title: EXAM 1
Course: Special Topics in Computer Programming (TEMPLATE) > Section: Competency Modules

Respondus

Q: Automated software testing is a totally separate activity from manual software testing.
- True
- False
A: False

Q: Automated software testing is a software development activity.
- True
- False
A: True

Q: Which of the following statements related to automated software testing are correct? (select all that apply)
- Focus is on automating the integration and system testing efforts
- Overall objective is to design, develop, and deliver an automated test and retest capability that increases efficiencies
- Results will be a significant increase in the cost, time and resources associated with traditional test and evaluation methods
A: Focus is on automating the integration and system testing efforts; Overall objective is to design, develop, and deliver an automated test and retest capability that increases efficiencies

Q: Automated Software Testing should support applications that (select all that apply)
- run on only one platform
- are developed in different programming languages
- may or may not use graphical user interfaces (GUI's)
- run any type of network protocol
A: are developed in different programming languages; may or may not use graphical user interfaces (GUI's); run any type of network protocol

Q: AST Frameworks require that the framework is installed on the system under test (SUT)
- True
- False
A: False

Q: Starting Automated Software Testing at unit test will allow for more reuse
- True
- False
A: True

Q: All manual tests should be automated
- True
- False
A: False

Q: One benefit of Automated Software Testing is removing required and error-prone manual human interaction
- True
- False
A: True

Q: Which one of the following test(s) require human interaction
- Usability testing
- Regression testing
- Security testing
- Soak testing
- Concurrency testing
A: Usability testing

Q: Which of the following is NOT an appropriate Automated Software Testing activity for Production Testing
- Verification of documentation changes
- Verification of program corrections
- Quick turnaround for testing production fixes and patches
- Automating acceptance testing
A: Verification of documentation changes

Q: Automated testing can be used to verify that changes to Automated Software Testing do not violate required standards
- True
- False
A: True

Q: Customers want more functionality delivered faster and cheaper, this means that (select all that apply)
- Each release will be larger and more complex
- Less time to test each release
- More releases each year
- Must meet schedules regardless of the quality of the software
A: Each release will be larger and more complex; Less time to test each release; More releases each year

Q: What was the key conclusion of the study done by Colorado State Univerity regarding hardware and software testing comparisons?
- Software development lags behind hardware design and test.
- Hardware design and test lags behind software development.
- Software development has superior tools to hardware development.
- Software and hardware development tools are equal in their productivity and usefulness.
A: Software development lags behind hardware design and test.

Q: The textbook states that "The cost and time of software testing represent a significant portion of a project's overall cost". What percentage of the overall cost and schedule does the textbook estimate is related to software testing?
- 33%
- 40%
- 50%
- 60%
- 66%
A: 50%

Q: Which of the following types of test are the best candidates for automation? (select all that apply)
- Tests that are repeated the most
- Tests that are difficult or labor intensive
- Tests run only once
- Test cases that change with each delivery of the product
A: Tests that are repeated the most; Tests that are difficult or labor intensive

Q: Which of the following statements describe the reason for the initial increase in test time and effort for automated testing? (select all that apply)
- Automated testing adds a level of complexity
- Sample data may not exist to support automated tests
- Automated testing is easier than manual testing to implement
- Sometimes there is no tool on the market and one has to be developed
A: Automated testing adds a level of complexity; Sample data may not exist to support automated tests; Sometimes there is no tool on the market and one has to be developed

Q: Requiring "test entrance criteria" before starting tests is reported to result in a decrease in test effort and schedule. Which of the following are criteria would best support that decrease?
- Unit / integration tests complete
- Smoke test successful
- Software build successful
- Source code under version / level control
- All of the above
A: All of the above

Q: A small data subset is OK for functional testing, but a ________ database is required for production level testing.
A: production size / production-size / production sized / production-sized

Q: The essence of software quality is
- how well the product performs.
- how well the products meets expected functionality and performance
- how easy the product is to use
- how many defects are undetected
- meeting product schedules
A: how well the products meets expected functionality and performance

Q: Describe THREE different metrics that can be used to measure software quality.
Feedback: Software defect density (defects per lines of code) Mean time to failure (MTTF) Mean time to critical failure (MTTCF) Number of high-priority defects that have not been found or removed Reliability (probability that no failure will occur in the next n time interval)

Q: Explain why AST "enables more testing" by listing at least FOUR different reasons.
Feedback: Full set of regression tests run every time Increased test coverage (AST can cover more combinations) AST increases amount of effective test time Automated tests don’t get tired or inattentive Automated tests are easier to replicate AST can run memory leak detection better than manual

Q: Exlain how software testing can increase the "breadth and depth" of testing. (Be sure to include several specific examples and descriptions.)
Feedback: Improved Build Verification Test (Smoke Test) Improved Regression Testing Multiplatform and Configuration Compatibility Testing Improved Execution of Mundane Tests Improved Focus on Advanced Test Issues

Q: A business case for justifying the cost of software testing is needed to perform which of the following activities? (mark all that apply)
- Justify the business need
- Justify the cost and benefit
- Identify the expected risks, including WHEN benefits will be realized
- Make sure that you have the necessary funding for the project
- Make sure that you have the necessary staffing for the project
A: Justify the business need; Justify the cost and benefit; Identify the expected risks, including WHEN benefits will be realized

Q: A successful AST business case includes all of the following EXCEPT
- Expected costs and benefits
- Necessary skills and processed needed
- Potential savings and time line for achieving the savings
- Approval from the external customer
- Buy-in from team and management
A: Approval from the external customer

Q: Characteristics of failed AST projects include ALL of the following EXCEPT
- Objective was to "speed up testing"
- Purchased an automation tool and everyone was trained
- Just a "try it - you'll like it"
- No real "team buy-in"
A: Purchased an automation tool and everyone was trained

Q: Key factors to focus on when identifying business needs include all of the following EXCEPT
- Need for speeding up the testing effort and increasng the testing efficiency
- Need for decreasing the testing cost
- Need for applying test team member skills most effectively
- Making the boss look good by ignoring risks
A: Making the boss look good by ignoring risks

Q: Speeding up testing will impact delivery ONLY if the test is in the critical path
- True
- False
A: True

Q: Which of the following statements are TRUE (mark all that apply)
- Automating the boring, mundane tests, that must be repeated for each build, will better utilize member skills and improve quality.
- AST can improve tester morale and lead to higher quality
- Automating manual tests will usually increase efficiency
A: Automating the boring, mundane tests, that must be repeated for each build, will better utilize member skills and improve quality.; AST can improve tester morale and lead to higher quality; Automating manual tests will usually increase efficiency

Q: The primary points in determining ROI include which of the following (mark all that apply)
- Developing automated tests requires more effort up front than manually developing a test
- Maintenance of automated tests does not need to be considered
- The payoff really comes from tests that are rerun on a regular basis
A: Developing automated tests requires more effort up front than manually developing a test; The payoff really comes from tests that are rerun on a regular basis

Q: The Excel spreadsheet for test setup time calculates the time estimates for
- manual test setup and automated test setup
- manual test setup only
- automated test setup only
A: manual test setup and automated test setup

Q: The Excel spreadsheet for test set time savings calculates the set up time for
- manual test setup and automated test setup
- manual test setup only
- automated test setup only
A: manual test setup and automated test setup

Q: The spreadsheet for comparing manual and automated test execution time requires which of the following parameters (mark all that apply)
- Number of manual tests planned
- Number of automated tests planned
- Estimated number of manual test operations
- Estimated number of automated test operations
- Estimated time estimate for executing manual tests
- Estimated time estimate for executing automated tests
A: Number of manual tests planned; Number of automated tests planned; Estimated number of manual test operations; Estimated number of automated test operations; Estimated time estimate for executing manual tests; Estimated time estimate for executing automated tests

Q: The spreadsheet for estimating diagnostics time savings requires which of the following inputs (mark all that apply)
- Number of test outputs to diagnose for manual tests
- Number of test outputs to diagnose for automated tests
- Estimated number of test iterations for manual tests
- Estimated number of test iterations for automated tests
A: Number of test outputs to diagnose for manual tests; Number of test outputs to diagnose for automated tests; Estimated number of test iterations for manual tests; Estimated number of test iterations for automated tests

Q: Other ROI considerations for calculating savings of automated testing vs. manual testing include which of the following (mark all that apply)
- Personnel requirements
- Lab equipment requirements
- Test case maintenance
- Intangible savings
A: Personnel requirements; Lab equipment requirements; Test case maintenance; Intangible savings

Q: Risks must be __________ since they can lead to failure in terms of cost overruns, schedule slippage, undetected critical software, errors, and rework.
- minimized
- eliminated
- reduced
- avoided
A: minimized

Q: Factors that influence risk are
- short time to market
- lack of adequate skills
- new technology
- difficult to automate requirements or features
- all of the above
A: all of the above

Q: List FOUR questions that might indicate that AST may be the preferred testing solution.
Feedback: * Need to keep up with ever increasing complexity of new technology * Need to keep your test team’s productivity up to the level of development * Support the increasing level of software and component reuse * Prove that software was tested to standards * Capture and reuse the knowledge of subject matter experts * Need to document and re-create problems found during testing * Need to execute tests remotely * Run manual tests, such as memory leak detection, etc. * Need to run tests 24/7 without increasing your staffing level

Q: The results of a survey on "Why Automation Fails" identified which of the following key reasons for failure?
- Lack of resources (time budget and skills)
- Lack of processes and standards
- Lack of interest
- Lacj if software development considerations
A: Lack of resources (time budget and skills); Lack of processes and standards; Lacj if software development considerations

Q: Which of the following statement BEST describes "Why test technology is lagging"
- Lack of management interest and support
- Innovation has been focused on software development
- Software testing technology has been lagging behind software development
- Innovation has been focused on software development AND software testing technology has been lagging behind software development
A: Innovation has been focused on software development AND software testing technology has been lagging behind software development

Q: Currently there is not one single test tool that can be used to support all operating system environments.
- True
- False
A: True

Q: Introduction of an automated testing tool will immediately reduce the test effort and schedule
- True
- False
A: False

Q: The introduction of automated tools requires new skills; therefore, additional training is required.
- True
- False
A: True

Q: Once automation has been implemented, everything can be tested, and test coverage will increase to 100%
- True
- False
A: False

Q: The sooner a defect is discovered, the easier it is to fix.
- True
- False
A: True

Q: Building testability into an application can best be supported by which of the following activity
- Providing a logging / tracing mechanism
- Proper sequencing of test cases
- Recording pass / fail only for each test performed
- Running a large number of tests
A: Providing a logging / tracing mechanism

Q: Which of the following software development activities will enhance the success of automated software development? (select all that apply)
- Document test cases in a standard way
- Adhere to coding standards
- Use proper object naming standards
- Promote code reuse
- Use lots of different platforms and languages
A: Document test cases in a standard way; Adhere to coding standards; Use proper object naming standards; Promote code reuse

Q: List / identify advantages of using open source software.
Feedback: No licensing fee Free support Portable across platforms Modifiable and adaptive Comparatively lightweight Not tied to a specific vendor

Q: List / identify the key items to consider when evaluating and choosing an automation tool.
Feedback: Identify the problem to solve Narrow down the tools requirements /criteria Identify a list of tools that meet the criteria Assign a weight to each tool criterion based on priority Evaluate each tool candidate and assign a score Multiply the weight by the tool score to get the tool’s overall score

Q: Which of the following answers best describes criteria to use in narrowing down the broad list of tools to a select few?
- Requirements
- Longevity
- User base
- Past experience
- All of the above
A: All of the above

Q: Vendors that provide AST tools do not all use the same standards for design. To select a vendor or tool based on standards, it would be appropriate to use all of the following characteristics EXCEPT:
- Ease of automation
- Product availability
- Product price
- Product interchangeability/interoperability
- Cross-platform compatability
- Testing capability
A: Product price

Q: What is the benefit of having a business case developed and approved for AST?
- Buy-in should exist from all stakeholders
- You know how much money you can spend
- It keeps management happy
- There is no benefit from having a business case developed and approved
A: Buy-in should exist from all stakeholders