Title: EXAM 2
Course: Special Topics in Computer Programming (TEMPLATE) > Section: Competency Modules

Respondus

Q: How should requirements for AST be documented so they can be understood and serve as the basis for accurate AST planning?
- in a clear and concise manner
- in technical terminology
- in as short a description as possible
- in a foreign language
A: in a clear and concise manner

Q: Developing an Automated System Test Framework requires which of the following?
- a mini product development cycle
- a lot of programmers
- a little bit of luck
- graduates of ACC's ITSE 1392 course
A: a mini product development cycle

Q: The high volume of data requirements for AST include which of the following (select all that apply)
- Amount / volume of test data needed
- Data to cover all business scenarios
- Identification of the testing techniques to be used
- Every possible combination of data
A: Amount / volume of test data needed; Data to cover all business scenarios; Identification of the testing techniques to be used

Q: Test data should be acquired by all of the following sources EXCEPT
- Scenarios developed by testers to focus on functionality
- Live data from user scenarios
- Live data that includes personal identity information
- Load testing scenarios
A: Live data that includes personal identity information

Q: What type of test data can be modified without affecting the validity of the test? (select the best answer)
- Modifiable test data
- Unmodifiable test data
- Made up test data
- Test data containing personal identification information
A: Modifiable test data

Q: Specific test data that is required to verify that a specific test requirement condition is met is also known as ___________
- Modifiable test data
- Unmodifiable test data
- Made up test data
- Test data containing personal identification information
A: Unmodifiable test data

Q: Which of the following best describes the elements which support the testing effort?
- hardware and software
- networking and facilities
- test data and skilled testers
- all of the above
- payroll
A: all of the above

Q: The preparation for creating a test environment include all of the following EXCEPT
- Obtain sample set of SUT production hardware
- How other companies test their products
- Test data requirements
- Network and security characteristics
- Number of servers, clients, tool licenses, etc.
A: How other companies test their products

Q: Hardware requirements include which of the following (select all that apply)
- Host system
- Networking protocol
- Specialized equipment
- Compilers
A: Host system; Specialized equipment

Q: Software requirements include which of the following (select all that apply)
- Operating systems
- Network protocol
- Compilers
- Other software tools
A: Operating systems; Network protocol; Compilers; Other software tools

Q: List FIVE AST process requirements
Feedback: * Testing phases to support * Lessons learned from previous releases * Level of effort to build the proposed SUT * Technology selected for the system implementation * Budget for implementing the product or system * Schedule allocated to develop and test the system * One product release or a series of product releases * Understand who owns the testing process * Type of testing team – independent, or integrated with development * Development process – Agile, extreme, test-driven * Roles and responsibilities of AST team

Q: Additional information in support of AST requirements include 1) manual testing procedure, 2) design documents, and 3) prototypes. Briefly describe the benefit of each of these three items.
Feedback: * Manual test procedure * Useful to understand how product really works * Design documents * Describe how product is designed * Provide additional details to support developing automated tests * Prototypes * Users can “see” expected results * Useful for “high-risk” areas

Q: If information is not available on a product, which of the following activities could produce results (select all that apply)
- conduct interviews
- become the local subject matter expert (SME)
- use an existing system to "reverse engineer" information
A: conduct interviews; become the local subject matter expert (SME); use an existing system to "reverse engineer" information

Q: When should an AST strategy document be created?
- After you have finished developing the AST
- At the very beginning, before you have gathered any information
- After you have reviewed design documents and understand the task at hand
- Whenever the boss says you need to create one
A: After you have reviewed design documents and understand the task at hand

Q: Which of the following statements is TRUE when initially considering AST project scope and test objectives?
- A high-level description of what the AST effort is trying to accomplish is sufficient.
- Detailed description of every test needed must be created at this point
- It is not necessary to establish project scope and test objectives at the beginning.
- Wait until the tests have been written, then create the automated test objectives.
A: A high-level description of what the AST effort is trying to accomplish is sufficient.

Q: Which of the following statements are TRUE about the process to create automated test objectives? (Select all that apply)
- Don't try to automate everything at once
- Everything can be tested or automated
- Focus on highest-risk functionality
- Ignore the reuse potential of an automated module
- Focus automation on repetitive tasks
A: Don't try to automate everything at once; Focus on highest-risk functionality; Focus automation on repetitive tasks

Q: Which of the following criteria should be used when optimizing the use of limited resources? (Select all that apply)
- Highest to lowest risk
- Lowest to highest priority
- Budget constraints
- Personnel skills available
- Time constraints
A: Highest to lowest risk; Budget constraints; Personnel skills available; Time constraints

Q: Briefly list 3 considerations to take into consideration when designing and developing test cases.
Feedback: 1. Detailed description of test cases for each test phase 2. Reusable components and project-specific features 3. Type of test data and how derived or acquired 4. Number and content of phases of code delivery 5. Reporting requirements 6. Include security, performance and scalability, compatibility and usability

Q: Briefly list 3 items that need to be included in test case documentation
Feedback: * Include standards for design * Adapt manual procedures to automation * Automate your test procedure documentation * Automate your test code generation * Test case development techniques

Q: Designing and developing an Automated System Test Framework requires following which of the following set of skills?
- software development
- software architecture
- software development and software architecture
- program management
A: software development and software architecture

Q: In an ASTF, the Test Manager module supports which of the following tasks? (select all that apply)
- Executes tests
- Logs results
- Selects test procedures / steps to execute
- Specifies input
- Reads results
- Determines pass/fail
A: Executes tests; Logs results; Selects test procedures / steps to execute

Q: In an ASTF the Test Procedures module performs which of the following tasks? (select all that apply)
- Executing tests
- Logging results
- Selecting test procedures / steps to execute
- Specifies input
- Reads results
- Determines pass / fail
A: Specifies input; Reads results; Determines pass / fail

Q: What does it mean for the AST Environment to be "clean"?
- isolated, secure, controlled, and stable
- free of compiler errors
- changes are made anytime without any level of control
- everyone wears clean room - clothing, smocks, hats, etc.
A: isolated, secure, controlled, and stable

Q: Which of the following is a recommended solution to the problem of "covering all test configurations"?
- using VMWare
- constantly reconfiguring the system under test
- ignoring the problem of testing all configurations
- just tell the boss that everything is OK
A: using VMWare

Q: One technique to detect changes in device drivers and other file-based components is _______________
A: MD5 checksum / MD5 / MD5 check sum

Q: When properly implemented Automated Configuration Management will verify _____________
- Only approved HW and SW are installed
- System settings/parameters are properly defined
- No unauthorized HW or SW has been added
- No required HW or SW has been removed
- All of the above
- None of the above
A: All of the above

Q: SUT requirements can be linked to software development by doing which of the following?
- Developing the Requirements Traceability Matrix (RTM)
- Updating test steps to include pass / fail results
- Hyperlinking test cases
- Requiring standard test case templates
- Updating the RTM to include pass / fails results automatically
A: Developing the Requirements Traceability Matrix (RTM)

Q: If the ASTF automatically creates defect data and enters them directly into a bug reporting system, no human intervention is required to create the defect.
- True
- False
A: False

Q: What is the main reason to test automated tests?
- Verify that what has been implemented works according to specifications.
- Verify that all tests run and provide a pass / fail result.
- Verify that all tests scheduled to be created have been created.
- Teach someone else how to run the automated tests.
- To make the boss happy.
A: Verify that what has been implemented works according to specifications.

Q: Which of the following is a COMMON expectation of locally developed (home grown) and purchased (off the shelf) software solutions?
- Requires high quality
- Internal customers
- External customers
- Quickly patched
- Often difficult to maintain
A: Requires high quality

Q: Testing open-source and vendor automated testing solutions should include which of the following (select all that apply)
- Verify they work "as advertised"
- Focus on unique or additional "features" added to meet your requirements
- Scalability testing
A: Verify they work "as advertised"; Focus on unique or additional "features" added to meet your requirements; Scalability testing

Q: Which of the following statement is FALSE regarding peer reviews of the ASTF design?
- Not a judgmental or performance review
- Perform them only once
- Perform them often
- Catch errors early in the ASTF design
A: Perform them only once

Q: List FIVE items that should be reviewed during a review of test cases.
Feedback: * Review Test Steps – Are they legible, legitimate, and precise? * Review Test Logic – Do they follow the correct logical flow? * Review Automated Test Code – Does the generated test code implement the test steps and logic? * Review Test Coverage – Is the test a duplicate of an existing test? Does it covers a new requirement? Are all requirements met? Are security concerns tested? * Review Test Template Compliance – Does the test case meet the template / framework requirements? * Review Test Data – Is the test data valid? Does it cover the depth and breadth required? Does it support the overall test coverage goals? Does it check boundary conditions?

Q: If the test cases all pass is the product ready to ship? (Be sure to address the TWO focus areas necessary to answer this apparently simple Yes/No question.)
Feedback: * Requirements * Do the test cases accurately map the status back to the requirements documents? * Coverage * Do the test cases accurately test the stated requirements and is there a test case for each requirement?

Q: Which of the following topics must be addressed in a customer review? (mark all that apply)
- Assumptions
- Approach
- Agreement
- Appearance
- Application
A: Assumptions; Approach; Agreement

Q: Automated testing can be applied to BOTH functional and non-functional testing.
- True
- False
A: True

Q: Explain what is meant by "vulnerability" and give TWO examples of vulnerabilities.
Feedback: * Vulnerability – weakness in the software that allows the application or system integrity to be compromised by an attack * Buffer overflow – condition in which an application attempts to store data beyond the bounds of the destination buffer * SQL injection – when user input / data is not validated at the database level

Q: What is meant by "soak testing"?
Feedback: Loading a system for an extended period of time to assess its behavior under an increasing load – above its expected normal amount

Q: What is meant by "concurrency testing"?
Feedback: Used to determine resource issues with the SUT’s resources are accessed concurrently

Q: What is meant by "disruption in Liveliness"?
Feedback: Liveliness - The ability of a concurrent application to fulfill its function requirements with some finite window of time Deadlock – multiple threads within an application are blocked at some point in their code while trying to execute Livelock – threads are not blocked and inactive; they are stuck in a non-progressive cycle Starvation – resource contention failure among threads

Q: Performance testing includes which of the following? (mark all that apply)
- Speed
- Scalability
- Stability
- Selectability
- Standardization
A: Speed; Scalability; Stability

Q: Code coverage testing is always considered to be functional testing.
- True
- False
A: False

Q: What are the automation benefits of unit testing?
Feedback: * Automation benefits * Finer control over unit isolation * Repeatability of test cases * Supports automated build processes (checking out and in of code modules)