Sirma’s TaaS framework comprises strategic assets such as process, people, and technology dedicated to the testing needs of businesses focused on increasing efficiency to create value for our customers. Our service offerings are differentiated into four core areas that cater to each requirement that a business may have.
QA Trends-Shifting from functional to business assurance
Test Center Excellence
Centralized Testing with Standardized Processes
Reusable Test Artifacts ( Frameworks, Templates etc. )
Transparency Through Metrics
Flexible Resourcing & Costing Models
Knowledge Repositories & Talent Management
Key Focus on Test ( Inhouse Automation Tool - iBorg )
The following are the various methods of software testing. Sirma uses all methods of testing services depending upon the usages and requirements.Manual testing is a key concept to ensure that the application is error-free and works in conformance to the specified functional requirements. We at Sirma perform detailed quality analysis (QA) by physically using the functions and features of an application as an end-user, with the aim to deliver software that is free from defects. We focus on the software’s specifications, user-friendly nature, and user acceptance testing (customer onboarding). Basically, manual testing checks the quality of the software and delivers a bug-free product to the customer.
The following are the type of testing covered under software testing as a service. The types mentioned are not limited, based on the requirement of the Bank, Sirma will undertake other types of testing:
Functional Testing types include
Unit Testing
Sanity Testing
Integration Testing
Smoke Testing
System Testing
Interface Testing
Beta/Acceptance Testing
User Acceptance Testing
Install Testing
Recovery Testing
Reliability Testing
Localization Testing
UI Testing
Compatibility Testing
Access security testing
Browser compatibility testing
Cross-device testing
Load testing
Volume testing
Usability testing
Stress Testing
Vulnerability testing
URL manipulation testing
XSS (Cross-Site Scripting)
Compliance Testing
Regression testing (fully automated using RPA)
The approach of software testing as a service by Sirma will lead to establishing the test Centre of excellence (TCoE) that brings into a shared services function, people, processes, tools, and infrastructure. Standardizing processes and optimizing resource utilization is to bring in maturity. The Test Center of Excellence (TCoE) solution is targeted towards customer who are challenged with decentralized and under-performing testing functions, underutilization of testing people, inconsistent test processes and are looking to move up the maturity ladder towards a standardized testing function, and at the same time improves efficiency, optimize people and tool utilization and lower testing costs.
Solution Group
Project
management
Best Practices
Labs
Generic Framework
Training Center
Training
Intellectual Property
Productivity
Improvement
BD/ Presales
Reusable Components
Performance Measurement &
Benchmarking
Knowledge Manegement
Generic Data Models
KPI Library
Standard Testing Deliverable
Templates (Test Cases, Execution,
Defects Reports Etc.)
Organizations can typically save in excess of 30% of testing costs by using Sirma's Test CoE while at the same time reducing risk and time to market
Test Strategy and Plan
The strategy and plan for the services cover testing Roadmap and refining the existing testing strategy, testing planning for various applications, Providing technical and non-technical resources for various testing projects, Test Plan, Test Case Preparation for planned testing, providing of the requirement to Test Case Traceability Matrix and test case Design.
Plan Initiation
Requirement Review
Sirma will do a detailed analysis of the service requirement and document the same for Bank’s review.The priority for testing will be done by Sirma and the bank
Gap Analysis
Gap Analysis Based on the requirement, gap analysis will be done with help of the bank’s business team
Test Strategy Creation
On completion of the Gap analysis the detailed test strategy will be proposed. The same will be documented and signed by the bank.Any changes suggested by the bank on strategy will be discussed and incorporated in the test strategy.
Creation of Traceability Matrix
Based on the requirement of the bank the forward, backward, and bi-directional traceability matrix will be created as per the test cases. The traceability matrix will be available to the bank through the dashboard.
The sample traceability matrix is given below
BRD - specification FSD - specification Test Id Test Detail Product code Owner Test result Severity Status
High Level Test Plan: Base the strategy high level test plan will created and shared with bank for approval.
Test Plan
The Creation of a test plan by Sirma, involves test case writing, setting up and customization of the testing tool, setting up of defects handling. The testing environment required to be a replication of the production and the tool for automated testing will be interfaced with the testing environment. Any defect will be handled both manually and automated so that the accuracy of the testing will be maintained.
Before the execution of the test cases, all the test cases will be properly documented by Sirma. This document will be reviewed by the bank. Once the document is signed off, test cases will be executed. The testing will be done through the completion of entry and exit criteria. As part of entry criteria the test environment and the parameter will be set to start the test. The exit criteria are based on the outcome of the test result compared with the standard result. If the exit criteria are not satisfied, the testing will be handled over to the next process of defect handling or testing.Whenever the exit criteria or entry criteria are not satisfied, the analytical team will initiate the action for mitigation, and log entry will be stored and analysed for further recommendation. The closure of the test will be decided by the test lead after clearly signed off by the stakeholders. The tool which we are using is designed to generate an email/SMS to the stakeholder for critical decision required to be taken by the stakeholder for further process. Test data preparation is a critical activity for software testing. The test data need to be made available in the test environment. Regarding any PII data, Sirma has inbuilt technology in its tool to camouflage data by masking. This will enable the bank to mitigate the risk of data breach.
As a part of TaaS, Sirma provides a dashboard which can be accessed by stakeholders of the bank. The user can access the test results and test in progress which will be available through the dashboard and report/download. The system will be built with secure web services, where the user will be able to download the report as per the requirement in secured way. The user can post their comments which includes signing off the successful testing, authorizing exceptional case, close, reopen of the test case. The bank can have full control over the testing using the dashboard.
Test data preparation is the critical activity for software testing. The test data need to be made available in the test environment. Regarding any PII data, Sirma has in built technology in its tool to camouflage data by masking. This will enable the bank to mitigate the risk of a data breach.
Requirement Review
Gap Analysis
Test Strategy Creation
Traceability Matrix
High Level Test Plan
Defect Logs
Test Summary Reports
Defect Trends
QA Matrix
Initiative Improvement
Proccess
Test Case Writing
Setup Test Environment
Setup /Plan Test Tools
Setup Defects Management
Proccess
Detail Plan
Execute Test Cases
Report Defects and
Re-Testing
Automation Design
and Scripting
Automation Design
and Execution
All proposed solutions are future proof and can be implemented on-premise and Cloud as required by the bank.
SIRMA never compromises in the quality of the service. Our quality assurance team is working round the clock which never allows any slippage of quality. For any testing, Sirma Business Consulting (India) Private Limited adopts 3 levels of approval before closing the testing.
Apache JMeter is the performance monitoring tool that is used by Sirma to test performance both on static and dynamic resources, Web dynamic applications. It can be used to simulate a heavy load on a server, group of servers, network, or object to test its strength or to analyze overall performance under different load types.
Sirma uses a strong RPA enabled tool which has inbuilt capability to meet the required specification for the services mentioned by the Bank. All the existing deliverables currently available will be provided by using this tool
Sirma products are safe and secure to use. Sirma takes all precautionary measures to ensure that the bank data is protected and uncompromised. The list of security measures that have been adopted by Sirma is given below:
Standard Practices
Sirma follows standard software development practices of uniform coding standards, guidelines, and reviews. Any data transmission will be reviewed and tested internally for security and penetration vulnerabilities.
RSA Encryption
Sirma uses RSA Encryption for information transmitted during any activity.
Mobile Authentication based Sign Up
Sirma uses mobile authentication-based signup via OTP (one-time password) for authenticating users and allowing access to the data.
Part of software testing as a service, the following level of securities have been taken care by Sirma:
Physical security
Network Security
Database security
Adhoc security
Intellectual property protection
PII protection
Sirma will be making use of home grown IMPACTO IBorg Tool for the Automation testing. The Tool will be used to access the test environments via VPN provided by the bank. For Mobile app testing the APKs will be installed on Sirma’s test devices or on the devices on the farm. Sirma will ensure that all the platforms and devices used will be at par with the best security standards. The automation testing framework is as below
