Responsibilities:
Working within the ITMX and BCS Non-Functional Testing team to ensure the code delivered to the Customer and/or Live is fit for use
Performance Engineering
• Document and implement performance engineering strategy and test plans covering environment, schedule, test data set up to certify performance SLAs
• Coordinate and participate in requirements review, design and architecture reviews to feed into performance testing activities of assigned developed systems
• Partner with operations and developers to develop performance dashboards and provide periodic updates on application performance to all the stakeholders
• Monitor automated and manual performance testing, troubleshoot performance issues covering platform hardware analysis, scalability, and application profiling (Java, Erlang, Databases, etc
), and drive performance issues to closure
• Define and implement best practices for end-to-end application performance management solutions including Proof of Concepts and Tools evaluation and selection where alternative tools are needed
• Document problems, monitor resolutions and retain documentation necessary to share knowledge with engineering and application teams
• Develop business and product knowledge over time and share such knowledge to mentor newer team members
Volume and Performance Testing of a release
• Ensure the responsiveness of the functionality is acceptable to the customers
• Provide sufficient confidence in the release to support the decision of Live deployment
• Ensure defects are prioritised correctly from a commercial viewpoint
• Produce reports highlighting progress
• Manage any issues/blockers to progress
• Produce test completion summary reports that are shipped to the customer
Migration Testing of a release
• Identify the migration approach (release requirement, environment, schedule, test data) that will be undertaken for a release
• Ensure the backup and recovery system function correctly
• Ensure that the integrated application is stable
• Ensure that the integrated applications has no performance degradation impacts
• Validate functionality once upgraded, Verify data integrity
• Provide sufficient confidence in the release to support the decision of Live deployment
• Ensure defects are prioritised correctly from a commercial viewpoint
• Produce reports highlighting progress
• Manage any issues/blockers to progress
• Produce migration instructions that are shipped to the customer
Expectations
• Plan, estimate and define Non Functional test approach understanding the business, commercial and Non Functional requirements
• Lead the non-functional test team, driven to get multiple parallel Non-functional test projects done on time
• To use technical knowledge of the platforms and applications to determine appropriate tests
• To create and gain sign off of Non Function test strategies and test plans
• To ensure all risks and issues are reported, escalated and managed through to resolution
• To engage with the requirements team to resolve any points of clarification with respect to Non Functional test requirements to ensure sign off is agreed
• To assure from within the test team that all tests produced are consistent with the scope of the delivery
• To engage with Infrastructure & Network Services team where support is required
• To liaise with Development, DevOps and Functional Test where needed
• Deploy the latest release of code for testing
• To improve the resource consumption of the applications in order to reduce the cost of hardware acquisition in the immediate future
• To build relationships with the key teams in Vocalink/MasterCard
• To develop and maintain testing artefacts, processes and procedures and ensure these apply across all Vocalink/MasterCard Non Functional Testing projects
• To carry out any other task associated with the role as reasonably requested
Experience
Mandatory
• 5-7 years’ experience in Non Functional Testing with at least 2-3 years as a Performance Engineer
• Must be detail focussed
Must have detailed knowledge of Non Functional Test processes
• Able to define Performance Test plans and roadmaps and partner with the Engineering team to deliver strategy
• Experience in building right performance environment data sets and use of data virtualization tools where required
• Sound understanding of all technical aspects of testing
• Able to assess varying priorities and establish critical path / MVP when time constrained
• Self-motivated individual that finds and delivers solutions with the ability to continuously learn new applications and technologies
• Driven to get the job done, with a willingness to work out of hours at short notice
Ability to work around setbacks and blockers to achieve the solution
• Excellent planning and organisational skills
• Flexibility to take on new projects, ways of working
• Excellent problem solving skills and the ability to find solutions to issues, work around conflicting priorities (different test phases/projects all with different priorities) with a view to the commercial reality
• Prior experience installing, configuring and using Performance Testing tools such as LoadRunner, JMeter
• Experience of performance monitoring tools
• Good working knowledge of Java and the ability to monitor and tune JVM/App servers, articulate JVM GC logs, ability to collect performance metrics
• Experience of Oracle and SQL Scripting
• Good working knowledge of WebLogic/WebSphere/Tomcat or any enterprise level middleware technologies
• Good working knowledge of networking between multi-sites
• Experience of testing high volume transaction processing systems
• Good knowledge of load generation test tool
• Performance tuning experience with RDBMS (Oracle, SQL server etc
)
• Good working knowledge of Enterprise Systems Management products
• Experience of Agile and tools such as ALM
• Working effectively with both onshore and offshore teams
• Experience of undertaking Non Functional Testing in the Cloud
Desirable
• Working knowledge of Erlang (or demonstrable ability to learn a new language)
Erlang is a fundamental part of the runtime environment