App test_ Summary of test points

Compatibility test

• Operating system compatibility

  • The test strategy ： Covering the mainstream operating system on the market （Android、IOS、 Hongmeng ） And version
  • Test method ： Local real machine + Cloud test platform
  • Test point ：app Whether the installation and uninstallation of are normal ,app Whether all functions of the are normal

• Resolution compatibility

  • The test strategy ： It covers the mainstream resolution and screen size in the market
  • Test point ： Check whether the interface display is normal 、 Whether the space is normally available

  Hardware compatibility

  Brands ROM Compatibility

Stability test

• Introduce ：Monkey The test is also known as the monkey test , The reason is that suppose a monkey operates a computer , It must be a mess in the face of computers and systems , No one can predict what will happen unexpectedly . And in the process of testing , The tests that test engineers usually perform are pre - designed test cases , Applied to a specific scenario . This is certainly true in most cases , But this predefined scenario , It is usually set by the test engineer , But in this particular case , But it may not work . therefore , We need to have another test method , To complete an alternative test , To cover more possible and even abnormal situations .Monkey Testing can help us make up for this scenario .

• effect ： Check the stability of the application under test

• The measure

  Losses to customers ： Such as data error 、 System crash and so on , Calculate the loss caused by the problem , Divided by the expected profits from the application , Get a percentage ,r1

  User feedback ： Divide the user's negative feedback by all feedback , Get the percentage ：r2

  The customer submits bug： User submitted bug Divide by the total bug, Get the percentage ：r3

  Defect repair cost ： Repair bug Divided by the total cost of the application , Get the percentage ：r4

  Change the number of requirements ： The number of changed requirements divided by the total number of requirements , Get the percentage ：r5

  Calculation formula ：Q = （1-r1-r2-r3-r4-r5）*100,Q The greater the value of, the better the stability of the application

• The test method ： Use monkey Command test the application under test , Observe whether the log is made of crash、ANR、error And so on

Weak network test

• Purpose ： Check whether the function and business operation of the tested application are normal under the poor network environment

• Focus on ：

  • response time
  • timeout handler
  • Mass flow event
  • Repeat payment

• Network delay

  • 1-30ms, very nice
  • 31-50ms, good
  • 51-100ms, commonly
  • 101-200ms, Poor
  • 201-500ms, range
  • 500ms, Basically no access to

• Network division

  • 2G（ Weak net ）
  • 3G（ Weak net ）
  • 4G、5G、WiFi
  • High packet loss rate
  • High latency
  • No network

• The test method

  • Simulate weak network through packet capturing tool

    1. charles Set up a remote connection （Proxy-Proxy settings)

       

    2. The mobile terminal sets up a network proxy ： Set up -WLAN- Long press the connection name - Modify the network - Click on advanced options - Agent selection manual , Enter the host name on this computer ip Address , port 8888

       

    3. charles Click on the Allow

       

    4. Weak network settings

       

       Weak net ： The upside -10, The downside -30

       2G： The upside -15, The downside -50

       3G： The upside -384, The downside -2800

    • adopt QNET Tool implementation

      • download ：https://wetest.qq.com/product/qnet
      • Help document ：https://cdn.wetest.qq.com/qnet/files/QNET Network testing tools 2.0.pdf

Cross event testing

• Cross event testing

  （1） Multiple App Whether the operation at the same time affects the normal function , Such as music download 、 Music listening 、QQ、 WeChat, etc. ;

  （2） App Before runtime / Whether background switching affects normal functions ;

  （3） App Call at runtime / Answer the phone ;

  （4） App Send at run time / Receiving information ;

  （5） App Send at run time / Receive mail ;

  （6） App Switching networks at runtime （2G/3G/4G/5G/WIFI）;

  （7） App Run browse web ;

  （8） APP The mobile phone is powered off during operation 、 restart 、 Charge 、 Plug in the headphones ;

  （9） App Runtime Kill Drop the process and open it again ;

  （10） App Use the camera at runtime 、 Calculator and other mobile devices ;

  （11） App Run time using Bluetooth transmission / receive data ;

  （12） APP Run time view app push ;

  （13） APP Rotate the screen at runtime ;

  （14） APP Lock screen during operation ;

  （15） When there is no memory space ,APP Can you respond correctly .

Install uninstall test

• Install the test

  • file ： Whether the operation manual is standardized 、 Whether the content is concise and easy to understand , Whether the document content is consistent with the actual operation
  • Installation package ： Version number 、 Signature 、 Whether the file name conforms to the specification
  • setup script ： Prompt information 、 Installation progress 、 Abnormal situation
  • Whether to identify SD card 、 Whether it can be installed to SD card
  • Whether it can operate normally after installation
  • Overlay installation （ Install higher version 、 Install the lower version ）

• Uninstall test

  • Uninstall process
  • Check whether the data is cleared after uninstallation
  • uninstall SD Applications in cards

Performance testing

• Application start time （ Cold start 、 Hot start ）
• CPU、 Memory 、 Electric quantity 、 Flow, etc

Security testing

• apk File security

  • Whether it can be decompiled

  • digital signature

• Data security

  Whether sensitive data is encrypted

  Whether there is sensitive data in the log file

  Whether there is sensitive data in the configuration file

  Permission to check

• Keyboard hijacking

  Sensitive data input （ Payment password, etc ） Use app Bring your own keyboard

• Video screen

  Whether the input sensitive data will be recorded