Doubts Milestone 7

  • validate_cpu_usage.sh - In benchmark we take average CPU for 1 Gb file upload and download separately.
    Questions
  1. do upload and download of only 1 gb file ?
    1.1 There might be some version that have increased CPU usage overtime with multiple files so do I upload/download multiple files ?
    PROS - Better data
    CONS - Some versions take a lot of time for even small amount of data upload/download of multiple files will take forever.
    Please suggest what is expected ?
  2. success when up/down criteria for both is passed right ?
  • validate_memory_usage.sh - In benchmark we take average memory for 1 Gb file upload and download separately.
    Questions
  1. do upload and download of only 1 gb file ?
    1.1 There might be some version that have increased memory usage overtime with multiple files so do I upload/download multiple files ?
    PROS - Better data
    CONS - Some versions take a lot of time for even small amount of data upload/download of multiple files will take forever.
    Please suggest what is expected ?
  2. success when up/down criteria for both is passed right ?
  3. For memory usage the benchmark is there to check for average memory usage then there is milestone 5 where in we have to check if memory usage is increasing over time.
    For this script do we do according to module 5 and check if memory increases over multiple file transfers ?
    OR
    Just check average memory usage ? and if this then what is criteria where the memory usage is decided as failure ? For CPU it is 2X for memory also 2X ??
  • validate_file_permissions.sh
    Questions
  1. In benchmark version we have taken permission reading according to default values in vsftpd.conf wherein for upload permission were not changed as expected in milestone 3.
    So do we compare permissions according to new specs added in module 3 or according to previous data ?

Also the QBox benchmark file that will be supplied , will it have only one value like a number 12 for CPU usage or will it be in the same format as we have prepared it and then we grep the value that is required according to the script ?

and what is output expected when say version_x fails is unable to upload a file in the cpu test but is within threshold for download ?

Here we go.

validate_cpu_usage.sh

  1. This is upto you. If you want better data, you are always welcome to (hint) stop the script after a certain period of time.
  2. success when CPU usage does not exceed atleast twice the benchmark usage for either upload or download.

validate_memory_usage.sh

  1. Same as above.
  2. success when memory usage does not exceed atleast twice the benchmark usage and does not consume more and more memory on subsequent transfer for both upload and download.
  3. Automate exactly the same as you have done in milestone 5. Memory usage should be significantly higher, but you can assume 2X

validate_file_permissions.sh

  1. Kindly refer to my question on the same topic here. Expected file permissions (Read the entire thread).

The QBox benchmark file will be in the same format as you have prepared it. So expect some grepping :smiley:

For the last question, I do not think that will be a possible scenario. I believe the server file will fail for both download and upload.

1 Like