[#QB-3104] QB should send compressed data between server and nodes

QuickBuild

QB should send compressed data between server and nodes

Created: 21/Dec/17 11:10 AM Updated: 13/Jan/18 03:01 AM

Component/s:

None

Affects Version/s:

7.0.28

Fix Version/s:

None

Original Estimate:	Unknown	Remaining Estimate:	Unknown	Time Spent:	Unknown
Environment:	Ubuntu

Description

« Hide

While analysing requests from master server we encountered multiple possible issues:

1. Requests /file_transfer are not compressed - using "compress=false" generating 15GB of data send between node and server

2. There are 500000 POST requests /service/server which produces 35GB of data transfer

None of those are compressed.

All

Comments

Work Log

Change History

Sort Order:

[ Permlink | « Hide ]

Robin Shen [21/Dec/17 11:30 PM]

Are you using file input/output option of steps to transfer files? If so, what is the data size if you enable the "compress=true" option?

[ Permlink | « Hide ]

Piotr Jedrys [22/Dec/17 07:43 AM]

How can we enable "compress=true" option?
How can we check input/output option?
Data is from 10MB up to 200MB (except for one request which is of size 6GB)

[ Permlink | « Hide ]

Piotr Jedrys [22/Dec/17 07:46 AM]

If you are asking for Fetch input/ Send output config - we are not using those.
We use repositories defined with specific configuration paths.

[ Permlink | « Hide ]

Robin Shen [23/Dec/17 01:36 AM]

File compressing on QuickBuild repository is not supported yet. Please watch below issue:
http://track.pmease.com/browse/QB-3107

[ Permlink | « Hide ]

Robin Shen [13/Jan/18 03:01 AM]

Will be covered by ~~QB-3107~~