Update release notes for PKB version 1.15.1.

PiperOrigin-RevId: 318359632

Update release notes for PKB version 1.15.0.

PiperOrigin-RevId: 316010183

Add netperf UDP stream test (GoogleCloudPlatform#2075)

* add UDP_STREAM and send size flags

* add flags and UDP_STREAM and pep fixes

* remove debug statements

* add flag to container_netperf

* added UDP STREAM results to tests

* add -M flag

* remove unnecessary line

* add comment justifying default size

* change to not in

* add upper and lower bounds to UDP send size

* revised comment

* remove -R 1 flag for TCP_STREAM, it is implicit

* remove line

Co-authored-by: Brandon Liu <[email protected]>

Release 1.13.0

Changes in this release:

Breaking changes:
- Removed gpus_per_node metadata from stencil2d and hpcg benchmarks
(GoogleCloudPlatformGH-1455)
- Removed legacy disk metadata (use data_disk\* not scratch_disk\* and
removed
  num_striped_disks + aws_provisioned_iops metadata) (GoogleCloudPlatformGH-1506)

New features:
- Added YCSB benchmark for Cloud Spanner (GoogleCloudPlatformGH-1387 from @haih-g)
- Added CUDA-enabled HPCG benchmark (GoogleCloudPlatformGH-1395)
- Added ManagedRelationalDatabase base classes and tests (GoogleCloudPlatformGH-1405)
- Added gpus to GceVmSpec. This is now the only way to create VMs with
gpus on GCE due to a gcloud API change (GoogleCloudPlatformGH-1406)
- Added flag_zip_defs which functions like flag_matrix_defs, but
performs a zip
  operation on the axes instead of a cross-product (GoogleCloudPlatformGH-1414)
- Added TensorFlow Benchmarks. (GoogleCloudPlatformGH-1420)
- Added --network_enable_BBR flag (GoogleCloudPlatformGH-1515)
- Added pgbench benchmark for managed PostgreSQL (GoogleCloudPlatformGH-1505)

Enhancements:
- Added basic auth support for Mesos provider. (GoogleCloudPlatformGH-1390)
- Added --failed_run_samples_error_length flag to limit failed run error
length (GoogleCloudPlatformGH-1391)
- Added `__eq__` and `__ne__` to IntegerList (GoogleCloudPlatformGH-1395)
- Added total_free_memory_kb to VirtualMachine class and implemented it
for
  Linux vms (GoogleCloudPlatformGH-1397)
- Created hpc_util for a place to share common HPC functions
- Added --runspec_estimate_spec flag to calculate an estimated spec
score (GoogleCloudPlatformGH-1401)
- Added all HPCC metrics as samples when running HPCC (GoogleCloudPlatformGH-1448)
- Added support for P100 gpus on Google Cloud Platform (GoogleCloudPlatformGH-1450)
- Added gpu type to cuda_toolkit_8 metadata (GoogleCloudPlatformGH-1453)
- Added num_gpus to cuda_toolkit_8 metadata (GoogleCloudPlatformGH-1455)
- Added range mode to gpu_pcie_bandwidth which calculates average
bandwidth over
  a provided range of transfer sizes (GoogleCloudPlatformGH-1482)
- Added size support to fio_benchmark scenarios (GoogleCloudPlatformGH-1489)
- Added RemoteCommandWithReturnValue (GoogleCloudPlatformGH-1516)

Bug fixes and maintenance updates:
- Fixed provision phase of memcached_ycsb benchmark for non-managed
memcached instances (GoogleCloudPlatformGH-1384)
- Fixed GPU benchmarks on GCE to work with new GPU API (GoogleCloudPlatformGH-1407)
- Changed cuda_toolkit_8 to use the gpu-specific base clock speed as the
default (GoogleCloudPlatformGH-1453)
- Changed default AWS P2 region for gpu benchmarks (GoogleCloudPlatformGH-1454)
- Fix multi-threading issue in fio.job filename (GoogleCloudPlatformGH-1474)
- Decreased speccpu2006 default disk size to 50gb (GoogleCloudPlatformGH-1484)
- Updated azure library version 1.0.3 for blob storage (GoogleCloudPlatformGH-1491)
- Added azure host_caching to metadata (GoogleCloudPlatformGH-1500)
- Fixed fio histograms when generated with numjobs>1 (GoogleCloudPlatformGH-1501)

Release v1.12.0

Release 1.11.0.

External contributions:
- Add ability to publish to InfluxDB (thanks @besanradwan GoogleCloudPlatformGH-1278)
- Always set internal IP-Address on OpenStack VMs (thanks @yremmet
GoogleCloudPlatformGH-1228)
- Add CloudSuite data-analytics benchmark (thanks @ivonindza GoogleCloudPlatformGH-1285)
- Update README.md (thanks @ianmaddox GoogleCloudPlatformGH-1291)
- Fix a small typo in the anti-affinity FLAG lookup (thanks @joelio
GoogleCloudPlatformGH-1284)
- Deprecate flag openstack_volume_size (thanks @vhe182 GoogleCloudPlatformGH-1220)
- Add ProfitBricks cloud api v3 support (thanks @aajdinov GoogleCloudPlatformGH-1264)
- Enable OpenStack Cinder Volume Type Option (thanks @rossmartyn04
GoogleCloudPlatformGH-1197)

New features:
- Add dpb_wordcount_benchmark (GoogleCloudPlatformGH-1253)

Enhancements:
- Add helpmatch usage instructions (GoogleCloudPlatformGH-1268)
- Add openStack_volume_type option decoder (GoogleCloudPlatformGH-1267)
- Upgrade OpenStack CLI dependency to 3.6.0 (GoogleCloudPlatformGH-1265)
- Add object storage service cold reads support, various improvements
(GoogleCloudPlatformGH-1290, GoogleCloudPlatformGH-1274)
- Add support for AWS Spot Instances (GoogleCloudPlatformGH-1288)
- Bump fio version to v2.17 and enable histogram (GoogleCloudPlatformGH-1300)
- Let publisher.py republish already-collected samples (GH 1299)
- Allow specifying temp dir (GoogleCloudPlatformGH-1277)
- Add --json_write_mode (GoogleCloudPlatformGH-1276)
- Allow override hpcc binaries (GoogleCloudPlatformGH-1269)

Bug fixes and maintenance updates:
- Lock samples json file before writing to it (GoogleCloudPlatformGH-1265)
- Fixed exception caused by publishers being None (GoogleCloudPlatformGH-1302)
- Add error and warning log level options to reduce log size (GoogleCloudPlatformGH-1301)
- Use force for DigitalOcean deletes (GoogleCloudPlatformGH-1281)
- Print helpmatch usage instructions (GoogleCloudPlatformGH-1280)
- Fix fio parser regex (GoogleCloudPlatformGH-1275)
- Specify AWS region when calling describe-images (GH 1273)
- Make CheckPrerequisites more comprehensive (GoogleCloudPlatformGH-1272)
- Use image_project flag in disk creation if set (GoogleCloudPlatformGH-1271)
- Minor bug fixes and configuration improvements (GoogleCloudPlatformGH-1262)

v1.10.0

External contributions:
- Re-write flag_util_test.py so it's easier to read (thanks @yilei GoogleCloudPlatformGH-1244)
- Fix bug that prevents running bonnie++ on Azure (thanks @rgodha GoogleCloudPlatformGH-1218)
- Add kernel compile benchmark (thanks @maggiejiao GoogleCloudPlatformGH-1215, GoogleCloudPlatformGH-1255)
- Change the documentation to reflect that work should be on master (thanks
  @besanradwan GoogleCloudPlatformGH-1209)
- Add flags to capture latency, bandwidth and IOPS logs in Fio benchmark (thanks @meteorfox GoogleCloudPlatformGH-1205)
- Re-add 'vm_util' object to fix broken master branch (thanks @vhe182 GoogleCloudPlatformGH-1196)
- Add EPEL Repo to Silo Installation (thanks @akrzos GoogleCloudPlatformGH-1153)

New features:
- Add GPU PCIe bandwidth test (GoogleCloudPlatformGH-1234, GoogleCloudPlatformGH-1250, GoogleCloudPlatformGH-1252, GoogleCloudPlatformGH-1254)
- Add blazemark (GoogleCloudPlatformGH-1145)
- Add simple memcached ycsb benchmark based on aerospike ycsb benchmark (GoogleCloudPlatformGH-1199)
- Add scimark2 installation package (GoogleCloudPlatformGH-1185)

Enhancements:
- Use FLAGS.aws_user_name if set for Rhel (GoogleCloudPlatformGH-1249)
- Fio enhancements (GoogleCloudPlatformGH-1246)
- Use aes128-ctr if aes128-cbc isn't available (GoogleCloudPlatformGH-1242)
- Make aeropsike able to run with raw devices on static vms (GoogleCloudPlatformGH-1243)
- Add some metadata to netperf samples (GoogleCloudPlatformGH-1236)
- Remove unneeded Azure code and add availability sets (GoogleCloudPlatformGH-1232)
- Add cassandra read concurrency flag (GoogleCloudPlatformGH-1233)
- Add a metadata attribute 'ssd_count' to spark_service (GoogleCloudPlatformGH-1229)
- Add a metadata attribute 'spark_svc_cloud' to spark_service (GoogleCloudPlatformGH-1226)
- Add ability to specify boot_disk_size in AWS vm spec (GoogleCloudPlatformGH-1231)
- Add a metadata attribute 'spark_svc_cloud' (GoogleCloudPlatformGH-1236)
- Set a default zone for the spark test to allow for subnet creation (GoogleCloudPlatformGH-1222)
- Update the location of the spark examples jar on the emr cluster (GoogleCloudPlatformGH-1222)
- Persist package installation across reboots (GoogleCloudPlatformGH-1185)
- Allow mongodb_ycsb to specify readahead settings (GoogleCloudPlatformGH-1256)

Bug fixes and maintenance updates:
- Close Aersospike connection in 1 second (GoogleCloudPlatformGH-1241)
- Fix bug with having multiple Azure data disks (GoogleCloudPlatformGH-1223)
- Fix aws spark service (GoogleCloudPlatformGH-1222)
- Add some git ignore entries (GoogleCloudPlatformGH-1222)
- Fix gcs credential conflict (GoogleCloudPlatformGH-1221)
- Fix bug with run_processes (GoogleCloudPlatformGH-1212)
- Remove collector from RunBenchmarkTask args (GoogleCloudPlatformGH-1210)
- Add the minimum tox version to the "tox is not installed" message (GoogleCloudPlatformGH-1201)
- Move sysbench05plus path prefix logic into package (GoogleCloudPlatformGH-1185)
- Fix bug with specifying Azure image (GoogleCloudPlatformGH-1204)
- Fix two files that were failing boilerplate check (GoogleCloudPlatformGH-1203)
- Update README.md (GoogleCloudPlatformGH-1200)

Release 1.9.0

Changes in this release.

New features:
- Add config file imports and allow for circular imports and add documentation (GoogleCloudPlatformGH-1163)
- Add a way to run benchmarks in parallel (GoogleCloudPlatformGH-1192)

Enhancements:
- ContainerizedDebianMixin: Ping to a fixed docker image and remove the sudo hack (GoogleCloudPlatformGH-1171)
- Auto detect  openjdk, libsnappy package versions (GoogleCloudPlatformGH-1181)
- Add flags to govern subnet creation and Optionally create only 1 subnet (GoogleCloudPlatformGH-1182)
- Install docker images as packages (GoogleCloudPlatformGH-1184)
- Call FLAGS.get_help if it's available (GoogleCloudPlatformGH-1187)
- Publish boot time samples for all tests (GoogleCloudPlatformGH-1156)

Bugfixes and maintenance updates:
- Update requirements.txt to set version of contextlib2 (GoogleCloudPlatformGH-1164)
- Fix bug with config flags (GoogleCloudPlatformGH-1165)
- Updated the cloudsuite web-serving benchmark (thanks @nooshin-mirzadeh, GoogleCloudPlatformGH-1166)
- Fix load command parsing (GoogleCloudPlatformGH-1168)
- openstack: Open all TCP and UDP ports for the internal network (GoogleCloudPlatformGH-1169)
- Fix aerospike metadata (GoogleCloudPlatformGH-1170)
- Adjust aerospike default replication factor (GoogleCloudPlatformGH-1172)
- Try replacing FlagValues._flags instead of FlagValues.FlagDict first (GoogleCloudPlatformGH-1175)
- Fix ycsb aggregator (GoogleCloudPlatformGH-1176)
- Fix bug during cleanup phase of object_storage_service benchmark (GoogleCloudPlatformGH-1178)
- Netperf thinktime fixes and support think time in nanoseconds instead of microseconds (GoogleCloudPlatformGH-1179, GoogleCloudPlatformGH-1186, GoogleCloudPlatformGH-1188)
- Fix sysbench05plus installation on ubuntu16.04 (GoogleCloudPlatformGH-1183)
- Fix race condition in Aerospike benchmark (GoogleCloudPlatformGH-1190)
- Clean up some pickling, unpickling issues (GoogleCloudPlatformGH-1191)
- Calculate free ram with more robust /proc/meminfo instead of `free`(GoogleCloudPlatformGH-1194)
- Fix multithread netperf (GoogleCloudPlatformGH-1149)
- Multiple fixes and refactoring of the linux package management on vms (GoogleCloudPlatformGH-1152)
- Fix dstat metadata in Analyze (GoogleCloudPlatformGH-1154)
- Obey flag overrides for static vm specs (GoogleCloudPlatformGH-1155)
- Fix links in README file for OpenStack and Cloudstack setup steps (thanks @shakhat, GoogleCloudPlatformGH-1157)
- Fix issue with GetConfig using flags (GoogleCloudPlatformGH-1160)
- Remove scratch disk from netperf and object_storage_service benchmark (GoogleCloudPlatformGH-1147, GoogleCloudPlatformGH-1148)
- Netperf changes to add num_streams metadata to samples (GoogleCloudPlatformGH-1177)
- Remove collector from RunBenchmarkTask args (GoogleCloudPlatformGH-1210)

Bugfixes and maintanence updates:

 - Fixed default machine type for Azure (GoogleCloudPlatformGH-1161)

Release v1.8.0

New features:
- Multithreaded netperf benchmark (GoogleCloudPlatformGH-1141, GoogleCloudPlatformGH-1144)
- Terasort benchmark using spark service infrastructure (GoogleCloudPlatformGH-1104)
- Support 10 or more disks on Azure (GoogleCloudPlatformGH-1102)
- Add sysctl and set_files flags (GoogleCloudPlatformGH-1096)
- Support DigitalOcean block storage (GoogleCloudPlatformGH-1092)
- Add cloudsuite_data_serving_rec_count and cloudsuite_data_serving_op_count parameters to cloudsuite_data_serving benchmark (GoogleCloudPlatformGH-1091)
- Add support for setting GCE boot disk size and type (GoogleCloudPlatformGH-1106)
- Add flag to skip reload on ycsb benchmark (GoogleCloudPlatformGH-1108)
- Support for AWS dedicated hosts (GoogleCloudPlatformGH-1109)
- Object storage multistream write-only scenario (GoogleCloudPlatformGH-1123)
- Allow multiple configs for the same benchmark in the same file (GoogleCloudPlatformGH-1126)
- Add flat that allows run retries (GoogleCloudPlatformGH-1129)
- Add fio_parameters flag (GoogleCloudPlatformGH-1131)
- Add config matrices (GoogleCloudPlatformGH-1134)
- Add events at the beginning and end of benchmarks (GoogleCloudPlatformGH-1135)
- Add extra_zones flag to pkb (GoogleCloudPlatformGH-1137)
- Add flag matrix filters (GoogleCloudPlatformGH-1138)
- Support allowing port ranges on Firewall.AllowPort (GoogleCloudPlatformGH-1139)
- Add static vm tags (GoogleCloudPlatformGH-1142)

Breaking changes:
- Because of GoogleCloudPlatformGH-1112, region names have changed.

Enhancements:
- Allow speccpu to run individual test (GoogleCloudPlatformGH-1113)
- Use Azure resource management mode (GoogleCloudPlatformGH-1112)
- GCP networks use subnets (GoogleCloudPlatformGH-1087)
- Add top level flags key to configs (GoogleCloudPlatformGH-1125)
- Precise resource usage for YCSB benchmarks (GoogleCloudPlatformGH-1127)

Bugfixes and maintanence updates:
- Fix bugs with Terasort (GoogleCloudPlatformGH-1136)
- Don't run container commands as sudo with ContainerizedDebianMixin (GoogleCloudPlatformGH-1130)
- Automatically use amazon linux if os_type is rhel (GoogleCloudPlatformGH-1124)
- Removed Panda as a dependency (GoogleCloudPlatformGH-1118, GoogleCloudPlatformGH-1119)
- Allow flag_util.ParseKeyValuePairs values to have colons in them (GoogleCloudPlatformGH-1117)
- Add ycsb to data directory (GoogleCloudPlatformGH-1116)
- Fix bug in mongodb_ycsb_benchmark cleanup (GoogleCloudPlatformGH-1115)
- Fix bug where static VM disk specs were overriden (GoogleCloudPlatformGH-1105)
- Use string formatting instead of addition to concatenate (GoogleCloudPlatformGH-1103)
- Fixed regression with fio flag (GoogleCloudPlatformGH-1097)
- Fix flags in static vm files (GoogleCloudPlatformGH-1093)
- Fix wait_for_command.py: wait for status file to avoid race condition (GoogleCloudPlatformGH-1090)