forked from openstack/swift
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathCHANGELOG
1363 lines (842 loc) · 47.8 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
swift (2.2.2)
* Data placement changes
This release has several major changes to data placement in Swift in
order to better handle different deployment patterns. First, with an
unbalance-able ring, less partitions will move if the movement doesn't
result in any better dispersion across failure domains. Also, empty
(partition weight of zero) devices will no longer keep partitions after
rebalancing when there is an unbalance-able ring.
Second, the notion of "overload" has been added to Swift's rings. This
allows devices to take some extra partitions (more than would normally
be allowed by the device weight) so that smaller and unbalanced clusters
will have less data movement between servers, zones, or regions if there
is a failure in the cluster.
Finally, rings have a new metric called "dispersion". This is the
percentage of partitions in the ring that have too many replicas in a
particular failure domain. For example, if you have three servers in a
cluster but two replicas for a partition get placed onto the same
server, that partition will count towards the dispersion metric. A
lower value is better, and the value can be used to find the proper
value for "overload".
The overload and dispersion metrics have been exposed in the
swift-ring-build CLI tools.
See http://docs.openstack.org/developer/swift/overview_ring.html
for more info on how data placement works now.
* Improve replication of large out-of-sync, out-of-date containers.
* Added console logging to swift-drive-audit with a new log_to_console
config option (default False).
* Optimize replication when a device and/or partition is specified.
* Fix dynamic large object manifests getting versioned. This was not
intended and did not work. Now it is properly prevented.
* Fix the GET's response code when there is a missing segment in a
large object manifest.
* Change black/white listing in ratelimit middleware to use sysmeta.
Instead of using the config option, operators can set
"X-Account-Sysmeta-Global-Write-Ratelimit: WHITELIST" or
"X-Account-Sysmeta-Global-Write-Ratelimit: BLACKLIST" on an account to
whitelist or blacklist it for ratelimiting. Note: the existing
config options continue to work.
* Use TCP_NODELAY on outgoing connections.
* Improve object-replicator startup time.
* Implement OPTIONS verb for storage nodes.
* Various other minor bug fixes and improvements.
swift (2.2.1)
* Swift now rejects object names with Unicode surrogates.
* Return 403 (instead of 413) on unauthorized upload when over account
quota.
* Fix a rare condition when a rebalance could cause swift-ring-builder
to crash. This would only happen on old ring files when "rebalance"
was the first command run.
* Storage node error limits now survive a ring reload.
* Speed up reading and writing xattrs for object metadata by using larger
xattr value sizes. The change is moving from 254 byte values to 64KiB
values. There is no migration issue with this.
* Deleted containers beyond the reclaim age are now properly reclaimed.
* Full Simplified Chinese translation (zh_CN locale) for errors and logs.
* Container quota is now properly enforced during cross-account COPY.
* ssync replication now properly uses the configured replication_ip.
* Fixed issue were ssync did not replicate custom object headers.
* swift-drive-audit now has the 'unmount_failed_device' config option
(default to True) that controls if the process will unmount failed
drives or not.
* swift-drive-audit will now dump drive error rates to a recon file.
The file location is controlled by the 'recon_cache_path' config value
and it includes each drive and its associated number of errors.
* When a filesystem does't support xattr, the object server now returns
a 507 Insufficient Storage error to the proxy server.
* Clean up empty account and container partitions directories if they
are empty. This keeps the system healthy and prevents a large number
of empty directories from slowing down the replication process.
* Show the sum of every policy's amount of async pendings in swift-recon.
* Various other minor bug fixes and improvements.
swift (2.2.0)
* Added support for Keystone v3 auth.
Keystone v3 introduced the concept of "domains" and user names
are no longer unique across domains. Swift's Keystone integration
now requires that ACLs be set on IDs, which are unique across
domains, and further restricts setting new ACLs to only use IDs.
Please see http://swift.openstack.org/overview_auth.html for
more information on configuring Swift and Keystone together.
* Swift now supports server-side account-to-account copy. Server-
side copy in Swift requires the X-Copy-From header (on a PUT)
or the Destination header (on a COPY). To initiate an account-to-
account copy, the existing header value remains the same, but the
X-Copy-From-Account header (on a PUT) or the Destination-Account
(on a COPY) are used to indicate the proper account.
* Limit partition movement when adding a new placement tier.
When adding a new placement tier (server, zone, or region), Swift
previously attempted to move all placement partitions, regardless
of the space available on the new tier, to ensure the best possible
durability. Unfortunately, this could result in too many partitions
being moved all at once to a new tier. Swift's ring-builder now
ensures that only the correct number of placement partitions are
rebalanced, and thus makes adding capacity to the cluster more
efficient.
* Per storage policy container counts are now reported in an
account response headers.
* Swift will now reject, with a 4xx series response, GET requests
with more than 50 ranges, more than 3 overlapping ranges, or more
than 8 non-increasing ranges.
* The bind_port config setting is now required to be explicitly set.
* The object server can now use splice() for a zero-copy GET
response. This feature is enabled with the "splice" config variable
in the object server config and defaults to off. Also, this feature
only works on recent Linux kernels (AF_ALG sockets must be
supported). A zero-copy GET response can significantly reduce CPU
requirements for object servers.
* Added "--no-overlap" option to swift-dispersion populate so that
multiple runs of the tool can add coverage without overlapping
existing monitored partitions.
* swift-recon now supports filtering by region.
* Various other minor bug fixes and improvements.
swift (2.1.0)
* swift-ring-builder placement was improved to allow gradual addition
of new regions without causing a massive migration of data to the new
region. The change was to prefer device weight first, then look at
failure domains.
* Logging updates
- Eliminated "Handoff requested (N)" log spam.
- Added process pid to the end of storage node log lines.
- Container auditor now logs a warning if the devices path contains a
non-directory.
- Object daemons now send a user-agent string with their full name.
* 412 and 416 responses are no longer tracked as errors in the StatsD
messages from the backend servers.
* Parallel object auditor
The object auditor can now be controlled with a "concurrency" config
value that allows multiple auditor processes to run at once. Using
multiple parallel auditor processes can speed up the overall auditor
cycle time.
* The object updater will now concurrently update each necessary node
in a new greenthread.
* TempURL updates
- The default allowed methods have changed to also allow POST and
DELETE. The new default list is "GET HEAD PUT POST DELETE".
- TempURLs for POST now also allow HEAD, matching existing GET and PUT
functionality.
- Added filename*= support to TempURL Content-Disposition response
header.
* X-Delete-At/After can now be used with the FormPost middleware.
* Make swift-form-signature output a sample form.
* Add v2 API to list endpoints middleware
The new API adds better support for storage policies and changes the
response from a list of backend urls to a dictionary with the keys
"endpoints" and "headers". The endpoints key contains a list of the
backend urls, and the headers key is a dictionary of headers to send
along with the backend request.
* Added allow_account_management and account_autocreate values to /info
responses.
* Enable object system metadata on PUTs (Note: POST support is ongoing).
* Various other minor bug fixes and improvements.
swift (2.0.0)
* Storage policies
Storage policies allow deployers to configure multiple object rings
and expose them to end users on a per-container basis. Deployers
can create policies based on hardware performance, regions, or other
criteria and independently choose different replication factors on
them. A policy is set on a Swift container at container creation
time and cannot be changed.
Full docs are at http://swift.openstack.org/overview_policies.html
* Add profiling middleware in Swift
The profile middleware provides a tool to profile Swift
code on the fly and collects statistical data for performance
analysis. A native simple Web UI is also provided to help
query and visualize the data.
* Add --quoted option to swift-temp-url
* swift-recon now supports checking the md5sum of swift.conf, which
helps deployers verify configurations are consistent across a cluster.
* Users can now set the transaction id suffix by passing in
a value in the X-Trans-Id-Extra header.
* New log_max_line_length option caps the maximum length of a log line.
* Support If-[Un]Modified-Since for object HEAD
* Added missing constraints and ratelimit parameters to /info
* Add ability to remove subsections from /info
* Unify logging for account, container, and object server processes
to provide a consistent message format. This change reorders the
fields logged for the account server.
* Add targeted config loading to swift-init. This allows an easier
and more explicit way to tell swift-init to run specific server
process configurations.
* Properly quote www-authenticate (CVE-2014-3497)
* Fix logging issue when services stop on py26.
* Change the default logged length of the auth token to 16.
* Explicitly set permissions on generated ring files to 0644
* Fix file uploads larger than 2GiB in the formpost feature
* Fixed issue where large objects would fail to download if the
auth token expired partway through the download
* Various other minor bug fixes and improvements
swift (1.13.1)
* Change the behavior of CORS responses to better match the spec
A new proxy config variable (strict_cors_mode, default to True)
has been added. Setting it to False keeps the old behavior. For
an overview of old versus new behavior, please see
https://review.openstack.org/#/c/69419/
* Invert the responsibility of the two instances of proxy-logging in
the proxy pipeline
The first proxy_logging middleware instance to receive a request
in the pipeline marks that request as handling it. So now, the
left most proxy_logging middleware handles logging for all
client requests, and the right most proxy_logging middleware
handles all other requests initiated from within the pipeline to
its left. This fixes logging related to large object
requests not properly recording bandwidth.
* Added swift-container-info and swift-account-info tools
* Allow specification of object devices for audit
* Dynamic large object COPY requests with ?multipart-manifest=get
now work as expected
* When a client is downloading a large object and one of the segment
reads gets bad data, Swift will now immediately abort the request.
* Fix ring-builder crash when a ring partition was assigned to a
deleted device, zero-weighted device, and normal device
* Make probetests work with conf.d configs
* Various other minor bug fixes and improvements.
swift (1.13.0)
* Account-level ACLs and ACL format v2
Accounts now have a new privileged header to represent ACLs or
any other form of account-level access control. The value of
the header is a JSON dictionary string to be interpreted by the
auth system. A reference implementation is given in TempAuth.
Please see the full docs at
http://swift.openstack.org/overview_auth.html
* Added a WSGI environment flag to stop swob from always using
absolute location. This is useful if middleware needs to use
out-of-spec Location headers in a response.
* Container sync proxies now support simple load balancing
* Config option to lower the timeout for recoverable object GETs
* Add a way to ratelimit all writes to an account
* Allow multiple storage_domain values in cname_lookup middleware
* Moved all DLO functionality into middleware
The proxy will automatically insert the dlo middleware at an
appropriate place in the pipeline the same way it does with the
gatekeeper middleware. Clusters will still support DLOs after upgrade
even with an old config file that doesn't mention dlo at all.
* Remove python-swiftclient dependency
* Add secondary groups to process user during privilege escalation
* When logging request headers, it is now possible to specify
specifically which headers should be logged
* Added log_requests config parameter to account and container servers
to match the parameter in the object server. This allows a deployer
to turn off log messages for these processes.
* Ensure swift.source is set for DLO/SLO requests
* Fixed an issue where overwriting segments in a dynamic manifest
could cause issues on pipelined requests.
* Properly handle COPY verb in container quota middleware
* Improved StaticWeb 404 error message on web-listings and index
* Various other minor bug fixes and improvements.
swift (1.12.0)
* Several important pieces of information have been added to /info:
- Configured constraints are included and allow a client to discover
the limits on names and object sizes that the cluster supports.
- The supported tempurl methods are now included.
- Static large object constraints are now included.
* The Last-Modified header value returned will now be the object's
timestamp rounded up to the next second. This allows subsequent
requests with If-[un]modified-Since to use the Last-Modified
value as expected.
* Non-integer values for if-delete-at headers will now properly
report a 400 error instead of a 503.
* Fix object versioning with non-ASCII container names.
* Bulk delete with POST now works properly.
* Generic means for persisting system metadata
Swift now supports system-level metadata on accounts and
containers. System metadata provides a means to store internal
custom metadata with associated Swift resources in a safe and
secure fashion without actually having to plumb custom metadata
through the core swift servers. The new gatekeeper middleware
prevents this system metadata from leaking into the request or
being set by a client.
* catch_errors and gatekeeper middleware are now forced into the proxy
pipeline if not explicitly referenced.
* New container sync configuration option, separating the end user
from knowing the required end point and adding more secure
signed requests. See
http://swift.openstack.org/overview_container_sync.html for full
information.
* bulk middleware now can be configured to retry deleting containers.
* The default yield_frequency used to keep client connections alive
during slow bulk requests was reduced from 60 seconds to 10 seconds.
While this is a change to a default, it should not affect deployments
and there is no migration process needed.
* Swift processes will attempt to set RLIMIT_NPROC to 8192.
* Server processes will now exit with a non-zero error code on config
errors.
* Warn if read_affinity is configured but not enabled.
* Fix checkmount error parsing in swift-recon.
* Log at warn level when an object is quarantined.
* Fixed CVE-2014-0006 to avoid a potential timing attack with tempurl.
* Various other minor bug fixes and improvements.
swift (1.11.0)
* Added discoverable capabilities
A Swift proxy server now by default (although it can be turned off)
will respond to requests to /info. The response to these requests
include information about the cluster and can be used by clients to
determine which features are supported in the cluster.
* Object replication ssync (an rsync alternative)
A Swift storage node can now be configured to use Swift primitives
for replication transport instead of rsync. This is an experimental
feature that is not yet considered production ready.
* If a source times out on an object server read, try another one
of them with a modified range.
* The proxy now responds to many types of requests as soon as it
has a quorum. This can help speed up responses (without
changing the results), especially when one node is acting up.
There is a post_quorum_timeout config value that can tune how
long to wait for requests to finish after a quorum has been
established.
* Add accurate timestamps in proxy log lines for the start and
end of a request. These are added as new fields on the end of
the existing log lines, and therefore should not break
existing, well-behaved log processors.
* Add an "inline" query parameter to tempurl
By default, temporary URLs add a "Content-Disposition" header
that forces many clients to download the object. Now, temporary
URLs support an optional "inline" query parameter that will
force a "Content-Disposition: inline" header to be added to the
response, overriding the default.
* Use TCP_NODELAY for created sockets. This can dramatically
lower latency for small object workloads.
* DiskFile API, with reference implementation
The DiskFile abstraction for talking to data on disk has been
refactored to allow alternate implementations to be developed.
Included in the codebase is an in-memory reference
implementation. For full documentation, please see the developer
documentation. The DiskFile API is still a work in progress and
is not yet finalized.
* Removal of swift-bench
The included benchmarking tool swift-bench has been extracted
from the codebase and is now in its own repository at
https://github.com/openstack/swift-bench. New swift-bench
binaries and packages may be found on PyPI at
https://pypi.python.org/pypi/swift-bench
* Bulk delete now also supports the POST verb, in addition to DELETE
* Added functionality to the swift-ring-builder to support
limited recreation of ring builder files from the ring file itself.
* HEAD on account now returns 410 if account was deleted and
not yet reaped. The old behavior was to return a 404.
* Fixed a bug introduced since the 1.10.0 release that
prevented expired objects from being removed from the system.
This resulted in orphaned expired objects taking up space on
the system but inaccessible to the API. This regression and
fix are only important if you have deployed code since the
1.10.0 release. For a full discussion, including a script that
can be used to clean up orphaned objects, see
https://bugs.launchpad.net/swift/+bug/1257330
* Tie socket write buffer size to server chunk size parameter. This
pairs the underlying network buffer size with the size of data
that Swift attempts to read from the connection, thereby
improving efficiency and throughput on connections.
* Fix 500 from account-quota middleware. If a user had set
X-Account-Meta-Quota-Bytes to something non-integer prior to
the installation of the account-quota middleware, then the
quota check would choke on it. Now a non-integer value is
treated as "no quota".
* Quarantine objects with busted metadata. Before, if you
encountered an object with corrupt or missing xattrs, the
object server would return a 500 on GET, and wouldn't quarantine
anything. Now the object server returns a 404 for that GET and
the corrupted file is quarantined, thus giving replication a
chance to fix it.
* Fix quarantine and error counts in audit logs
* Report transaction ID in failure exception logs
* Make pbr a build-time only dependency
* Worked around a bug in eventlet 0.9.16 where the size of the
memcache connection pools would grow unbounded.
* Tempurl keys are now properly stored as utf8
* Fixed an issue where concurrent PUT requests to accounts or
containers may result in errors due to locked databases.
* Handle copy requests in account and container quota middleware
* Now ensure that a WWW-Authenticate header is on all 401 responses
* Various other bug fixes and improvements
swift (1.10.0)
* Added support for pooling memcache connections
* Added support to replicating handoff partitions first in object
replication. Can also configure how many remote nodes a storage node
must talk to before removing a local handoff partition.
* Fixed bug where memcache entries would not expire
* Much faster calculation for choosing handoff nodes
* Added container listing ratelimiting
* Fixed issue where the proxy would continue to read from a storage
server even after a client had disconnected
* Added support for headers that are only visible to the owner of a Swift
account
* Fixed ranged GET with If-None-Match
* Fixed an issue where rings may not be balanced after initial creation
* Fixed internationalization support
* Return the correct etag for a static large object on the PUT response
* Allow users to extract archives to containers with ACLs set
* Fix support for range requests against static large objects
* Now logs x-copy-from header in a useful place
* Reverted back to old XML output of account and container listings to
ensure older clients do not break
* Account quotas now appropriately handle copy requests
* Fix issue with UTF-8 handling in versioned writes
* Various other bug fixes and improvements, including support for running
Swift under Pypy and continuing work to support storage policies
swift (1.9.1)
* Disallow PUT, POST, and DELETE requests from creating older tombstone
files, preventing the possibility of filling up the disk and removing
unnecessary container updates.
* Set default wsgi workers to cpu_count
Change the default value of wsgi workers from 1 to auto. The new
default value for workers in the proxy, container, account & object
wsgi servers will spawn as many workers per process as you have cpu
cores. This will not be ideal for some configurations, but it's much
more likely to produce a successful out of the box deployment.
* Added reveal_sensitive_prefix config setting to filter the auth token
logged by the proxy server.
* Ensure Keystone's reseller prefix ends with an underscore. Previously
this was a recommendation--now it is enforced.
* Added log_file_pattern config to swift-drive-audit for drive errors
* Add support for telling Swift to detect a content type on a request.
* Additional object stats are now logged in the object auditor
* Moved the DiskFile interface into its own module
* Ensure the SQLite cursors are closed when creating functions
* Better support for valid Accept headers
* In Keystone, don't allow users to delete their own account
* Return a UTC timezone designator in container listings
* Ensure that users can't remove their account quotas
* Allow floating point value for dispersion coverage
* Fix incorrect error page handling in staticweb
* Add utf-8 charset to multipart-manifest=get response.
* Allow dispersion tools to use keystone server with insecure certificate
* Ensure that files are always closed in tests
* Use OpenStack's "Hacking" guidelines for code formatting
* Various other minor bug fixes and improvements
swift (1.9.0)
* Global clusters support
The "region" concept introduced in Swift 1.8.0 has been augmented with
support for using a separate replication network and configuring read
and write affinity. These features combine to offer support for a single
Swift cluster spanning wide geographic area.
* Disk performance
The object server now can be configured to use threadpools to increase
performance and smooth out latency throughout the system. Also, many
disk operations were reordered to increase reliability and improve
performance.
* Added config file conf.d support
Allow Swift daemons and servers to optionally accept a directory as the
configuration parameter. This allows different parts of the config file
to be managed separately, eg each middleware could use a separate file
for its particular config settings.
* Allow two TempURL keys per account
By adding a second key, a user can safely rotate keys and prevent URLs
already in use from becoming invalid. TempURL middlware has also been
updated to allow a configuable set of allowed methods and to prevent a
bugrelated to content-disposition names.
* Added crossdomain.xml middleware. See
http://docs.openstack.org/developer/swift/crossdomain.html for details
* Added rsync bandwidth limit setting for object replicator
* Transaction ID updated to include the time and an optional suffix
* Added x-remove-versions-location header to disable versioned writes
* Improvements to support for Keystone ACLs
* Added parallelism to object expirer daemon
* Added support for ring hash prefix in addition to the existing suffix
* Allow all headers requested for CORS
* Stop getting useless bytes on manifest Range requests
* Improved container-sync resiliency
* Added example Apache config files. See
http://docs.openstack.org/developer/swift/apache_deployment_guide.html
for more info
* If an account is marked as deleted but hasn't been reaped and is still
on disk, responses will include an "X-Account-Status" header
* Fix 503 on account/container HEAD with invalid format
* Added extra safety on account-level DELETE when using bulk deletes
* Made colons quote-safe in logs (mainly for IPv6)
* Fixed bug with bulk delete max items
* Fixed static large object manifest range requests
* Prevent static large objects from containing other static large objects
* Fixed issue with use of delimiter in container queries where some
objects would not be listed
* Various other minor bug fixes and improvements
swift (1.8.0)
* Make rings' replica count adjustable
* Added a region tier to the ring above zones
* Added timing-based sorting of object servers on read requests
* Added support for auto-extract archive uploads
* Added support for bulk delete requests
* Added support for large objects with static manifests
* Added list_endpoints middleware to provide an API for determining where
the ring places data
* proxy-logging middleware can now handle logging for other middleware
proxy-logging should be used twice in the proxy pipeline. The first
handles middleware logs for requests that never made it all the way
to the server. The last handles requests that do make it to the server.
This is a change that may require an update to your proxy server
config file or custom middleware that you may be using. See the full
docs at http://docs.openstack.org/developer/swift/misc.html#module-swift.common.middleware.proxy_logging.
* Changed the default sample rate for a few high-traffic requests.
Added log_statsd_sample_rate_factor to globally tune the StatsD
sample rate. This tunable can be used to reduce StatsD traffic
proportionally for all metrics and is intended to replace
log_statsd_default_sample_rate, which is left alone for
backward-compatibility, should anyone be using it.
* Added swift_hash_path_prefix option to swift.conf
New deployments are advised to set this value to a random secret
to protect against hash collisions
* Added user-managed container quotas
* Added support for account-level quotas managed by an auth reseller
* Added --run-dir option to swift-init
* Added more options to swift-bench
* Added support for CORS "actual requests"
* Added fallocate_reserve option to protect against full drives
* Allow ring rebalance to take a seed
* Ring serialization will now produce the same gzip file (Py2.7)
* Added support to swift-drive-audit for handling rotated logs
* Added first-byte latency timings for GET requests
* Added per disk PUT timing monitoring support
* Added speed limit options for DB auditor
* Force log entries to be one line
* Ensure that fsync is used and not just fdatasync
* Improved handoff node selection
* Deprecated keystone is_admin feature
* Fix large objects with unicode in the segment names
* Update Swift's MemcacheRing to provide API compatibility with
standard Python memcache libraries
* Various other minor bug fixes and improvements
swift (1.7.6)
* Better tempauth storage URL guessing
* Added --top option to swift-recon -d
* Allow optional, temporary healthcheck failure
* keystoneauth middleware now supports cross-tenant ACLs
* Add dispersion report flags to limit reports
* Add config option to turn eventlet debug on/off
* Added override option for swift-init's KILL_WAIT
* Added oldest and most recent replication pass to swift-recon
* Fixed 500 error response when GETing a many-segment manifest
* Memcached keys now use a delta timeout when possible
* Refactor DiskFile to hide temp file names and exts
* Remove IP-based container-sync ACLs from auth middlewares
* Fixed bug in deleting memcached account info data
* Fixed lazy-listing of object manifest segments
* Fixed bug where a ? in the object name caused an error
* Swift now returns 406 if it can't satisfy Accept
* Fix infinite recursion bug in object replicator
* Swift will now reject names with NULL characters
* Fixed object-auditor logging to use a minimum of unix sockets
* Various other minor bug fixes and improvements
swift (1.7.5)
* Support OPTIONS verb, including CORS preflight requests
* Added support for custom log handlers
* Range support is extended to support GET requests with multiple ranges.
Multi-range GETs are not yet supported against large-object manifests.
* Cluster constraints are now settable by config
* Replicators can now run against specific devices or partitions
* swift-bench now supports running on multiple cores and multiple servers
* Added partition option to swift-get-nodes
* Allow underscores in account and user in tempauth via base64 encodings
* New option to the dispersion report to output the missing partitions
* Changed storage server StatsD metrics to report timings instead of
counts for errors. See the admin guide for the updated metric names.
* Removed a dependency on WebOb and replaced it with an internal module
* Fixed config parsing in swift-bench -x
* Fixed sample_rate in StatsD logging
* Track unlinks of async_pendings with StatsD
* Remove double GET on range requests
* Allow unsetting of X-Container-Sync-To and ACL headers
* DB reclamation now removes empty suffix directories
* Fix non-standard 100-continue behavior
* Allow object-expirer to delete the last copy of a versioned object
* Only set TCP_KEEPIDLE on systems where it is supported
* Fix stdin flush and fdatasync issues on BSD platforms
* Allow object-expirer to delete the last version of an object
* Various other minor bug fixes and improvements
swift (1.7.4)
* Fix issue where early client disconnects may have caused a memory leak
swift (1.7.2)
* Fix issue where memcache serialization was not properly loading
the config value
swift (1.7.0)
* Use custom encoding for ring data instead of pickle
Serialize RingData in a versioned, custom format which is a combination
of a JSON-encoded header and .tostring() dumps of the
replica2part2dev_id arrays. This format deserializes hundreds of times
faster than rings serialized with Python 2.7's pickle (a significant
performance regression for ring loading between Python 2.6 and Python
2.7). Fixes bug 1031954.
The new implementation is backward-compatible; if a ring
does not begin with a new-style magic string, it is assumed to be an
old-style pickle-dumped ring and is handled as before. So new Swift
code can read old rings, but old Swift code will not be able to read
newly-serialized rings.
* Do not use pickle for serialization in memcache, but JSON
To avoid issues on upgrades (unability to read pickled values, and cache
poisoning for old servers not understanding JSON), we add a
memcache_serialization_support configuration option, with the following
values:
0 = older, insecure pickle serialization
1 = json serialization but pickles can still be read (still insecure)
2 = json serialization only (secure and the default)
To avoid an instant full cache flush, existing installations should
upgrade with 0, then set to 1 and reload, then after some time (24
hours) set to 2 and reload. Support for 0 and 1 will be removed in
future versions.
* Update proxy-server StatsD logging. This is a significant change to the
existing StatsD intigration. Docs for this feature can be found in
doc/source/admin_guide.rst.
* Improved swift-bench to allow random object sizes and better usability
* Updated probe tests
* Replicator removal metrics are now generated on a per-device basis
* Made object replicator locking more optimistic
* Split proxy-server code into separate modules
* Fixed bug where swift-recon would not report all unmounted drives
* Fixed issue where a LockTimeout may have caused a file descriptor to
not be closed properly
* Fixed a bug where an error may have caused the proxy to stop returning
data to a client
* Fixed bug where expirer would get confused by odd deletion times
* Fixed a bug where auto-creating accounts would return an error if they
were recreated after being deleted
* Fix when rate_limit_after_segment kicks in
* fallocate() failures properly return HTTPInsufficientStorage from
object-server before reading from wsgi.input, allowing the proxy
server to quickly error_limit that node
* Fixed error with large object manifests and x-newest headers on GET
* Various other minor bug fixes and improvements
swift (1.6.0)
* Removed bin/swift and swift/common/client.py from the swift repo. These
tools are now managed in the python-swiftclient project. The
python-swiftclient project is a second deliverable of the openstack
swift project.
* Moved swift_auth (openstack keystone) middleware from keystone project
into swift project
* Made dispersion report work with any replica count other than 3. This
substantially affects the JSON output of the dispersion report, and any
tools written to consume this output will need to be updated.
* Added Solaris (Illumos) compatibility
* Added -a option to swift-get-nodes to show all handoffs
* Add UDP protocol support for logger
* Added config options for rate limiting of large object downloads.
* Added config option `log_handoffs` (defaults to True) to proxy server
to log and update statsd with information about when a handoff node is
used. This is helpful to track the health of the cluster.
* swift-bench can now use auth 2.0
* Support forbidding substrings based on a regexp in name_filter
middleware
* Hardened internal server processes so only authorized methods can be