~tplavcic/percona-xtrabackup/bld-26-2.0

« back to all changes in this revision

Viewing changes to src/libarchive/build/windows/vc90/libarchive_test/libarchive_test.vcproj

  • Committer: Alexey Kopytov
  • Date: 2012-02-10 20:05:56 UTC
  • mto: This revision was merged to the branch mainline in revision 390.
  • Revision ID: akopytov@gmail.com-20120210200556-6kx41z8wwrqfucro
Rebase of the parallel compression patch on new trunk + post-review
fixes.

Implementation of parallel compression and streaming for XtraBackup.

This revision implements the following changes:

* InnoDB files are now streamed by the xtrabackup binary rather than
innobackupex. As a result, integrity is now verified by xtrabackup and
thus tar4ibd is no longer needed, so it was removed.

* xtrabackup binary now accepts the new '--stream' option which has
exactly the same semantics as the '--stream' option in
innobackupex: it tells xtrabackup to stream all files to the standard
output in the specified format rather than storing them locally.

* The xtrabackup binary can now do parallel compression using the
quicklz library. Two new options were added to xtrabackup to support
this feature:

- '--compress' tells xtrabackup to compress all output data, including
the transaction log file and meta data files, using the specified
compression algorithm. The only currently supported algorithm is
'quicklz'. The resulting files have the qpress archive format,
i.e. every *.qp file produced by xtrabackup is essentially a one-file
qpress archive and can be extracted and uncompressed by the qpress
file archiver (http://www.quicklz.com/).

- '--compress-threads' specifies the number of worker threads used by
xtrabackup for parallel data compression. This option defaults to 1.

Parallel compression ('--compress-threads') can be used together with
parallel file copying ('--parallel'). For example, '--parallel=4
--compress --compress-threads=2' will create 4 IO threads that will
read the data and pipe it to 2 compression threads.

* To support simultaneous compression and streaming, a new custom
streaming format called 'xbstream' was introduced to XtraBackup in
addition to the 'tar' format. That was required to overcome some
limitations of traditional archive formats such as 'tar', 'cpio' and
others that do not allow streaming dynamically generated files, for
example dynamically compressed files.  Other advantages of xbstream over
traditional streaming/archive formats include ability to stream multiple
files concurrently (so it is possible to use streaming in the xbstream
format together with the --parallel option) and more compact data
storage.

* To allow streaming and extracting files to/from the xbstream format
produced by xtrabackup, a new utility aptly called 'xbstream' was
added to the XtraBackup distribution. This utility has a tar-like
interface:

- with the '-x' option it extracts files from the stream read from its
standard input to the current directory unless specified otherwise
with the '-C' option.

- with the '-c' option it streams files specified on the command line
to its standard output.

The utility also tries to minimize its impact on the OS page cache by
using the appropriate posix_fadvise() calls when available.

Show diffs side-by-side

added added

removed removed

Lines of Context:
 
1
<?xml version="1.0" encoding="Windows-1252"?>
 
2
<VisualStudioProject
 
3
        ProjectType="Visual C++"
 
4
        Version="9.00"
 
5
        Name="libarchive_test"
 
6
        ProjectGUID="{407CA0B9-0CCB-4F02-A20B-CBBAEAAA2E4B}"
 
7
        RootNamespace="libarchive_test"
 
8
        Keyword="Win32Proj"
 
9
        TargetFrameworkVersion="131072"
 
10
        >
 
11
        <Platforms>
 
12
                <Platform
 
13
                        Name="Win32"
 
14
                />
 
15
        </Platforms>
 
16
        <ToolFiles>
 
17
        </ToolFiles>
 
18
        <Configurations>
 
19
                <Configuration
 
20
                        Name="Debug|Win32"
 
21
                        OutputDirectory="$(SolutionDir)$(ConfigurationName)"
 
22
                        IntermediateDirectory="$(ConfigurationName)"
 
23
                        ConfigurationType="1"
 
24
                        CharacterSet="2"
 
25
                        >
 
26
                        <Tool
 
27
                                Name="VCPreBuildEventTool"
 
28
                        />
 
29
                        <Tool
 
30
                                Name="VCCustomBuildTool"
 
31
                        />
 
32
                        <Tool
 
33
                                Name="VCXMLDataGeneratorTool"
 
34
                        />
 
35
                        <Tool
 
36
                                Name="VCWebServiceProxyGeneratorTool"
 
37
                        />
 
38
                        <Tool
 
39
                                Name="VCMIDLTool"
 
40
                        />
 
41
                        <Tool
 
42
                                Name="VCCLCompilerTool"
 
43
                                Optimization="0"
 
44
                                AdditionalIncludeDirectories="..\..\..\libarchive"
 
45
                                PreprocessorDefinitions="WIN32;_DEBUG;_CONSOLE;LIBARCHIVE_STATIC"
 
46
                                MinimalRebuild="true"
 
47
                                BasicRuntimeChecks="3"
 
48
                                RuntimeLibrary="3"
 
49
                                UsePrecompiledHeader="0"
 
50
                                WarningLevel="3"
 
51
                                Detect64BitPortabilityProblems="false"
 
52
                                DebugInformationFormat="4"
 
53
                                CompileAs="1"
 
54
                                DisableSpecificWarnings="4996"
 
55
                        />
 
56
                        <Tool
 
57
                                Name="VCManagedResourceCompilerTool"
 
58
                        />
 
59
                        <Tool
 
60
                                Name="VCResourceCompilerTool"
 
61
                        />
 
62
                        <Tool
 
63
                                Name="VCPreLinkEventTool"
 
64
                        />
 
65
                        <Tool
 
66
                                Name="VCLinkerTool"
 
67
                                ShowProgress="0"
 
68
                                OutputFile="..\..\..\$(ProjectName).exe"
 
69
                                LinkIncremental="2"
 
70
                                GenerateDebugInformation="true"
 
71
                                SubSystem="1"
 
72
                                RandomizedBaseAddress="1"
 
73
                                DataExecutionPrevention="0"
 
74
                                TargetMachine="1"
 
75
                        />
 
76
                        <Tool
 
77
                                Name="VCALinkTool"
 
78
                        />
 
79
                        <Tool
 
80
                                Name="VCManifestTool"
 
81
                                EmbedManifest="true"
 
82
                                SuppressStartupBanner="true"
 
83
                        />
 
84
                        <Tool
 
85
                                Name="VCXDCMakeTool"
 
86
                        />
 
87
                        <Tool
 
88
                                Name="VCBscMakeTool"
 
89
                        />
 
90
                        <Tool
 
91
                                Name="VCFxCopTool"
 
92
                        />
 
93
                        <Tool
 
94
                                Name="VCAppVerifierTool"
 
95
                        />
 
96
                        <Tool
 
97
                                Name="VCPostBuildEventTool"
 
98
                        />
 
99
                </Configuration>
 
100
                <Configuration
 
101
                        Name="Release|Win32"
 
102
                        OutputDirectory="$(SolutionDir)$(ConfigurationName)"
 
103
                        IntermediateDirectory="$(ConfigurationName)"
 
104
                        ConfigurationType="1"
 
105
                        CharacterSet="2"
 
106
                        WholeProgramOptimization="1"
 
107
                        >
 
108
                        <Tool
 
109
                                Name="VCPreBuildEventTool"
 
110
                        />
 
111
                        <Tool
 
112
                                Name="VCCustomBuildTool"
 
113
                        />
 
114
                        <Tool
 
115
                                Name="VCXMLDataGeneratorTool"
 
116
                        />
 
117
                        <Tool
 
118
                                Name="VCWebServiceProxyGeneratorTool"
 
119
                        />
 
120
                        <Tool
 
121
                                Name="VCMIDLTool"
 
122
                        />
 
123
                        <Tool
 
124
                                Name="VCCLCompilerTool"
 
125
                                AdditionalIncludeDirectories="..\..\..\libarchive"
 
126
                                PreprocessorDefinitions="WIN32;NDEBUG;_CONSOLE;LIBARCHIVE_STATIC"
 
127
                                RuntimeLibrary="2"
 
128
                                UsePrecompiledHeader="0"
 
129
                                WarningLevel="3"
 
130
                                Detect64BitPortabilityProblems="false"
 
131
                                DebugInformationFormat="3"
 
132
                                CompileAs="1"
 
133
                                DisableSpecificWarnings="4996"
 
134
                        />
 
135
                        <Tool
 
136
                                Name="VCManagedResourceCompilerTool"
 
137
                        />
 
138
                        <Tool
 
139
                                Name="VCResourceCompilerTool"
 
140
                        />
 
141
                        <Tool
 
142
                                Name="VCPreLinkEventTool"
 
143
                        />
 
144
                        <Tool
 
145
                                Name="VCLinkerTool"
 
146
                                OutputFile="..\..\..\$(ProjectName).exe"
 
147
                                LinkIncremental="1"
 
148
                                GenerateDebugInformation="true"
 
149
                                SubSystem="1"
 
150
                                OptimizeReferences="2"
 
151
                                EnableCOMDATFolding="2"
 
152
                                RandomizedBaseAddress="1"
 
153
                                DataExecutionPrevention="0"
 
154
                                TargetMachine="1"
 
155
                        />
 
156
                        <Tool
 
157
                                Name="VCALinkTool"
 
158
                        />
 
159
                        <Tool
 
160
                                Name="VCManifestTool"
 
161
                        />
 
162
                        <Tool
 
163
                                Name="VCXDCMakeTool"
 
164
                        />
 
165
                        <Tool
 
166
                                Name="VCBscMakeTool"
 
167
                        />
 
168
                        <Tool
 
169
                                Name="VCFxCopTool"
 
170
                        />
 
171
                        <Tool
 
172
                                Name="VCAppVerifierTool"
 
173
                        />
 
174
                        <Tool
 
175
                                Name="VCPostBuildEventTool"
 
176
                        />
 
177
                </Configuration>
 
178
        </Configurations>
 
179
        <References>
 
180
                <ProjectReference
 
181
                        ReferencedProjectIdentifier="{0C758FDB-BE1D-47E9-8E18-9168AB34A308}"
 
182
                        CopyLocal="false"
 
183
                        CopyLocalDependencies="false"
 
184
                        CopyLocalSatelliteAssemblies="false"
 
185
                        RelativePathToProject=".\libarchive.vcproj"
 
186
                />
 
187
        </References>
 
188
        <Files>
 
189
                <Filter
 
190
                        Name="Source Files"
 
191
                        Filter="cpp;c;cc;cxx;def;odl;idl;hpj;bat;asm;asmx"
 
192
                        UniqueIdentifier="{4FC737F1-C7A5-4376-A066-2A32D752A2FF}"
 
193
                        >
 
194
                        <File
 
195
                                RelativePath="..\..\..\libarchive\test\main.c"
 
196
                                >
 
197
                        </File>
 
198
                        <File
 
199
                                RelativePath="..\..\..\libarchive\test\read_open_memory.c"
 
200
                                >
 
201
                        </File>
 
202
                        <File
 
203
                                RelativePath="..\..\..\libarchive\test\test_acl_basic.c"
 
204
                                >
 
205
                        </File>
 
206
                        <File
 
207
                                RelativePath="..\..\..\libarchive\test\test_acl_freebsd.c"
 
208
                                >
 
209
                        </File>
 
210
                        <File
 
211
                                RelativePath="..\..\..\libarchive\test\test_acl_pax.c"
 
212
                                >
 
213
                        </File>
 
214
                        <File
 
215
                                RelativePath="..\..\..\libarchive\test\test_archive_api_feature.c"
 
216
                                >
 
217
                        </File>
 
218
                        <File
 
219
                                RelativePath="..\..\..\libarchive\test\test_bad_fd.c"
 
220
                                >
 
221
                        </File>
 
222
                        <File
 
223
                                RelativePath="..\..\..\libarchive\test\test_compat_bzip2.c"
 
224
                                >
 
225
                        </File>
 
226
                        <File
 
227
                                RelativePath="..\..\..\libarchive\test\test_compat_gtar.c"
 
228
                                >
 
229
                        </File>
 
230
                        <File
 
231
                                RelativePath="..\..\..\libarchive\test\test_compat_gzip.c"
 
232
                                >
 
233
                        </File>
 
234
                        <File
 
235
                                RelativePath="..\..\..\libarchive\test\test_compat_tar_hardlink.c"
 
236
                                >
 
237
                        </File>
 
238
                        <File
 
239
                                RelativePath="..\..\..\libarchive\test\test_compat_zip.c"
 
240
                                >
 
241
                        </File>
 
242
                        <File
 
243
                                RelativePath="..\..\..\libarchive\test\test_empty_write.c"
 
244
                                >
 
245
                        </File>
 
246
                        <File
 
247
                                RelativePath="..\..\..\libarchive\test\test_entry.c"
 
248
                                >
 
249
                        </File>
 
250
                        <File
 
251
                                RelativePath="..\..\..\libarchive\test\test_entry_strmode.c"
 
252
                                >
 
253
                        </File>
 
254
                        <File
 
255
                                RelativePath="..\..\..\libarchive\test\test_fuzz.c"
 
256
                                >
 
257
                        </File>
 
258
                        <File
 
259
                                RelativePath="..\..\..\libarchive\test\test_link_resolver.c"
 
260
                                >
 
261
                        </File>
 
262
                        <File
 
263
                                RelativePath="..\..\..\libarchive\test\test_pax_filename_encoding.c"
 
264
                                >
 
265
                        </File>
 
266
                        <File
 
267
                                RelativePath="..\..\..\libarchive\test\test_read_compress_program.c"
 
268
                                >
 
269
                        </File>
 
270
                        <File
 
271
                                RelativePath="..\..\..\libarchive\test\test_read_data_large.c"
 
272
                                >
 
273
                        </File>
 
274
                        <File
 
275
                                RelativePath="..\..\..\libarchive\test\test_read_disk.c"
 
276
                                >
 
277
                        </File>
 
278
                        <File
 
279
                                RelativePath="..\..\..\libarchive\test\test_read_extract.c"
 
280
                                >
 
281
                        </File>
 
282
                        <File
 
283
                                RelativePath="..\..\..\libarchive\test\test_read_format_ar.c"
 
284
                                >
 
285
                        </File>
 
286
                        <File
 
287
                                RelativePath="..\..\..\libarchive\test\test_read_format_cpio_bin.c"
 
288
                                >
 
289
                        </File>
 
290
                        <File
 
291
                                RelativePath="..\..\..\libarchive\test\test_read_format_cpio_bin_bz2.c"
 
292
                                >
 
293
                        </File>
 
294
                        <File
 
295
                                RelativePath="..\..\..\libarchive\test\test_read_format_cpio_bin_gz.c"
 
296
                                >
 
297
                        </File>
 
298
                        <File
 
299
                                RelativePath="..\..\..\libarchive\test\test_read_format_cpio_bin_Z.c"
 
300
                                >
 
301
                        </File>
 
302
                        <File
 
303
                                RelativePath="..\..\..\libarchive\test\test_read_format_cpio_odc.c"
 
304
                                >
 
305
                        </File>
 
306
                        <File
 
307
                                RelativePath="..\..\..\libarchive\test\test_read_format_cpio_svr4_gzip.c"
 
308
                                >
 
309
                        </File>
 
310
                        <File
 
311
                                RelativePath="..\..\..\libarchive\test\test_read_format_cpio_svr4c_Z.c"
 
312
                                >
 
313
                        </File>
 
314
                        <File
 
315
                                RelativePath="..\..\..\libarchive\test\test_read_format_empty.c"
 
316
                                >
 
317
                        </File>
 
318
                        <File
 
319
                                RelativePath="..\..\..\libarchive\test\test_read_format_gtar_gz.c"
 
320
                                >
 
321
                        </File>
 
322
                        <File
 
323
                                RelativePath="..\..\..\libarchive\test\test_read_format_gtar_lzma.c"
 
324
                                >
 
325
                        </File>
 
326
                        <File
 
327
                                RelativePath="..\..\..\libarchive\test\test_read_format_gtar_sparse.c"
 
328
                                >
 
329
                        </File>
 
330
                        <File
 
331
                                RelativePath="..\..\..\libarchive\test\test_read_format_iso_gz.c"
 
332
                                >
 
333
                        </File>
 
334
                        <File
 
335
                                RelativePath="..\..\..\libarchive\test\test_read_format_isorr_bz2.c"
 
336
                                >
 
337
                        </File>
 
338
                        <File
 
339
                                RelativePath="..\..\..\libarchive\test\test_read_format_mtree.c"
 
340
                                >
 
341
                        </File>
 
342
                        <File
 
343
                                RelativePath="..\..\..\libarchive\test\test_read_format_pax_bz2.c"
 
344
                                >
 
345
                        </File>
 
346
                        <File
 
347
                                RelativePath="..\..\..\libarchive\test\test_read_format_tar.c"
 
348
                                >
 
349
                        </File>
 
350
                        <File
 
351
                                RelativePath="..\..\..\libarchive\test\test_read_format_tar_empty_filename.c"
 
352
                                >
 
353
                        </File>
 
354
                        <File
 
355
                                RelativePath="..\..\..\libarchive\test\test_read_format_tbz.c"
 
356
                                >
 
357
                        </File>
 
358
                        <File
 
359
                                RelativePath="..\..\..\libarchive\test\test_read_format_tgz.c"
 
360
                                >
 
361
                        </File>
 
362
                        <File
 
363
                                RelativePath="..\..\..\libarchive\test\test_read_format_tz.c"
 
364
                                >
 
365
                        </File>
 
366
                        <File
 
367
                                RelativePath="..\..\..\libarchive\test\test_read_format_zip.c"
 
368
                                >
 
369
                        </File>
 
370
                        <File
 
371
                                RelativePath="..\..\..\libarchive\test\test_read_large.c"
 
372
                                >
 
373
                        </File>
 
374
                        <File
 
375
                                RelativePath="..\..\..\libarchive\test\test_read_pax_truncated.c"
 
376
                                >
 
377
                        </File>
 
378
                        <File
 
379
                                RelativePath="..\..\..\libarchive\test\test_read_position.c"
 
380
                                >
 
381
                        </File>
 
382
                        <File
 
383
                                RelativePath="..\..\..\libarchive\test\test_read_truncated.c"
 
384
                                >
 
385
                        </File>
 
386
                        <File
 
387
                                RelativePath="..\..\..\libarchive\test\test_tar_filenames.c"
 
388
                                >
 
389
                        </File>
 
390
                        <File
 
391
                                RelativePath="..\..\..\libarchive\test\test_tar_large.c"
 
392
                                >
 
393
                        </File>
 
394
                        <File
 
395
                                RelativePath="..\..\..\libarchive\test\test_ustar_filenames.c"
 
396
                                >
 
397
                        </File>
 
398
                        <File
 
399
                                RelativePath="..\..\..\libarchive\test\test_write_compress.c"
 
400
                                >
 
401
                        </File>
 
402
                        <File
 
403
                                RelativePath="..\..\..\libarchive\test\test_write_compress_program.c"
 
404
                                >
 
405
                        </File>
 
406
                        <File
 
407
                                RelativePath="..\..\..\libarchive\test\test_write_disk.c"
 
408
                                >
 
409
                        </File>
 
410
                        <File
 
411
                                RelativePath="..\..\..\libarchive\test\test_write_disk_hardlink.c"
 
412
                                >
 
413
                        </File>
 
414
                        <File
 
415
                                RelativePath="..\..\..\libarchive\test\test_write_disk_perms.c"
 
416
                                >
 
417
                        </File>
 
418
                        <File
 
419
                                RelativePath="..\..\..\libarchive\test\test_write_disk_secure.c"
 
420
                                >
 
421
                        </File>
 
422
                        <File
 
423
                                RelativePath="..\..\..\libarchive\test\test_write_disk_times.c"
 
424
                                >
 
425
                        </File>
 
426
                        <File
 
427
                                RelativePath="..\..\..\libarchive\test\test_write_format_ar.c"
 
428
                                >
 
429
                        </File>
 
430
                        <File
 
431
                                RelativePath="..\..\..\libarchive\test\test_write_format_cpio.c"
 
432
                                >
 
433
                        </File>
 
434
                        <File
 
435
                                RelativePath="..\..\..\libarchive\test\test_write_format_cpio_empty.c"
 
436
                                >
 
437
                        </File>
 
438
                        <File
 
439
                                RelativePath="..\..\..\libarchive\test\test_write_format_cpio_newc.c"
 
440
                                >
 
441
                        </File>
 
442
                        <File
 
443
                                RelativePath="..\..\..\libarchive\test\test_write_format_cpio_odc.c"
 
444
                                >
 
445
                        </File>
 
446
                        <File
 
447
                                RelativePath="..\..\..\libarchive\test\test_write_format_pax.c"
 
448
                                >
 
449
                        </File>
 
450
                        <File
 
451
                                RelativePath="..\..\..\libarchive\test\test_write_format_shar_empty.c"
 
452
                                >
 
453
                        </File>
 
454
                        <File
 
455
                                RelativePath="..\..\..\libarchive\test\test_write_format_tar.c"
 
456
                                >
 
457
                        </File>
 
458
                        <File
 
459
                                RelativePath="..\..\..\libarchive\test\test_write_format_tar_empty.c"
 
460
                                >
 
461
                        </File>
 
462
                        <File
 
463
                                RelativePath="..\..\..\libarchive\test\test_write_format_tar_ustar.c"
 
464
                                >
 
465
                        </File>
 
466
                        <File
 
467
                                RelativePath="..\..\..\libarchive\test\test_write_open_memory.c"
 
468
                                >
 
469
                        </File>
 
470
                </Filter>
 
471
                <Filter
 
472
                        Name="Header Files"
 
473
                        Filter="h;hpp;hxx;hm;inl;inc;xsd"
 
474
                        UniqueIdentifier="{93995380-89BD-4b04-88EB-625FBE52EBFB}"
 
475
                        >
 
476
                        <File
 
477
                                RelativePath="..\..\..\libarchive\test\list.h"
 
478
                                >
 
479
                        </File>
 
480
                        <File
 
481
                                RelativePath="..\..\..\libarchive\test\test.h"
 
482
                                >
 
483
                        </File>
 
484
                </Filter>
 
485
                <Filter
 
486
                        Name="Resource Files"
 
487
                        Filter="rc;ico;cur;bmp;dlg;rc2;rct;bin;rgs;gif;jpg;jpeg;jpe;resx;tiff;tif;png;wav"
 
488
                        UniqueIdentifier="{67DA6AB6-F800-4c08-8B7A-83BB121AAD01}"
 
489
                        >
 
490
                </Filter>
 
491
        </Files>
 
492
        <Globals>
 
493
        </Globals>
 
494
</VisualStudioProject>