WL#9499 - InnoDB: Replace MLOG_FILE_NAME with MLOG_FILE_OPEN

Fix the performance issues introduced by WL#7142 and its followup WL#7806.

1. Revert WL#7142 and WL#7806 changes, keep some of the tests to test
   the behaviour that was introduced by the two WLs
2. Change the tests that rely on the above two WLs behaviour
3. Use std::unordered_map instead of the homebrew hash table for the recovery
   code and space ID to name mapping
4. Split the redo log hash table key from <space, page> -> apply records to
   <space> -> apply records
5. Addition of two new system files (tablespaces.open.1 and tablespaces.open.2)

   - Rename MLOG_FILE_NAME to MLOG_FILE_OPEN
   - Remove the two pass recovery code, make it a single pass
   - Track file open, close and rename
   - Write and fsync the tracking state to disk on checkpoint and rename.
   Uses the files in #5 in a round robin fashion

Introduce --innodb-scan-directories="path1;...pathN". Scan the paths for
.ibd files to open during recovery. This option can be used if the files in #5
above are corrupt or missing. You should not use this if you move files around.
While they can be recovered the data dictionary will not be updated and it
will cause issues during runtimg.

rb#13686 Approved by Satya and Shaohua

commit af3dc1301a768c01b971d14ad07549d6ef470fe6
Merge: ac37b926e6a 4d81939d63a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Mar 3 11:16:10 2017 +1100

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit ac37b926e6ad85b6c4e3d7880b905d082f1674be
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Mar 2 23:12:24 2017 +1100

    WL#9499 - Fix test

commit 2b05df7ffa592da9b19cec7ba31c04795a1cdfc0
Merge: 3c79f3aee51 71b3bbff153
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Mar 2 20:34:10 2017 +1100

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 3c79f3aee51858b1859f4e8711883a85867c417a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Mar 2 18:16:35 2017 +1100

    WL#9499 - Add an mtr tst

commit 2c7496246c0e95e25c62ceb6fe5c1875f693ffac
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Mar 2 17:34:50 2017 +1100

    WL#9499 Fix bugs

    1. Fix a memory leak, call mem_heap_free() instead of mem_heap_empty()
    2. Use a reference instead of copy by value during dblwr traversing
    3. Use absolute path names for tablespace.open.* files

commit fbf87161f3c93979e5abe424fbe0678fdc32159e
Merge: 517cf3a7bf0 c2b504664ed
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Feb 28 10:39:32 2017 +0100

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 517cf3a7bf0490c3168fed020e3096ec500e0a85
Merge: 4786f93ad8a 5e974fd0ea4
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Feb 28 10:24:25 2017 +0100

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

    Additional change is to call recv_recovery_from_checkpoint_finish() on abort.
    Instead of recv_sys_free().

commit 4786f93ad8a25506a2a1f6e9d1207256a34b3665
Merge: 5dc35e05b5f 275245cce32
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Feb 24 10:43:27 2017 +0100

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 5dc35e05b5f2da95c36e191350e9c7087be72194
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Feb 24 10:42:40 2017 +0100

    WL#9499 Free recv resources on abort

commit bed693070395923ededba736f1c7102b8eb21e95
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 23 18:34:50 2017 +0100

    WL#9499 - Test cannot be run with Valgrind

commit c5d423228ddf58b17866ff8be289dba4a19205d2
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 23 17:30:39 2017 +0100

    WL#9499 - Remove const

commit ac42498506b4dffb22e74282d0ce037fe3acf977
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 23 17:00:30 2017 +0100

    WL#9499 - Clean up code

commit bc48077cab9c3ccb1b2797c365fe0940c269a785
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 23 16:01:09 2017 +0100

    WL#9499 - Revert unrelated change

commit 8b2bb0f6d6254b3cfde168d41356400009db12f4
Merge: eb9b294ba78 153a79ff35d
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 23 11:43:38 2017 +0100

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit eb9b294ba786800f9e397cd87f01c4f4976edddb
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 23 11:29:56 2017 +0100

    WL#9499 - Remove debug message

commit abae66ad591854ee67a5013f3209be2f82e4d9bf
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Feb 22 17:04:10 2017 +0100

    WL#9499 - Test only works in debug mode.

commit 71ebea70391ef295bed49ee06a8b872f15ecfe97
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Feb 22 12:18:08 2017 +0100

    WL#9499 - Update to mtr test from Matthias

commit f108a5b92fc476c70c49e4937496b32d9d5d031f
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Feb 22 12:13:04 2017 +0100

    WL#9499 - Increment redo log version number

commit 4439c83a4d3edd6e511706ccf9936770ed29e593
Merge: fa459186b90 05923bef41d
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Feb 22 09:54:18 2017 +0100

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit fa459186b90d7a5ddcba7e3c6c7a9871d0dce793
Merge: 14ac4f81d84 b401f17e70d
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Feb 21 20:02:40 2017 +0100

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 14ac4f81d84bec23a7be210504ca0be93619bf11
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Feb 21 16:44:57 2017 +0100

    WL#9499 - Update from Matthias

commit ed3191a9fc951151fd7d758a527e7ab81530b3f0
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Feb 21 15:16:11 2017 +0100

    WL#9499 - Revert change pushed by nmistake

commit 8c0edb998867bf557f6c86410552d6d123892000
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Feb 21 15:11:21 2017 +0100

    WL#9499 - Don't redo log MLOG_FILE_OPEN until startup is complete

commit 3b503ea1d3f89c0f7e3677d3b56f249c7ebff506
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Feb 21 11:37:04 2017 +0100

    WL#9499 - Add tests

commit 47af7bd6eec10eac55633d7c4cf54afe607f3649
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Feb 21 11:00:30 2017 +0100

    WL#9499 - Fix compile problem

commit a8b9a8c6ccb15e2be5ce5db5fa0bce24b86d2c87
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Feb 20 16:51:05 2017 +0100

    WL#9499 Remove dead code

commit b1dba474486ad10b61029b2ef4e6a91ea67dcea8
Merge: 3cf9e9eb3e8 a4271026201
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Feb 20 16:49:38 2017 +0100

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 3cf9e9eb3e86e4c8f4d44cb79d3f7c456ea7d671
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Feb 18 07:53:43 2017 +0530

    WL#9499 - Remove suggestion to use force recovery

    --innodb-scan-directories is a safer option for the user. Force recovery should
    be the absolute last resort.

commit 4104c4bfd606270650aac95a9a724e106fe835c5
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Feb 17 09:00:47 2017 +0530

    WL#9499 - Fix error message

    User can try --innodb-scan-directories="..." if the tablespaces.open.* files
    are corrupt or unreadable.

commit 19ab12e54923b070a0b4ffc76b9fe97ac54ad3cc
Merge: 50b3a95e446 f0f51c410bd
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Feb 17 05:22:57 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

    Replace readdir_r() with readdir(), compiler complains that readdir_r() is
    deprecated and recommends replacing it with readdir().

commit 50b3a95e446b91853fc35716b63bdc173221d01f
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 16 18:55:33 2017 +0530

    WL#9499 - Fix test

commit 45d202ae0fa35aa3aced55cc1933aeefa33837de
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 16 18:32:56 2017 +0530

    WL#9499 - Remove redundant test

commit 48fe691b97735e5144e9d439a0adbf721b2dc554
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 16 18:18:11 2017 +0530

    WL#9499 - Add DEBUG sync points

commit d986f4e04a9eb6c2c76d61cd4afe9541d77b34bd
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 16 18:03:50 2017 +0530

    WL#9499 - Remove PB2 control file

commit 5af7dca9c305bd366ad2b5c3de26a870e913af4a
Merge: 74022f50a5f 23a0e71aa3d
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Feb 15 09:05:05 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 74022f50a5ff7cb2801c0712601f8a467b409a28
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Feb 14 10:31:00 2017 +0530

    WL#9499 - Fix test

commit f6188175ee62040ac6a844a5c54787839dff6155
Merge: 24c867aab14 19ca7c6a5d3
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Feb 13 12:37:22 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 24c867aab14556188503aac495f60d89ba3d26ec
Merge: cb64b8c7f9f a4de6ab549e
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Feb 4 06:41:23 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit cb64b8c7f9fa9ca05033a9d6f6193cf141746310
Merge: 17c6c41da0a 88dbc4f4511
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Feb 3 19:48:12 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 17c6c41da0afe3fc78843b75fa02578dab29a0ca
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Feb 3 19:46:34 2017 +0530

    WL#9499 - Add a test for scan directories.

    The use case is where the location of the files is not changed but the
    tablespaces.open.* files are missing.

commit 79cc52f1bd82dc65932eacbc9aa14a47e4196572
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Feb 3 18:01:50 2017 +0530

    WL#9499 - If open fails space will be null.

commit 22ea5f31ecc1fa0db8abd57d4a46578e5f891c9a
Merge: f5b69930f95 853a52cf5a1
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Feb 3 12:14:41 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit f5b69930f95192ddfdb3ca170024a5c7e3416076
Merge: 40a4c32f2c4 b18872ed4a3
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Feb 2 13:54:24 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 40a4c32f2c42b584539a14cbc1ba0d4f0fe7d3c9
Merge: b1d1923d37c d071c0e7a0b
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Feb 1 13:48:33 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit b1d1923d37c3d23a9f701a61b458b7e4cbd3c90c
Merge: 2fc6c51edab 4ae71705a01
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Jan 31 10:44:59 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 2fc6c51edabc3de4537eceb0b82cd62063ada3a9
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Jan 30 16:36:46 2017 +0530

    WL#9499 - Empty the tablespace.open.* files on normal shutdown.

commit 738acb7d554f97455c8dba512282c7c2e6ba9f3a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Jan 30 12:47:21 2017 +0530

    WL#9499 - Fix formatting

commit 28f8579a6f729af354e0c50098d16fbfa17cc253
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Jan 30 12:25:30 2017 +0530

    WL#9499 - Bug fix

    The DELETED state was set on a copy of the data structure

commit dd5bf8ea81b7023fa1980c01d89219a690160b04
Merge: 7eeab0a994d 9c7808e1054
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Jan 27 21:14:22 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 7eeab0a994db4cf0c2e080f27ff916c778ec65f8
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Jan 27 20:50:59 2017 +0530

    WL#9499 - Add tests.

commit ddfaf047f43587ee807599b0b80b6d01a3579e8c
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Jan 27 20:48:06 2017 +0530

    WL#9499 - Create tablespace bug fix

    If there is a checkpoint after the create tablespace is logged and the
    server crashes after writing the page initialization to the redo log. Then
    we neither have the mapping in the redo log nor in the tablespace.open.*
    files. We must update the tablespace mapping before writing the CREATE
    redo log entry so that the state is written out to disk on checkpoint.

commit 29546d3ebea2991e5b86b33edddb551c924bf1db
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Jan 27 17:55:28 2017 +0530

    WL#9499 - Remove dead code from WL#7142

commit eced7a3e4437ee4bb24a12290f561437ddb15611
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Jan 27 14:51:09 2017 +0530

    WL#9499 - Use the tablespace.open.* files in a round robin fashion.

commit d8eff788eea1ad5e6c7786b9d64963524f2b2c81
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Jan 27 13:56:12 2017 +0530

    WL#9499 - Fix duplicate entry

commit 1d04e0cf0308c35ee7498e6919eab9a11c699d52
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Jan 27 13:55:30 2017 +0530

    WL#9499 - Revert last push

commit 8361d3c39366d6435a895d5b64dd23615d26fc28
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Jan 26 09:05:52 2017 +0530

    WL#9499 - Write to the tablespace.open.* files in a round robin manner.

commit 3eaba629ee5b5c26a5f4e80852fee2d446f3013f
Merge: 6642c43d735 bdc49070128
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Jan 25 14:03:15 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 6642c43d7353063a455972ab2cbc21220c16be43
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Jan 23 08:34:35 2017 +0530

    WL#9499 - Rename fil_ibd_load to fil_ibd_open_for_recovery.

commit fdd1897c79b29c9e0a69c1f81d94927da06d9424
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Jan 23 06:28:49 2017 +0530

    WL#9499 - Enforce const semantics on Windows for Folder::exists().

commit 9394f4653e10cc5d4ab9b7b0a0b9331fd2666f49
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Jan 23 06:08:26 2017 +0530

    WL#9499 - Include <array>

commit c1903d28800ae0f7af69552aa669622d552346b4
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Jan 21 07:49:28 2017 +0530

    WL#9499 - Improve scan directory handling

    1. Convert relative paths to absolute paths
    2. Filter out duplicates
    3. Check directories at filtering stage

commit dfea237f4bef914de4067153cbf382240112c4f4
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Jan 20 11:11:05 2017 +0530

    WL#9499 - Code clean up

commit c4d51bfdf1c786b1c584c0af1bde080a4f37cc5b
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Jan 20 07:37:06 2017 +0530

    WL#9499 - Update the open/rename LSN when a file is opened or renamed.

    Minor code cleanup.
    Add diagnostic code for debugging.

commit 5e1d159b571fe6dbfe13c627a245155b82c4bbfa
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Jan 18 10:59:54 2017 +0530

    WL#9499 - Filter out '*' from innodb-scan-directories

commit 361f2944f1940f11dfb16dec3589d68335f5e2d8
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Jan 17 21:01:06 2017 +0530

    WL#9499 - Code cleanup

commit 288d70b356721887423ca3d2d72b42da331216cd
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Jan 17 13:08:08 2017 +0530

    WL#9499 - Sync open file map to disk before checkpoint.

commit 3c602d1b4089cd262200650f4b33986fc9e26531
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Jan 17 09:18:46 2017 +0530

    WL#9499 - Print expected bytes instead of generic message.

commit f52e0985b8cbef3891385179d35dc8c7f567146a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Jan 17 09:07:47 2017 +0530

    WL#9499 - Print file size instead of generic message.

commit b27b1b4b4b70e286e2c669f997b0a669f6d6034c
Merge: bbdd1c46f1e c101ec9b557
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Jan 16 13:19:42 2017 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit bbdd1c46f1ef08d956ea249e1f6f4bc93d3464f1
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Dec 10 14:41:12 2016 +0530

    WL#9499 - Handle the case where the rename has already been done on recovery.

commit 141bdb02b1a402e786db5d8b165b781a5d7370a3
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Dec 9 11:59:29 2016 +0530

    WL#9499 - Instrumentation for debugging

commit 34815bb24a1c296d9739e7602dc6ccd53c58c44c
Merge: 41ca3732a6f 13a46b4c5ea
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Dec 9 09:44:03 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 41ca3732a6ffd8dfa16762a05df6b5c6b4b550c1
Merge: 7137edb2d2c aba34f1205d
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Dec 8 11:10:08 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 7137edb2d2ca60cdec44600ddf3f5cbde424e7a4
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Dec 8 05:56:06 2016 +0530

    WL#9499 - Remove unused code. Move id to name mapping sync before log flush.

commit 2a50067e2da2f7819781de6550e55ca14995c7ff
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Dec 7 12:57:41 2016 +0530

    WL#9499 - Initialize the PFS file handle

commit d478d3492cdb40ec02fda9c043bf29b87bae11ed
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Dec 7 12:05:52 2016 +0530

    WL#9499 - Fix whitespace

commit 061af748a5e2fde6c1577ccdabfc8a89a9f753de
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Dec 7 12:02:25 2016 +0530

    WL#9499 - Set must flush on file close/delete.

commit ad76e2b9c7ff757f60c66821e86696d5ab757b18
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Dec 7 11:43:00 2016 +0530

    WL#9499 - Code cleanup

commit 5a95946d4567dc13cf5a12d6bcdb28b19a02b5bc
Merge: 1a0f373eb7f da23d6b8e44
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Dec 7 09:27:45 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 1a0f373eb7f03dc22264f91f3f6ed1fd13825de7
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Dec 6 13:01:41 2016 +0530

    WL#9499 - Readd test result file back

commit 00afde093183cf850f735940245af111dce82b72
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Dec 6 12:59:49 2016 +0530

    WL#9499 - Don't purge the files based on LWM. It won't work.

    We need to also ensure that there aren't any pages in the buffer pool that
    belong to a tablespace that is closed. Redo log records can be written for
    such pages.

commit 3199fe255103daa42f0332b7ff9d565eefff7429
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Nov 29 06:41:39 2016 +0530

    WL#9499 - Fix typo

commit 351cb6c42709405a79021276f310d7b996aadd1b
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Nov 29 06:32:02 2016 +0530

    WL#9499 - Remove unused function

commit 61cc7f6b06c5280d58217b76d7627013ddcd8338
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Nov 29 04:22:31 2016 +0530

    WL#9499 - Reduce the compression level.

commit 48142e360ff5cfb53d5e416f3d6b92e956237923
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Nov 29 04:21:51 2016 +0530

    WL#9499 - Code cleanup

commit 4de4f8b31ebdff31a2f7a97a1ad211770d20cdd6
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Nov 28 14:07:07 2016 +0530

    WL#9499 - Revert ef30f0754ab22e614ac22712c348ec5f53e0f09c

commit c2f77f44c43c209fad86bba568aa521a2dcbf718
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Nov 28 12:20:37 2016 +0530

    WL#9499 - Code clean up

commit 5fccb51769a13cb9a1fc0f29a832d3b0085ad52a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Nov 28 10:30:18 2016 +0530

    WL#9499 - Print a message when checkpoint is disabled.

commit ef30f0754ab22e614ac22712c348ec5f53e0f09c
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Nov 28 10:17:27 2016 +0530

    WL#9499 - Print progress in 10% units.

commit bc0ded332624fa2c8a08ebfc955a03f1a24e069c
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Nov 28 08:13:54 2016 +0530

    WL#9499 - Code clean up

commit 68ce0208cc073452f5f791faf304971dbac7194a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Nov 28 07:38:03 2016 +0530

    WL#9499 - Scan directories after the mutex code is initialized.

commit 21e07c8fd6b8eddf158fb79980443f6c9f6d238e
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Nov 28 07:12:23 2016 +0530

    WL#9499 - Introduce --innodb-checkpoint-disabled (debug)

    Disable checkpointing if the variable is set. This is to force recovery if the
    server is killed during a test.

commit 7033c9bb5ff7641764f70823a73d747b497a0eed
Merge: 11a6e582417 c6af7f512b6
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Nov 28 04:00:39 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 11a6e582417d45a80a7f19233c2d2191a17936eb
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Nov 28 03:59:05 2016 +0530

    WL#9499 - Code cleanup

commit 0a38252e65d607b59b1e9f64d0c8003cdecfecfd
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Nov 25 05:56:42 2016 +0530

    WL#9499 - Code clean up

commit bcf650cc92b8636f3768dcc3deb33b90b2942134
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Nov 24 08:46:07 2016 +0530

    WL#9499 - Change the open files number back to 2.

commit 99960af2825529fb45d021a34ba6c072e8caa0dc
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Nov 24 07:13:58 2016 +0530

    WL#9499 - Code clean up

commit bdb91bc0ba03e01661c50c7175d3fd123d2bcd69
Merge: 61f3e4a5663 a545bdd6e31
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Nov 23 14:04:40 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 61f3e4a5663c375cd44ee766b263281ff7f0601b
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Nov 23 14:00:20 2016 +0530

    WL#9499 - Code clean up

commit 072ab837d0acb4d2ed817110598554acc44ec344
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Nov 23 12:06:53 2016 +0530

    WL#9499 - Set the IMPORT page LSN to the flushed to disk LSN

commit 7f18661432f3645eb9ce76680c62508ced115fa9
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Nov 23 11:28:47 2016 +0530

    WL#9499 - Force a checkpoint before the crash

commit 83671e9c37fa61adfa5546cabe1463a91ff02241
Merge: cc26d5ae16e d1f811eb6e8
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Nov 23 10:52:16 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit cc26d5ae16e8d723a2519f38bfbc084c13a766c1
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Nov 4 18:40:51 2016 +0530

    WL#9499 - Fix latch ordering issue

    Cannot hold the log sys mutex when updating the checkpoint LSN for the open
    files in fil0fil.cc.

commit 4474509addfbdf91b9f0ad890a971299c594e738
Merge: 396755e195c 0856b10cde5
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Nov 4 08:00:05 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 396755e195c1c8d3b2485a58175dcf56ca2cbf3f
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Nov 4 07:58:05 2016 +0530

    WL#9499 - Remove newline added earlier

commit ab5e60ba491e52f1529c22551a936d771b8b5ef9
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Nov 4 07:57:21 2016 +0530

    WL#9499 - Revert a change that was added by mistake.

commit 38688417713e5ef8cbb65032fa0a547ab0c25c15
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Nov 3 20:44:50 2016 +0530

    WL#9499 - Bug fix, using an invalidated iterator.

commit 4082d44f6dc4a5605562e37ccad9ac4db69344c6
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Nov 3 11:30:49 2016 +0530

    WL#9499 - Fix doxygen comment

commit d5ca99e14c010a5349aea6c8cc39493b2073b9c1
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Nov 2 15:30:12 2016 +0530

    WL#9499 - Code cleanup

commit a25f3af10ea2893c634dc961d6f2af05efa103ec
Merge: c8c2a7eba4c aa039b73223
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Nov 2 12:52:51 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit c8c2a7eba4cac29ff431588daf2d6def0c0ee5a6
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Nov 2 12:39:32 2016 +0530

    WL#9499 - Fix problem with open files acrosss checkpoints.

    The problem is that we write the open file state before writing the checkpoint.
    Before this change the closed files were purged from the open state map and
    the state written to disk. The problem is that the state and mapping of a file
    opened before the last checkpoint but closed just before we write the state
    will not be in the mapping on disk. One solution is to check older files and
    retrieve the mapping from there. The solution chosen is to avoid purging
    files based on open LSN. If the file was opened before the last checkpoint
    and closed within the current checkpoint we note the state as CLOSED but
    write the mapping to disk. It will be purged at the next checkpoint, if it is
    not opened again in the meantime.

    Previously an attempt was made to open all files straight after reading the
    mapping from disk. With this change only the state is loaded into memory the
    files are opened on demand. Added a check to verify that the tablespace ID
    from the first page matches the expected value.

    Fixed tests to use this new tablespace ID verification.

commit 5dc929e54b1c259f0f8104739ae1f88e9b860f73
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Oct 25 12:24:40 2016 +0530

    WL#9499 - Remove unused code

commit 528b95d70dcc05a69a98ee2a76fdfb8dae1e82fe
Merge: d9861c40964 75f05cba753
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Oct 25 10:14:40 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit d9861c40964ad8fd45ee2cbbd9d94946110e8a9a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Oct 25 10:04:49 2016 +0530

    WL#9499 - Remove last vestiges of MLOG_CHECKPOINT

commit 3007ea5af68f40b85bc93098d8385ac96bcbd660
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Oct 25 10:04:49 2016 +0530

    WL#9499 - Remove last vestiges of MLOG_CHECKPOINT

commit 9592996d2f17c9005262faa75dc1ade9dedbd511
Merge: da512d5591b ac925fc91f6
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Oct 19 10:34:48 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit da512d5591b3379b793d6155089e90791fe94c61
Merge: f42e2ddd7d5 e635dfe28c0
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Sep 30 05:20:10 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit f42e2ddd7d50aacae679babe71643af379b5c492
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 22 15:05:28 2016 +0530

    WL#9499 - Fix assertion, the values can be ORred.

commit 94cd08960bc3801acefd4b4ff4ddb4a3e7d7e81a
Merge: 32a68f91330 59af373321b
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 22 11:05:21 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 32a68f9133011871bfdaba3c742f6239e0a53061
Merge: 7857f38ebce 15555ae2165
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Sep 21 11:23:32 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 7857f38ebce747135e055bc8a232b649f1aad351
Merge: 427491f63f1 b43bf88cf80
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Sep 19 11:43:17 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 427491f63f107247c36796e66f6224d20968f104
Merge: e7fa4c53dcf 23343687722
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Sep 14 22:40:47 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit e7fa4c53dcf01ea0e101bd8aa817698492995034
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Sep 12 19:22:00 2016 +0530

    WL#9499 - max_lsn should work with any number of tablespace open files.

commit 09775960da43d36ca64504c1298b9adff3056575
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Sep 12 17:47:29 2016 +0530

    WL#9499 - Fix Names hash bug.

commit 8430c5b34d23cb1774597707fe583dfac93fb3a8
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Sep 12 09:49:47 2016 +0530

    WL#9499 - Use std::unordered_map for name to fil_space_t* hash.

commit 5e8275caf9d50dc9ba2f2dadd3b8c0fdeb9c79b6
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Sep 10 07:55:42 2016 +0530

    WL#9499 - Reduce an extra fil_sys_t::mutex call by consolidating flush request.

commit b29fd1039cf0022cff36a2a2311f464f1f6dbcc5
Merge: 6235ee4902a a150caebee6
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Sep 9 20:44:56 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 6235ee4902addd1a041b33469988bb1ea870dc7a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 8 10:58:00 2016 +0530

    WL#9499 - Add debug crash points.

commit bf71fbc72b3570f55c8f01dd1a440e9eff761cb6
Merge: ce6d2246a94 d25f38e38d3
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 8 09:47:37 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit ce6d2246a94801041da0bfece74b5ffdd9e8f796
Merge: 69adae163de f28c4b9a41e
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Sep 7 11:20:50 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 69adae163de295ef0e910752cf5f8c96b1c1114f
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 1 22:33:29 2016 +0530

    WL#9499 - Ensure that the MLOG_FILE_OPEN is always written first to the redo

commit 20d5b1ebe6c899e2a0a1d135ad4303490516ce26
Merge: 2d7d25c145f 4f1fb936211
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 1 22:17:58 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 2d7d25c145fae59af744e91fce47fe009c869dad
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 1 10:06:56 2016 +0530

    WL#9499 - Add PFS instrumentation for the tablespace open file.

commit 4e14a53ad129c1adcb0a3330931878a9f24c15cc
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 1 08:53:57 2016 +0530

    WL#9499 - Code cleanup

commit a465361e74136662471d2b9c0f307799efbe7269
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 1 08:17:43 2016 +0530

    WL#9499 - Move the file write code to a separate method.

commit 7a26ba28bf7bf94808c47cfcdb6210c4abde2587
Merge: f49914e5e61 ed389829067
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Sep 1 07:55:25 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit f49914e5e61b846c45f7b177308cd891918619e4
Merge: a4fab040243 16fd507b84a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 31 11:23:42 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit a4fab040243a57fb8ef55f91812604352d8b92c8
Merge: 93019973329 dfee02dc4f5
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 30 10:42:20 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 9301997332923921b93de4946c4824164723050c
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 30 09:09:05 2016 +0530

    WL#9499 - OSX/Solaris compilers don't like the code.

commit 54afa110837a054de24ccda84ddbb4ef2d0b96a1
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 29 22:55:19 2016 +0530

    WL#9499 - During recovery PFS instrumentation can't be accessed by the user.

commit fa5c11e8cf0fbcd1852535faa74b1a04200df2e8
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 29 11:15:07 2016 +0530

    WL#9499 - Fil_Open::purge() can be called during recovery too

commit d8672a978d62db42f1a12ba152693a3c0d244d83
Merge: d4251d0ed6f 14d2a977ce8
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 29 11:10:32 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit d4251d0ed6f9df5a3acbf97ce7ba8074f126044c
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 29 11:07:14 2016 +0530

    WL#9499 - Remove a WL#7806 test.

    The test doesn't really help. It uses very simplistic checks for matching
    path names. It ignores links (soft and hard) completely. Besides during
    recovery the path names will work with the original path names.

commit fba6656350d0a757b2cc936b017329e7f7ce2d32
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 26 09:51:53 2016 +0530

    WL#9499 - Code cleanup

commit b522d665d10dca905420cb9119692dffac5024c9
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 26 09:20:30 2016 +0530

    WL#9499 - Code cleanup

commit 3a9aca50a2e193398d626b5f75d238b5aa704e81
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 26 09:19:39 2016 +0530

    WL#9499 - Code cleanup

commit 5923cd73fc3af904220dea20b033ffcbb7892606
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 26 09:12:44 2016 +0530

    WL#9499 - Use custom allocators.

commit 8c5acab2641cedae9542b9ad9405032abbcb4618
Merge: 1509c43fcff 3c1319b9901
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 26 08:21:28 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 1509c43fcffb9a849542ef8f3a62e66fda490fc7
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 26 08:08:34 2016 +0530

    WL#9499 - Fix bug, should be decrement in_use, not increment.

commit 0ad783d5e6e3f99817c8b839fe8521f783577d35
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 26 07:58:49 2016 +0530

    WL#9499 - Change fil_node_t::in_use into a reference counter from bool.

commit 3974f1ed40bfbadcee04fa5fc2e60a50b89f930c
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 22:10:24 2016 +0530

    WL#9499 - Remove an assertion that is no longer an invariant.

commit d79f12dec7c07698f02ce2e0d0396bcd01bdc683
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 21:52:21 2016 +0530

    WL#9499 - Rename fil_node_t::being_extended to in_use. Fix test.

commit 1d3368bcf60e2e339d5917251b51201b94dd63a3
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 10:57:38 2016 +0530

    WL#9499 - Fix log info messages during recovery/apply.

commit d3811bd67248d3ae014f0e6475b1b49524f5c35b
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 10:40:01 2016 +0530

    WL#9499 - Don't print % processed if number of records to apply is small.

commit 55af670ff81170da51fbcae6832c3d6191176602
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 10:21:31 2016 +0530

    WL#9499 - Update test with new log message to check.

commit 60c3d6c074ae230ab594015ed2f99e2eefcf97e0
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 10:09:04 2016 +0530

    WL#9499 - Record test, because of new config parameter innodb_scan_directories.

commit bd79ff06406c86758a29a28dbe5e7d494a0aa51f
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 10:05:38 2016 +0530

    WL#9499 - Remove WL#7142 artefact.

commit bcb753b72b2a01ba35d952cbab45e420929f2b33
Merge: e30834ecc60 27d64e974ec
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 09:26:25 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit e30834ecc60522fca8d7b156a66c0765867dea6e
Author: Sunny Bains <Sunny.Bains@Oracle.Com>
Date:   Thu Aug 25 05:54:26 2016 +0200

    WL#9499 - Destroy the mutex in the Fil_Open destructor.

commit a396d4714bdc46626e07d22b6871be153b627bd3
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 09:17:06 2016 +0530

    WL#9499 - Code cleanup

commit 282ad76aaeaeb6d91bbf81fcd3315f455d9f572c
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 09:12:33 2016 +0530

    WL#9499 - Protect changes to Fil_Open state with a mutex.

commit d338cb9468c126ee7e3eeae3bf37b0fc966bbf53
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 07:37:49 2016 +0530

    WL#9499 - Fix division by zero.

commit 845324f19ba0a84538b87c072f6d99514533aa25
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 00:28:45 2016 +0530

    WL#9499 - Check for UNDO tablespace names during directory scan.

commit 30ed1d19389e174605fdfc0b7d55fdf544933712
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 25 00:26:08 2016 +0530

    WL#9499 - Conform to new naming guidelines.

commit 4cf67b352d4c8131064f832ec884db6166d50e71
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 24 22:04:43 2016 +0530

    WL#9499 - Add test for the configuration variable. Add a version number to the file.

commit ad9c5bca0eba1d7bf8e29cd8ebd7062aae089f90
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 24 21:01:56 2016 +0530

    WL#9499 - Code clean up

commit a9e848158909645ead86759ed7ab64789d18a0cb
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 24 15:26:02 2016 +0530

    WL#9499 - Print redo apply progress per tablespace

commit 8cf86cf1567cabc1b03b2e8f2ec1167f3c38ce6c
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 24 13:04:55 2016 +0530

    WL#9499 - Print tablespace name and % completed per tablespace

commit 35ccdf32d1d048400012a80422072fb41ceb1bbd
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 24 10:35:26 2016 +0530

    WL#9499 - Code cleanup

commit c978fb2e18a4e0b4a93b44fc3c75234bcdb3f1f0
Merge: 8bde4aeb01c 0832bf660e3
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 23 22:25:57 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 8bde4aeb01c3bcdecfb884e566f0ae28797a5b36
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 23 13:21:10 2016 +0530

    WL#9499 - Fix Windows build issue

commit 7f502be746cbe0de1a0c3a992217691b167c2fa9
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 23 12:12:08 2016 +0530

    WL#9499 - Fix Windows build issue

commit 247bcfda6744a67cc4e53d61658ca87d206b0660
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 23 10:57:44 2016 +0530

    WL#9499 - Code cleanup

commit 04509641b086a1b0b2c591573f95957f8a2f1cd0
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 23 10:50:55 2016 +0530

    WL#9499 - Pass the filename directly to the callback

commit 3efa317825886a3ae5d4a3c771fc0770a2c5a3ff
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 23 09:39:18 2016 +0530

    WL#9499 - Include tchar.h on Windows

commit 55b814d2c2ebdea7c16a6d87a7251ca3f6e83775
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 23 07:47:39 2016 +0530

    WL#9499 - Code cleanup

commit e4d203688273b562691c912cb9c7024709757490
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 22 22:02:02 2016 +0530

    WL#9499 - Code cleanup

commit 31433b21dcabba0a7705eb8b1879beb1d8c36517
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 22 21:37:41 2016 +0530

    WL#9499 - Move Dir_Walker::walk implementation to os0file.cc

commit 11f9016477274c5420782e365b26762067e7b99b
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 22 18:42:28 2016 +0530

    WL#9499 - Fix Windows version of Dir_Walk.

commit f32b88e0b1ef99f220165897db745b1dba12f86b
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 22 13:48:03 2016 +0530

    WL#9499 - Code cleanup

commit b91ad88d96942f1e05443001b7d1c2f6818ff6d3
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sun Aug 21 14:32:25 2016 +0530

    WL#9499 - Initialize active ID to filename set from scanned set.

commit 4a09f677ae7095aac9b07f7beccba8e60c50b065
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sun Aug 21 13:09:05 2016 +0530

    WL#9499 Scan specified directories to build the ID to name mapping.

commit c13b791497e322e6a5cf64ba85da52ee2cf05d45
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sun Aug 21 10:46:53 2016 +0530

    WL#9499 - Fix check for incomplete read.

commit 8a849e0288309cec7228612a62fc2bfd71b595e9
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sun Aug 21 10:45:04 2016 +0530

    WL#9499 - Fix Windows build errors

commit 4fc24b654da26e8411fc45bc96f73ff70dc73e43
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sun Aug 21 09:12:12 2016 +0530

    WL#9499 - Need to include string for Windows std::wstring.

commit bcb5c2b23f54776e0faaafba2472bb2555aee561
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sun Aug 21 09:02:59 2016 +0530

    WL#9499 - On POSIX fopen() mode should be "w+b".

commit b3c7def1931867633d9b8bb601317e99a06c31a9
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Aug 20 21:23:57 2016 +0530

    WL#9499 - Open file in binary mode for writing.

    Otherwise on Windows newline (0x0A) is translated to CRLF (0x0D0A).

commit 0739399cb8a384c07b4b3540b73ade482d083f4a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Aug 20 20:27:11 2016 +0530

    WL#9499 - More error messages during mapping file read. Add a directory walker.

commit 1322de0af2235bc94630f7cb22e4ead1588775ee
Merge: f266b100e2f 8fdbb2f5f1a
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Aug 20 13:47:39 2016 +0530

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit f266b100e2f23e775e5e04de8d26301d7f2f1072
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Aug 20 13:18:07 2016 +0530

    WL#9499 - Flush the tablespace to mapping file buffers before fsync()

commit 7c92536686033c2c70e7df831d569c1cd6f871f0
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 19 20:32:26 2016 +0530

    WL#9499 - Remove unused member variable m_lsn.

commit 994c4766ef712e7da668788d0bdd648cbd764982
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 19 20:25:05 2016 +0530

    WL#9499 - Don't crash on uncompress failure. Try the next file if any.

commit a419a190cdf734e3beca08d339c6c0d307ddff5f
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 19 20:21:49 2016 +0530

    WL#9499 - Print an error code on uncopress failure

commit 77cb39000e098ba4d06873723423521e6889a7d0
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 19 20:12:11 2016 +0530

    WL#9499 - Code cleanup

commit afc632e0ef768542a96d4d15a897cb1780825d2e
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 19 11:34:44 2016 +0530

    WL#9499 - Compress the tablespace open state file.

commit 568c9e758084f671007789f7b5d1c996f5df39a0
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 19 09:12:39 2016 +0530

    WL#9499 - Free the buffer on return

commit 0f468cf8e50b9605a9e6c4e93c818b0f876c3c29
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Fri Aug 19 08:42:38 2016 +0530

    WL#9499 - Remove protobuf

commit e789eb175d2da90cee2d46e30b91e623546f9e96
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Thu Aug 18 09:59:37 2016 +0530

    WL#9499 - Get native HANDLE

commit 6014c5853c09fee75256f9de6a86a5fc0ea18508
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 17 14:50:37 2016 +0530

    WL#9499 - Use _fileno() on Windows

commit 61e6b4d7c033d48b775b22c4ad6d6b4858cd4cd7
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 17 14:37:01 2016 +0530

    WL#9499 - Use buffered IO for open state file writes

commit 98f40b10c15e49d9a5e14689cdb34758bdf85a05
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 17 12:36:06 2016 +0530

    WL#9499 - Don't complain about corrupted encrypted pages during dblwr recovery

commit c674939cbdeaa4a9996960de0fa4e74954ad6f76
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 17 09:21:06 2016 +0530

    WL#9499 - Protobuf internal code doesn't compile on Solaris/SPARC.

    Workaround is to set -Wno-unused-but-set-parameter for generated sources too.

commit ff68ba26aeaa27070ceeaa8db4472a9ce4daa3c9
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Wed Aug 17 08:33:03 2016 +0530

    WL#9499 - Protobuf internal code doesn't compile on Solaris/SPARC.

    Workaround is to set -Wno-unused-but-set-parameter for fil/fil0fil.cc

commit 445985ca11810c528567a4222cad4a7f0ce49e81
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 16 19:44:29 2016 +0530

    WL#9499 - Read/Write open state files using absolute paths

commit b4d91d3799d94eb2677be6512752ec27dfa5e0f1
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 16 14:37:40 2016 +0530

    WL#9499 - Fix doxygen errors

commit 8be2de3b3077c0d0f26340c9c80f7ae2247eefbc
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 16 11:20:24 2016 +0530

    WL#9499 - Record test, MLOG_FILE_NAME doesn't exist anymore

commit 54e64dc4a97f5bf4b5606cea1841dfc1f04fe536
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Tue Aug 16 10:41:01 2016 +0530

    WL#9499 - Add protobuf library to the embedded library.

commit 83b0fb38283e285e1e963dd2c7c144d70b130338
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 15 21:17:13 2016 +0530

    WL#9499 - Improved DBLWR and System table checks and code cleanup

    1. Remove dead code
    2. If some pages from the dblwr buffer were not recovered during recovery
       because of a missing tablespace id -> name mapping. Check the tablespace
       ID against the Tablespaces meta-data after recovery.
    3. Track open of the system tablespace. Check if the name of any file
       has changed. We don't rename the system tablespace.

commit 5ebfba1e083f6a1d2b70946b91a02d32733c7e87
Merge: 7a1b724c04b 0c27bf6fc44
Author: Sunny Bains <Sunny.Bains@Oracle.Com>
Date:   Mon Aug 15 11:40:07 2016 +0200

    Merge branch 'mysql-trunk' into mysql-trunk-wl9499

commit 7a1b724c04bf9d2e4aba0e58fb95dc8fc75d55c1
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 15 15:07:47 2016 +0530

    WL#9499 - Free deferred page memory

commit 4de5d3b03670e4d2e8ebce89e8b3f104968eb3e1
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 15 11:45:25 2016 +0530

    WL#9499 - Remove unrelated changes

commit c9e83914232480501b139c36ef616798a2ac1d05
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Mon Aug 15 11:28:19 2016 +0530

    WL#9499 - Code clean up

commit 6ecdb21d63ef6dd5a6aff997720178ff6510f0d5
Author: Sunny Bains <Sunny.Bains@oracle.com>
Date:   Sat Aug 13 14:31:52 2016 +0530

    WL#9499 - Don't exit if no open state files found