{"id":4393,"date":"2020-12-27T14:51:56","date_gmt":"2020-12-27T01:51:56","guid":{"rendered":"http:\/\/www.zoyinc.com\/?p=4393"},"modified":"2024-01-04T14:59:47","modified_gmt":"2024-01-04T01:59:47","slug":"omv-fix-accidentally-split-mirror-raid","status":"publish","type":"post","link":"http:\/\/www.zoyinc.com\/?p=4393","title":{"rendered":"OMV fix accidentally split mirror RAID"},"content":{"rendered":"\n

I had setup a mirrored RAID in OMV and then the PC hardware, not the disks I should emphasize, failed and I needed to move the system disk and two data disks to other hardware.<\/p>\n\n\n\n

Because I decided to test each disk separately this broke the mirror and in OMV I now saw:<\/p>\n\n\n\n

<\/div>\n\n\n\n
\"\"<\/figure>\n\n\n\n

Work off line<\/h2>\n\n\n\n

I was really keen to keep the two disks in the same state and not have them accidentially updated by other servers on my network. So for the entire time for this exercise I kept the OMV server and my desktop completely off the lan with a static IP set on my PC. I would strongly suggest you think of something similar.<\/p>\n\n\n\n

Work off line<\/h2>\n\n\n\n

At this point I had a spare blank disk around and so took out one of the drives from the array, put the new one in, did a “Recover” in OMV and rebuilt the array, when the array was built I took the spare disk out. The point was if everything went to custard I could use the spare disk, which I had now turned into a disk from the mirror, to rebuild the array from scratch as it were.<\/p>\n\n\n\n

If I login to OMV using ssh then if I run:<\/p>\n\n\n\n

<\/path><\/path><\/svg><\/span>
ARRAY <\/span>\/dev\/md\/Mirror<\/span> <\/span>metadata=<\/span>1.2<\/span> <\/span>name=nas1:Mirror<\/span> <\/span>UUID=391fb756:204b7361:f368c71b:fb4eea09<\/span><\/span>\nARRAY <\/span>\/dev\/md\/Mirror<\/span> <\/span>metadata=<\/span>1.2<\/span> <\/span>name=nas1:Mirror<\/span> <\/span>UUID=391fb756:204b7361:f368c71b:fb4eea09<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
As you can see the two listed arrays are identical.<\/p>\n\n\n\n
From the earlier screen shots you can see it thinks there are now two arrays md126 and md127. I can query each of these:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm <\/span>--detail<\/span> <\/span>\/dev\/md126<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
Gives<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
\/dev\/md126:<\/span><\/span>\n         Version <\/span>:<\/span> <\/span>1.2<\/span><\/span>\n   Creation <\/span>Time<\/span> <\/span>:<\/span> <\/span>Thu<\/span> <\/span>Nov<\/span> <\/span>10<\/span> <\/span>19<\/span>:<\/span>41<\/span>:<\/span>47<\/span> <\/span>2016<\/span><\/span>\n      Raid <\/span>Level<\/span> <\/span>:<\/span> <\/span>raid1<\/span><\/span>\n      Array <\/span>Size<\/span> <\/span>:<\/span> <\/span>2930135488<\/span> (2794.40 <\/span>GiB<\/span> <\/span>3000.46<\/span> <\/span>GB<\/span>)<\/span><\/span>\n   Used <\/span>Dev<\/span> <\/span>Size<\/span> <\/span>:<\/span> <\/span>2930135488<\/span> (2794.40 <\/span>GiB<\/span> <\/span>3000.46<\/span> <\/span>GB<\/span>)<\/span><\/span>\n    Raid <\/span>Devices<\/span> <\/span>:<\/span> <\/span>2<\/span><\/span>\n   Total <\/span>Devices<\/span> <\/span>:<\/span> <\/span>1<\/span><\/span>\n     Persistence <\/span>:<\/span> <\/span>Superblock<\/span> <\/span>is<\/span> <\/span>persistent<\/span><\/span>\n   Intent <\/span>Bitmap<\/span> <\/span>:<\/span> <\/span>Internal<\/span><\/span>\n     Update <\/span>Time<\/span> <\/span>:<\/span> <\/span>Wed<\/span> <\/span>Dec<\/span> <\/span>23<\/span> <\/span>09<\/span>:<\/span>37<\/span>:<\/span>53<\/span> <\/span>2020<\/span>       <\/span>State<\/span> <\/span>:<\/span> <\/span>active,<\/span> <\/span>degraded<\/span><\/span>\n  Active <\/span>Devices<\/span> <\/span>:<\/span> <\/span>1<\/span><\/span>\n Working <\/span>Devices<\/span> <\/span>:<\/span> <\/span>1<\/span><\/span>\n  Failed <\/span>Devices<\/span> <\/span>:<\/span> <\/span>0<\/span><\/span>\n   Spare <\/span>Devices<\/span> <\/span>:<\/span> <\/span>0<\/span><\/span>\n        Name <\/span>:<\/span> <\/span>nas1:Mirror<\/span>  (local <\/span>to<\/span> <\/span>host<\/span> <\/span>nas1<\/span>)<\/span><\/span>\n        UUID <\/span>:<\/span> <\/span>391fb756:204b7361:f368c71b:fb4eea09<\/span><\/span>\n      Events <\/span>:<\/span> <\/span>940496<\/span><\/span>\n <\/span><\/span>\nNumber   <\/span>Major<\/span>   <\/span>Minor<\/span>   <\/span>RaidDevice<\/span> <\/span>State<\/span><\/span>\n    2       <\/span>8<\/span>       <\/span>32<\/span>        <\/span>0<\/span>      <\/span>active<\/span> <\/span>sync<\/span>   <\/span>\/dev\/sdc<\/span><\/span>\n    1       <\/span>0<\/span>        <\/span>0<\/span>        <\/span>1<\/span>      <\/span>removed<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
Then if I run:<\/p>\n\n\n\n
Then if I run:<\/pre>\n\n\n\n
I get:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
\/dev\/md127:<\/span><\/span>\n         Version <\/span>:<\/span> <\/span>1.2<\/span><\/span>\n   Creation <\/span>Time<\/span> <\/span>:<\/span> <\/span>Thu<\/span> <\/span>Nov<\/span> <\/span>10<\/span> <\/span>19<\/span>:<\/span>41<\/span>:<\/span>47<\/span> <\/span>2016<\/span><\/span>\n      Raid <\/span>Level<\/span> <\/span>:<\/span> <\/span>raid1<\/span><\/span>\n      Array <\/span>Size<\/span> <\/span>:<\/span> <\/span>2930135488<\/span> (2794.40 <\/span>GiB<\/span> <\/span>3000.46<\/span> <\/span>GB<\/span>)<\/span><\/span>\n   Used <\/span>Dev<\/span> <\/span>Size<\/span> <\/span>:<\/span> <\/span>2930135488<\/span> (2794.40 <\/span>GiB<\/span> <\/span>3000.46<\/span> <\/span>GB<\/span>)<\/span><\/span>\n    Raid <\/span>Devices<\/span> <\/span>:<\/span> <\/span>2<\/span><\/span>\n   Total <\/span>Devices<\/span> <\/span>:<\/span> <\/span>1<\/span><\/span>\n     Persistence <\/span>:<\/span> <\/span>Superblock<\/span> <\/span>is<\/span> <\/span>persistent<\/span><\/span>\n Intent <\/span>Bitmap<\/span> <\/span>:<\/span> <\/span>Internal<\/span><\/span>\n <code>Update <\/span>Time<\/span> <\/span>:<\/span> <\/span>Wed<\/span> <\/span>Dec<\/span> <\/span>23<\/span> <\/span>09<\/span>:<\/span>59<\/span>:<\/span>36<\/span> <\/span>2020<\/span>       <\/span>State<\/span> <\/span>:<\/span> <\/span>active,<\/span> <\/span>degraded<\/span><<\/span>\/cod<\/span>e><\/span><\/span>\n Active <\/span>Devices<\/span> <\/span>:<\/span> <\/span>1<\/span><\/span>\n Working <\/span>Devices<\/span> <\/span>:<\/span> <\/span>1<\/span><\/span>\n  Failed <\/span>Devices<\/span> <\/span>:<\/span> <\/span>0<\/span><\/span>\n   Spare <\/span>Devices<\/span> <\/span>:<\/span> <\/span>0<\/span><\/span>\n <code>       <\/span>Name<\/span> <\/span>:<\/span> <\/span>nas1:Mirror<\/span>  (local <\/span>to<\/span> <\/span>host<\/span> <\/span>nas1<\/span>)        <\/span>UUID<\/span> <\/span>:<\/span> <\/span>391fb756:204b7361:f368c71b:fb4eea09<\/span>      <\/span>Events<\/span> <\/span>:<\/span> <\/span>942450<\/span> <\/span>Number<\/span>   <\/span>Major<\/span>   <\/span>Minor<\/span>   <\/span>RaidDevice<\/span> <\/span>State<\/span>    <\/span>0<\/span>       <\/span>0<\/span>        <\/span>0<\/span>        <\/span>0<\/span>      <\/span>removed<\/span>    <\/span>3<\/span>       <\/span>8<\/span>       <\/span>16<\/span>        <\/span>1<\/span>      <\/span>active<\/span> <\/span>sync<\/span>   <\/span>\/dev\/sdb<\/span><<\/span>\/cod<\/span>e><\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
So nearly identical, the problem was how to join them.<\/p>\n\n\n\n
If you want to see the details for one disk in the array you can run:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm <\/span>--examine<\/span> <\/span>\/dev\/sdc<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
This gives<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
\/dev\/sdc:<\/span><\/span>\n           Magic <\/span>:<\/span> <\/span>a92b4efc<\/span><\/span>\n         Version <\/span>:<\/span> <\/span>1.2<\/span><\/span>\n     Feature <\/span>Map<\/span> <\/span>:<\/span> <\/span>0x1<\/span><\/span>\n      Array <\/span>UUID<\/span> <\/span>:<\/span> <\/span>391fb756:204b7361:f368c71b:fb4eea09<\/span><\/span>\n            Name <\/span>:<\/span> <\/span>nas1:Mirror<\/span>  (local <\/span>to<\/span> <\/span>host<\/span> <\/span>nas1<\/span>)<\/span><\/span>\n   Creation <\/span>Time<\/span> <\/span>:<\/span> <\/span>Thu<\/span> <\/span>Nov<\/span> <\/span>10<\/span> <\/span>19<\/span>:<\/span>41<\/span>:<\/span>47<\/span> <\/span>2016<\/span><\/span>\n      Raid <\/span>Level<\/span> <\/span>:<\/span> <\/span>raid1<\/span><\/span>\n    Raid <\/span>Devices<\/span> <\/span>:<\/span> <\/span>2<\/span><\/span>\n  Avail <\/span>Dev<\/span> <\/span>Size<\/span> <\/span>:<\/span> <\/span>7813775024<\/span> (3725.90 <\/span>GiB<\/span> <\/span>4000.65<\/span> <\/span>GB<\/span>)<\/span><\/span>\n      Array <\/span>Size<\/span> <\/span>:<\/span> <\/span>2930135488<\/span> (2794.40 <\/span>GiB<\/span> <\/span>3000.46<\/span> <\/span>GB<\/span>)<\/span><\/span>\n   Used <\/span>Dev<\/span> <\/span>Size<\/span> <\/span>:<\/span> <\/span>5860270976<\/span> (2794.40 <\/span>GiB<\/span> <\/span>3000.46<\/span> <\/span>GB<\/span>)<\/span><\/span>\n     Data <\/span>Offset<\/span> <\/span>:<\/span> <\/span>262144<\/span> <\/span>sectors<\/span><\/span>\n    Super <\/span>Offset<\/span> <\/span>:<\/span> <\/span>8<\/span> <\/span>sectors<\/span><\/span>\n           State <\/span>:<\/span> <\/span>clean<\/span><\/span>\n     Device <\/span>UUID<\/span> <\/span>:<\/span> <\/span>fbd7e6a5:7e687f1e:4bd1c7cb:42945d52<\/span><\/span>\n Internal <\/span>Bitmap<\/span> <\/span>:<\/span> <\/span>8<\/span> <\/span>sectors<\/span> <\/span>from<\/span> <\/span>superblock<\/span><\/span>\n     Update <\/span>Time<\/span> <\/span>:<\/span> <\/span>Wed<\/span> <\/span>Dec<\/span> <\/span>23<\/span> <\/span>09<\/span>:<\/span>37<\/span>:<\/span>53<\/span> <\/span>2020<\/span><\/span>\n        Checksum <\/span>:<\/span> <\/span>f4cb61d7<\/span> <\/span>-<\/span> <\/span>correct<\/span><\/span>\n          Events <\/span>:<\/span> <\/span>940496<\/span><\/span>\n     Device <\/span>Role<\/span> <\/span>:<\/span> <\/span>Active<\/span> <\/span>device<\/span> <\/span>0<\/span><\/span>\n     Array <\/span>State<\/span> <\/span>:<\/span> <\/span>A.<\/span> (<\/span>'A'<\/span> == active, <\/span>'.'<\/span> == missing)<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
And for the other disk run:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm <\/span>--examine<\/span> <\/span>\/dev\/sdb<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
Giving:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
\/dev\/sdb:<\/span><\/span>\n           Magic <\/span>:<\/span> <\/span>a92b4efc<\/span><\/span>\n         Version <\/span>:<\/span> <\/span>1.2<\/span><\/span>\n     Feature <\/span>Map<\/span> <\/span>:<\/span> <\/span>0x1<\/span><\/span>\n      Array <\/span>UUID<\/span> <\/span>:<\/span> <\/span>391fb756:204b7361:f368c71b:fb4eea09<\/span><\/span>\n            Name <\/span>:<\/span> <\/span>nas1:Mirror<\/span>  (local <\/span>to<\/span> <\/span>host<\/span> <\/span>nas1<\/span>)<\/span><\/span>\n   Creation <\/span>Time<\/span> <\/span>:<\/span> <\/span>Thu<\/span> <\/span>Nov<\/span> <\/span>10<\/span> <\/span>19<\/span>:<\/span>41<\/span>:<\/span>47<\/span> <\/span>2016<\/span><\/span>\n      Raid <\/span>Level<\/span> <\/span>:<\/span> <\/span>raid1<\/span><\/span>\n    Raid <\/span>Devices<\/span> <\/span>:<\/span> <\/span>2<\/span><\/span>\n  Avail <\/span>Dev<\/span> <\/span>Size<\/span> <\/span>:<\/span> <\/span>5860271024<\/span> (2794.40 <\/span>GiB<\/span> <\/span>3000.46<\/span> <\/span>GB<\/span>)<\/span><\/span>\n      Array <\/span>Size<\/span> <\/span>:<\/span> <\/span>2930135488<\/span> (2794.40 <\/span>GiB<\/span> <\/span>3000.46<\/span> <\/span>GB<\/span>)<\/span><\/span>\n   Used <\/span>Dev<\/span> <\/span>Size<\/span> <\/span>:<\/span> <\/span>5860270976<\/span> (2794.40 <\/span>GiB<\/span> <\/span>3000.46<\/span> <\/span>GB<\/span>)<\/span><\/span>\n     Data <\/span>Offset<\/span> <\/span>:<\/span> <\/span>262144<\/span> <\/span>sectors<\/span><\/span>\n    Super <\/span>Offset<\/span> <\/span>:<\/span> <\/span>8<\/span> <\/span>sectors<\/span><\/span>\n           State <\/span>:<\/span> <\/span>clean<\/span><\/span>\n     Device <\/span>UUID<\/span> <\/span>:<\/span> <\/span>665bdd07:200d588f:1a7bf968:f1b050ee<\/span><\/span>\n Internal <\/span>Bitmap<\/span> <\/span>:<\/span> <\/span>8<\/span> <\/span>sectors<\/span> <\/span>from<\/span> <\/span>superblock<\/span><\/span>\n     Update <\/span>Time<\/span> <\/span>:<\/span> <\/span>Wed<\/span> <\/span>Dec<\/span> <\/span>23<\/span> <\/span>10<\/span>:<\/span>06<\/span>:<\/span>38<\/span> <\/span>2020<\/span><\/span>\n        Checksum <\/span>:<\/span> <\/span>8c53478d<\/span> <\/span>-<\/span> <\/span>correct<\/span><\/span>\n          Events <\/span>:<\/span> <\/span>943424<\/span><\/span>\n     Device <\/span>Role<\/span> <\/span>:<\/span> <\/span>Active<\/span> <\/span>device<\/span> <\/span>1<\/span><\/span>\n     Array <\/span>State<\/span> <\/span>:<\/span> <\/span>.A<\/span> (<\/span>'A'<\/span> == active, <\/span>'.'<\/span> == missing)<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
The resolution<\/h2>\n\n\n\n
As with some of these things it can be a simple trick to fix, it’s just a ton of Googling to find it.<\/p>\n\n\n\n
You need to run:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm <\/span>--manage<\/span> <\/span>\/devmd126<\/span> <\/span>--re-add<\/span> <\/span>\/dev\/sdc<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
Unfortunately this will give you an error:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm: <\/span>error<\/span> <\/span>opening<\/span> <\/span>\/devmd126:<\/span> <\/span>No<\/span> <\/span>such<\/span> <\/span>file<\/span> <\/span>or<\/span> <\/span>directory<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
To fix this you need to run:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm <\/span>--stop<\/span> <\/span>\/dev\/md127<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
Now the problem is that because I had set this up as a share one of the current mirrors, md126 or md127 will be serving the SMB share. so you may get back:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm: <\/span>Cannot<\/span> <\/span>get<\/span> <\/span>exclusive<\/span> <\/span>access<\/span> <\/span>to<\/span> <\/span>\/dev\/md127:Perhaps<\/span> <\/span>a<\/span> <\/span>running<\/span> <\/span>process,<\/span> <\/span>mounted<\/span> <\/span>filesystem<\/span> <\/span>or<\/span> <\/span>active<\/span> <\/span>volume<\/span> <\/span>group?<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
If happens try to stop the other mirror so try:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm <\/span>--stop<\/span> <\/span>\/dev\/md126<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
Which gives:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm: <\/span>stopped<\/span> <\/span>\/dev\/md126<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
So now the mirror md127 is still running and you will recall earlier you ran “mdadm –detail \/dev\/md127” which included the line:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
       3       <\/span>8<\/span>       <\/span>16<\/span>        <\/span>1<\/span>      <\/span>active<\/span> <\/span>sync<\/span>   <\/span>\/dev\/sdb<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
So you need to readd the OTHER disk, which is sdc. So run the following:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm <\/span>--manage<\/span> <\/span>\/dev\/md127<\/span> <\/span>--re-add<\/span> <\/span>\/dev\/sdc<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
Which returns:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
mdadm: <\/span>re-added<\/span> <\/span>\/dev\/sdc<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
Now in OMV you see the RAID is fixed:<\/p>\n\n\n\n
<\/div>\n\n\n\n
\"\"<\/figure>\n\n\n\n
At this point it’s fixed, see it was simple, once you got to the bottom of it.<\/p>\n\n\n\n
Testing I did<\/h2>\n\n\n\n
I was quite concerned that the merged array was working. I when it was up I went to one of the shares and deleted some files and added one large video file.<\/p>\n\n\n\n
Then I took one drive out and restarted OMV and check the files were as expected and I could play the video<\/p>\n\n\n\n
Then I swapped and took other the other drive and connected the one I just removed. Again I checked the share and checked I could play the video.<\/p>\n\n\n\n
So for myself I believe it is working ok<\/p>\n\n\n\n
What are events<\/h2>\n\n\n\n
When you do a “–details” or “–examine” you will see a line that looks like:<\/p>\n\n\n\n
<\/path><\/path><\/svg><\/span>
Events <\/span>:<\/span> <\/span>944167<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
I assumed that this number should be constantly increasing whenever I changed the file system. I now don’t think that is the case and although I am not completely sure, I think it is related to “events” in the array, as in things that have happened on the array – I don’t believe just because the number doesn’t change or it goes up, that anything is broken.<\/p>\n\n\n\n
It is also very important to note that the listed “events” is not real time or does not appear to be. You should give it a few minutes and repeat the command and you will often see the number change.<\/p>\n\n\n\n
If there have been no file changes I have found that the numbers reported for each disk will stablize and be the same number.<\/p>\n\n\n\n
Spares Missing Event emails<\/h2>\n\n\n\n
After fixing the array you may find you get emails from OMV with a subject similar to:<\/p>\n\n\n\n
SparesMissing event on \/dev\/md\/Mirror:nas1 [nas1.cantabrian]<\/code><\/pre>\n\n\n\n
If you do follow the instructions in the post: Spares missing event emails after RAID changes<\/a><\/p>\n\n\n\n
<\/p>\n","protected":false},"excerpt":{"rendered":"
I had setup a mirrored RAID in OMV and then the PC hardware, not the disks I should emphasize, failed and I needed to move the system disk and two data disks to other hardware. Because I decided to test each disk separately this broke the mirror and in OMV I now saw: Work off […]<\/p>\n","protected":false},"author":2,"featured_media":5504,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[796,4,313],"tags":[318,668,338,667,331,669,319,320,326,666,94,664,670,665],"class_list":["post-4393","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-home-page","category-linux","category-open-media-vault","tag-debian","tag-fix","tag-mdadm","tag-merge","tag-mirror","tag-mirror-array","tag-omv","tag-open-media-vault","tag-raid","tag-separated","tag-setup","tag-split","tag-two","tag-unjoined"],"_links":{"self":[{"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=\/wp\/v2\/posts\/4393","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4393"}],"version-history":[{"count":23,"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=\/wp\/v2\/posts\/4393\/revisions"}],"predecessor-version":[{"id":5799,"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=\/wp\/v2\/posts\/4393\/revisions\/5799"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=\/wp\/v2\/media\/5504"}],"wp:attachment":[{"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4393"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4393"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.zoyinc.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4393"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}